Search Unity

Question Discrete Action Branches

Discussion in 'ML-Agents' started by JustnTrying, Feb 1, 2023.

  1. JustnTrying

    JustnTrying

    Joined:
    Sep 24, 2021
    Posts:
    7
    When I've got 100 actions for my agent to choose from, is it better to create one discrete action branch with size 100 or to create 100 branches with size 1?
    Does this make any difference?
     
  2. hughperkins

    hughperkins

    Joined:
    Dec 3, 2022
    Posts:
    191
    A branch of size 1 will always choose the same single action every time. 100 of those is 100 identical choices.

    You want a single branch of size 100.

    (alternatively, you could have 2 branches of size 10, giving 10x10 total possible actions; or any combination of factors of 100 (that multiply together to give 100) (you can google "factorization" for more information on factors ) )
     
    Last edited: Feb 1, 2023
    JustnTrying likes this.
  3. JustnTrying

    JustnTrying

    Joined:
    Sep 24, 2021
    Posts:
    7
    Thanks!
     
    hughperkins likes this.