Search Unity

  1. Unity 6 Preview is now available. To find out what's new, have a look at our Unity 6 Preview blog post.
    Dismiss Notice
  2. Unity is excited to announce that we will be collaborating with TheXPlace for a summer game jam from June 13 - June 19. Learn more.
    Dismiss Notice

Question Discrete Action Branches

Discussion in 'ML-Agents' started by JustnTrying, Feb 1, 2023.

  1. JustnTrying

    JustnTrying

    Joined:
    Sep 24, 2021
    Posts:
    7
    When I've got 100 actions for my agent to choose from, is it better to create one discrete action branch with size 100 or to create 100 branches with size 1?
    Does this make any difference?
     
  2. hughperkins

    hughperkins

    Joined:
    Dec 3, 2022
    Posts:
    195
    A branch of size 1 will always choose the same single action every time. 100 of those is 100 identical choices.

    You want a single branch of size 100.

    (alternatively, you could have 2 branches of size 10, giving 10x10 total possible actions; or any combination of factors of 100 (that multiply together to give 100) (you can google "factorization" for more information on factors ) )
     
    Last edited: Feb 1, 2023
    JustnTrying likes this.
  3. JustnTrying

    JustnTrying

    Joined:
    Sep 24, 2021
    Posts:
    7
    Thanks!
     
    hughperkins likes this.