Search Unity

Question Help needed : Relation between different time steps

Discussion in 'ML-Agents' started by Aurel33, May 4, 2022.

  1. Aurel33

    Aurel33

    Joined:
    Apr 12, 2018
    Posts:
    10
    Hello,

    I'm confused between all different steps units used in MLAgents :

    • Unity Step
    • Unity Fixed Step
    • Unity Agent Max Step
    • Hyperparameter max_steps
    • Hyperparameter buffer_size (assuming its in step unit also but which one ?)
    • time_horizon
    • summary_freq
    Their is also "Experience", when is collected an Experience, what it is composed of ?

    Relation between those step units and Unity Agent DecisionPeriod ?

    What should append to the Hyperparameter buffer_size (and maybe others) when performing paralel training (either by cloning env in unity itself or using multiple exe)

    It's realy confusing for me.

    Thank you
     
    Aurel33, May 4, 2022
    #1

  2. Aurel33

    Aurel33

    Joined:
    Apr 12, 2018
    Posts:
    10
    Little Up, thanks
     
    Aurel33, May 7, 2022
    #2

  3. Aurel33

    Aurel33

    Joined:
    Apr 12, 2018
    Posts:
    10
    no one for help ?
     
    Aurel33, May 12, 2022
    #3

  4. jrupert-unity

    jrupert-unity

    Unity Technologies

    Joined:
    Oct 20, 2021
    Posts:
    12
    jrupert-unity, May 17, 2022
    #4