Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.
  2. We have updated the language to the Editor Terms based on feedback from our employees and community. Learn more.
    Dismiss Notice
  3. Join us on November 16th, 2023, between 1 pm and 9 pm CET for Ask the Experts Online on Discord and on Unity Discussions.
    Dismiss Notice
  4. Unite 2023 Registrations are now LIVE! We are thrilled to announce that Unite 2023 Registration is now live and open for all!
    Dismiss Notice
New Forum User Notice Update to the Unity Editor Software Terms Unite 2023 - Ask the Experts Online Unite 2023 Registrations are now LIVE!

Question Help needed : Relation between different time steps

Discussion in 'ML-Agents' started by Aurel33, May 4, 2022.

  1. Aurel33

    Aurel33

    Joined:
    Apr 12, 2018
    Posts:
    10
    Hello,

    I'm confused between all different steps units used in MLAgents :

    • Unity Step
    • Unity Fixed Step
    • Unity Agent Max Step
    • Hyperparameter max_steps
    • Hyperparameter buffer_size (assuming its in step unit also but which one ?)
    • time_horizon
    • summary_freq
    Their is also "Experience", when is collected an Experience, what it is composed of ?

    Relation between those step units and Unity Agent DecisionPeriod ?

    What should append to the Hyperparameter buffer_size (and maybe others) when performing paralel training (either by cloning env in unity itself or using multiple exe)

    It's realy confusing for me.

    Thank you
     
    Aurel33, May 4, 2022
    #1

  2. Aurel33

    Aurel33

    Joined:
    Apr 12, 2018
    Posts:
    10
    Little Up, thanks
     
    Aurel33, May 7, 2022
    #2

  3. Aurel33

    Aurel33

    Joined:
    Apr 12, 2018
    Posts:
    10
    no one for help ?
     
    Aurel33, May 12, 2022
    #3

  4. jrupert-unity

    jrupert-unity

    Unity Technologies

    Joined:
    Oct 20, 2021
    Posts:
    12
    jrupert-unity, May 17, 2022
    #4