Search Unity

  1. Unity support for visionOS is now available. Learn more in our blog post.
    Dismiss Notice

Episode definition

Discussion in 'ML-Agents' started by Satyros, Feb 2, 2020.

  1. Satyros

    Satyros

    Joined:
    Feb 8, 2015
    Posts:
    6
    In an environment with multiple agents, how exactly does the following loop work:

    The academy OnEnvironmentReset is called in the beginning of my simulation, but despite all my agents being marked as "done" and resetting multiple times the delegate is never called again.
    Is that a bug on the master branch or expected functionality?
    Does the learning for the PPO happen after each episode or after each agent reset?
    In short, what exactly is an episode and how does it relate to agent training?

    Thanks in advance! :)
     
    Aelcyx likes this.