Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.
  2. Join us on March 30, 2023, between 5 am & 1 pm EST, in the Performance Profiling Dev Blitz Day 2023 - Q&A forum and Discord where you can connect with our teams behind the Memory and CPU Profilers.
    Dismiss Notice

Episode definition

Discussion in 'ML-Agents' started by Satyros, Feb 2, 2020.

  1. Satyros


    Feb 8, 2015
    In an environment with multiple agents, how exactly does the following loop work:

    The academy OnEnvironmentReset is called in the beginning of my simulation, but despite all my agents being marked as "done" and resetting multiple times the delegate is never called again.
    Is that a bug on the master branch or expected functionality?
    Does the learning for the PPO happen after each episode or after each agent reset?
    In short, what exactly is an episode and how does it relate to agent training?

    Thanks in advance! :)
    Aelcyx likes this.