Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.
  2. Join us on March 30, 2023, between 5 am & 1 pm EST, in the Performance Profiling Dev Blitz Day 2023 - Q&A forum and Discord where you can connect with our teams behind the Memory and CPU Profilers.
    Dismiss Notice
New Forum User Notice Performance Profiling Dev Blitz Day 2023

Question How to detect episode finished using low-level API?

Discussion in 'ML-Agents' started by hughperkins, Dec 28, 2022.

  1. hughperkins

    hughperkins

    Joined:
    Dec 3, 2022
    Posts:
    175
    For example, I receive in get_steps:

    - one decision, for a new agent id 3
    - two terminals, for agent id 2 and agent id 0; both with interrupted False

    New episode? Or continuation of old episode?

    Now, I happen to know that this is a new episode, and agent id 3 is being added in this new episode, and in the next steps agent id 2 and 0 will reappear too. But from this get steps, there appears no obvious way to tell?

    After all, perhaps agents 2 and 0 both died, and agent id 3 was created, in the same step, and that would be indistinguishable from this, right?
     
    hughperkins, Dec 28, 2022
    #1