Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.
  2. We have updated the language to the Editor Terms based on feedback from our employees and community. Learn more.
    Dismiss Notice
New Forum User Notice Update to the Unity Editor Software Terms

Question How to detect episode finished using low-level API?

Discussion in 'ML-Agents' started by hughperkins, Dec 28, 2022.

  1. hughperkins

    hughperkins

    Joined:
    Dec 3, 2022
    Posts:
    191
    For example, I receive in get_steps:

    - one decision, for a new agent id 3
    - two terminals, for agent id 2 and agent id 0; both with interrupted False

    New episode? Or continuation of old episode?

    Now, I happen to know that this is a new episode, and agent id 3 is being added in this new episode, and in the next steps agent id 2 and 0 will reappear too. But from this get steps, there appears no obvious way to tell?

    After all, perhaps agents 2 and 0 both died, and agent id 3 was created, in the same step, and that would be indistinguishable from this, right?
     
    hughperkins, Dec 28, 2022
    #1