Search Unity

  1. We are migrating the Unity Forums to Unity Discussions. On July 12, the Unity Forums will become read-only.

    Please, do not make any changes to your username or email addresses at id.unity.com during this transition time.

    It's still possible to reply to existing private message conversations during the migration, but any new replies you post will be missing after the main migration is complete. We'll do our best to migrate these messages in a follow-up step.

    On July 15, Unity Discussions will become read-only until July 18, when the new design and the migrated forum contents will go live.


    Read our full announcement for more information and let us know if you have any questions.

Question How to detect episode finished using low-level API?

Discussion in 'ML-Agents' started by hughperkins, Dec 28, 2022.

  1. hughperkins

    hughperkins

    Joined:
    Dec 3, 2022
    Posts:
    195
    For example, I receive in get_steps:

    - one decision, for a new agent id 3
    - two terminals, for agent id 2 and agent id 0; both with interrupted False

    New episode? Or continuation of old episode?

    Now, I happen to know that this is a new episode, and agent id 3 is being added in this new episode, and in the next steps agent id 2 and 0 will reappear too. But from this get steps, there appears no obvious way to tell?

    After all, perhaps agents 2 and 0 both died, and agent id 3 was created, in the same step, and that would be indistinguishable from this, right?