Search Unity

Question How to detect episode finished using low-level API?

Discussion in 'ML-Agents' started by hughperkins, Dec 28, 2022.

  1. hughperkins

    hughperkins

    Joined:
    Dec 3, 2022
    Posts:
    191
    For example, I receive in get_steps:

    - one decision, for a new agent id 3
    - two terminals, for agent id 2 and agent id 0; both with interrupted False

    New episode? Or continuation of old episode?

    Now, I happen to know that this is a new episode, and agent id 3 is being added in this new episode, and in the next steps agent id 2 and 0 will reappear too. But from this get steps, there appears no obvious way to tell?

    After all, perhaps agents 2 and 0 both died, and agent id 3 was created, in the same step, and that would be indistinguishable from this, right?