Episode definition

Satyros · Feb 2, 2020

In an environment with multiple agents, how exactly does the following loop work:

Calls your Academy's OnEnvironmentReset delegate.

Calls the AgentReset() function for each Agent in the scene.

Calls the CollectObservations() function for each Agent in the scene.

Uses each Agent's Policy to decide on the Agent's next action.

Calls the AgentAction() function for each Agent in the scene, passing in the action chosen by the Agent's Policy. (This function is not called if the Agent is done.)

Calls the Agent's AgentReset() function if the Agent has reached its Max Step count or has otherwise marked itself as done.

Click to expand...

The academy OnEnvironmentReset is called in the beginning of my simulation, but despite all my agents being marked as "done" and resetting multiple times the delegate is never called again.
Is that a bug on the master branch or expected functionality?
Does the learning for the PPO happen after each episode or after each agent reset?
In short, what exactly is an episode and how does it relate to agent training?

Thanks in advance!

Search Unity

Unity ID

Episode definition

Satyros