Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.

Question Why decision_steps in unityenvironment suddenly get nothing?

Discussion in 'ML-Agents' started by Dream_Surpass, Dec 9, 2022.

  1. Dream_Surpass


    Dec 2, 2022
    I try to use custom PPO algorithm to train a continuous action env(3DBall or others) in python by ml-agents env, just like tutorial, which use custom Qlearning to train discrete action space env.

    At the beginning 3DBall env can run normally, but several seconds later it terminates.

    I find decision_steps suddenly get nothing from last env step(it works normally at the beginning and the obs shape is [num_agents, obs_dim]), and I pass the obs to net to get the action(actually null), so compiler report an error above.


    Any ideas will be appreciated. Thanks!