Question ML-Agents stopped before arrive to Max steps.

Hello.

I am trying to use ML-Agents.
Now, ML-Agents learnning stopped before arrive to Max steps.
(Stop at 500000 steps)

config file is follows:

Code (Boo):

1. behaviors:
2.   BalanceGame:
3.     trainer_type: ppo
4.     hyperparameters:
5.       batch_size: 512
6.       buffer_size: 65536
7.       learning_rate: 3e-5
8.       beta: 0.001
9.       epsilon: 0.2
10.       lambd: 0.99
11.       num_epoch: 8
12.       learning_rate_schedule: linear
13.     network_settings:
14.       normalize: true
15.       hidden_units: 256
16.       num_layers: 2
17.       vis_encode_type: simple
18.     reward_signals:
19.       extrinsic:
20.         gamma: 0.99
21.         strength: 1.0
22.     keep_checkpoints: 50000
23.     max_steps: 1.0e7
24.     time_horizon: 64
25.     summary_freq: 10000
26.     threaded: true
27.  

My environments are follows:
Unity: 2020.3.17f1
ML-Agents:0.17.0

Thanks for your help.

 

500000 steps is the default value. Are you sure you have the correct behaviour name or you are using this yaml file?

 

It salved.
I missed behavior name in yaml file.
Thank you!