Search Unity

  1. If you have experience with import & exporting custom (.unitypackage) packages, please help complete a survey (open until May 15, 2024).
    Dismiss Notice
  2. Unity 6 Preview is now available. To find out what's new, have a look at our Unity 6 Preview blog post.
    Dismiss Notice

Question Long time frozen when training resume.

Discussion in 'ML-Agents' started by wglxxx, May 21, 2020.

  1. wglxxx

    wglxxx

    Joined:
    Oct 27, 2018
    Posts:
    6
    Hello,
    I have a problem that can be reproduced.
    When I resume a training run that has been running for several hours,the unity editor has a long frozen in a few minutes(only one time and lasts for almost half an hour).
    But python still working.When the editor returns to normal, all behavior got a big reward.Most indicators are abnormal on the Tensorboard.I don’t know where I made a mistake.
    Here is my config file:
    default:
    trainer: sac
    batch_size: 128
    buffer_size: 50000
    buffer_init_steps: 0
    hidden_units: 128
    init_entcoef: 1.0
    learning_rate: 3.0e-4
    learning_rate_schedule: constant
    max_steps: 5.0e5
    memory_size: 128
    normalize: false
    steps_per_update: 10
    num_layers: 2
    time_horizon: 64
    sequence_length: 64
    summary_freq: 5000
    tau: 0.005
    use_recurrent: false
    vis_encode_type: simple
    reward_signals:
    extrinsic:
    strength: 1.0
    gamma: 0.99
    Cha 1:
    init_entcoef: 0.1
    reward_signals:
    extrinsic:
    strength: 1.0
    gamma: 0.99
    curiosity:
    strength: 0.003
    gamma: 0.99
    encoding_size: 256
    Cha 1 c1:
    init_entcoef: 0.1
    reward_signals:
    extrinsic:
    strength: 1.0
    gamma: 0.99
    curiosity:
    strength: 0.003
    gamma: 0.99
    encoding_size: 256
    Cha 1 r1:
    init_entcoef: 0.1
    reward_signals:
    extrinsic:
    strength: 1.0
    gamma: 0.99
    curiosity:
    strength: 0.003
    gamma: 0.99
    encoding_size: 256
    Cha 1 b1:
    init_entcoef: 0.1
    reward_signals:
    extrinsic:
    strength: 1.0
    gamma: 0.99
    curiosity:
    strength: 0.003
    gamma: 0.99
    encoding_size: 256
    Cha 1 d1:
    init_entcoef: 0.1
    reward_signals:
    extrinsic:
    strength: 1.0
    gamma: 0.99
    curiosity:
    strength: 0.003
    gamma: 0.99
    encoding_size: 256
     
  2. TreyK-47

    TreyK-47

    Unity Technologies

    Joined:
    Oct 22, 2019
    Posts:
    1,830