Search Unity

  1. Megacity Metro Demo now available. Download now.
    Dismiss Notice
  2. Unity support for visionOS is now available. Learn more in our blog post.
    Dismiss Notice

Question GridWorld!!!!

Discussion in 'ML-Agents' started by PxZzYYDS, Apr 10, 2021.

  1. PxZzYYDS

    PxZzYYDS

    Joined:
    Mar 26, 2021
    Posts:
    13
    i change the 'gridsize' to 15f
    but the train wasn't convengence,here are the parameters.
    i want to konw the suitable value of parameters
    upload_2021-4-10_10-1-1.png

    upload_2021-4-10_10-3-0.png
     
  2. andrewcoh_unity

    andrewcoh_unity

    Unity Technologies

    Joined:
    Sep 5, 2019
    Posts:
    162
    Hi @PengXiao9912

    I recommend you first try training with the default hyperparameters given in GridWorld.yaml and then make small adjustments from there. It's good practice to only change one parameter at a time as changing multiple parameters may cause changes in algorithm dynamics that can be hard to understand.

    Additionally, my intuition is that the network is too large, the time horizon too small and that you do not need the use an LSTM (use_recurrent=True) for this problem. Please see documentation here for guidelines https://github.com/Unity-Technologi...uration-File.md#common-trainer-configurations
     
  3. PxZzYYDS

    PxZzYYDS

    Joined:
    Mar 26, 2021
    Posts:
    13
    Do i need to use LSTM if the girdsize is too large?In other words,when i should use LSTM