Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.
  2. We’re making changes to the Unity Runtime Fee pricing policy that we announced on September 12th. Access our latest thread for more information!
    Dismiss Notice
  3. Dismiss Notice

Resolved Learning rate drops to 0

Discussion in 'ML-Agents' started by mateolopezareal, Jun 7, 2020.

  1. mateolopezareal

    mateolopezareal

    Joined:
    Jun 4, 2020
    Posts:
    54
    Screenshot 2020-06-07 at 10.16.14.png
    Screenshot 2020-06-07 at 10.21.57.png
    Screenshot 2020-06-07 at 10.28.09.png
    As you can see in the image above, the learning rate of this run decreases to 0, is this a problem? I have attached some images of the reward and the entropy. The beta that I am using is 0.4, so the entropy decreases like that, is that okay or should I change it? Is the Learning rate thing the problem of the reward? What does it change the learning rate value of the configuration file to the learning rate graph?​
     
  2. MrWetsnow

    MrWetsnow

    Joined:
    Jan 5, 2020
    Posts:
    60
    The learning rate and entropy will both decrease over time, this is normal.
     
  3. celion_unity

    celion_unity

    Unity Technologies

    Joined:
    Jun 12, 2019
    Posts:
    289
  4. mateolopezareal

    mateolopezareal

    Joined:
    Jun 4, 2020
    Posts:
    54