Search Unity

  1. All Pro and Enterprise subscribers: find helpful & inspiring creative, tech, and business know-how in the new Unity Success Hub. Sign in to stay up to date.
    Dismiss Notice
  2. Dismiss Notice

Model not improving after 10 million steps

Discussion in 'ML-Agents' started by insane245, Jun 8, 2021.

  1. insane245

    insane245

    Joined:
    Jun 28, 2016
    Posts:
    10
    I've attached the screenshot for my training. I've let it run for over 10 million steps but there is no correlation, which tells me my model isn't learning anything. Do you know why this is, or what I could do to improve it? Each episode is the same length.
     

    Attached Files:

  2. andrewcoh_unity

    andrewcoh_unity

    Unity Technologies

    Joined:
    Sep 5, 2019
    Posts:
    157
    Hi @insane245

    I'd need more information to help debug your issue. I would confirm that your agent is actually able to reach rewarding states and also that the termination conditions work properly e.g. EndEpisode is being called using either keyboard controls or during training.
     
unityunity