Search Unity

  1. Unity 6 Preview is now available. To find out what's new, have a look at our Unity 6 Preview blog post.
    Dismiss Notice
  2. Unity is excited to announce that we will be collaborating with TheXPlace for a summer game jam from June 13 - June 19. Learn more.
    Dismiss Notice
  3. Dismiss Notice

Question Changing agent operator script while training process. Is it bad?

Discussion in 'ML-Agents' started by Pavel_Arkhipov, Aug 25, 2023.

  1. Pavel_Arkhipov

    Pavel_Arkhipov

    Joined:
    Jul 19, 2020
    Posts:
    12
    I've been teaching my agent for a while now and changing its code regularly. I've been tweaking how it gets rewards and how it takes actions. I'm doing this to figure out the best way to teach it, and also because I tried making it learn easier things before moving on to harder stuff. Every time I initialized my training process from previous session.

    I'm wondering if this is a bad thing. Should I start teaching the agent all over again using the newest version of the code? I'm asking because I'm starting to see that the agent is having trouble learning new ways to do things and it's getting stuck in its training.
     
  2. smallg2023

    smallg2023

    Joined:
    Sep 2, 2018
    Posts:
    154
    you can use the academy lessons to change the environment a bit (generally this is meant for things like making the goal move further away or the number of goals required might increase etc not really changing the agent itself).
    ML is not exact though, it is quite difficult to know the best route without experimenting, it can definitely be very time consuming letting them train over and over :)
     
  3. Pavel_Arkhipov

    Pavel_Arkhipov

    Joined:
    Jul 19, 2020
    Posts:
    12
    Thanks for the advise