Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.
  2. Unite 2023 Registrations are now LIVE! We are thrilled to announce that Unite 2023 Registration is now live and open for all!
    Dismiss Notice
New Forum User Notice Unite 2023 Registrations are now LIVE!

Active tracking environment

Discussion in 'ML-Agents' started by KNRichardson, Nov 4, 2020.

  1. KNRichardson

    KNRichardson

    Joined:
    Jul 20, 2020
    Posts:
    6
    Put together an environment for training an agent cube to follow a travelling target cube, in two scenes that use vector and visual observations respectively.

    Medium blog: https://knrichardson.medium.com/cub...ve-tracking-with-unity-ml-agents-6b92d58acb5d

    GitHub repo: https://github.com/kirstenrichardson/CubeTrack

    Appreciate any feedback, mistake spots etc

    Two questions I had:
    - anyone know why training with multiple Area instances would generate occasional 'No episode was completed since last summary' messages in the terminal (and 'None' in the Episode length column of the results folder csv file) even though episodes should terminate at 3,000 steps and summary frequency is set to 10,000
    - when I changed the visual encoder to resnet, the simulation in the Unity Editor pauses regularly throughout training which I assume is when the model update is being performed. Is this an example of when moving up to the cloud and utilising a GPU would be beneficial (currently training on laptop CPU with 4 cores, 8 threads), or is there anything about the training config that might cause this
     
    KNRichardson, Nov 4, 2020
    #1

  2. jeffrey_unity538

    jeffrey_unity538

    Unity Technologies

    Joined:
    Feb 15, 2018
    Posts:
    59
    hi @KNRichardson - thanks, as discussed, the blog and repo look good with the changes we went over on github.

    For those two questions, let me check with the team.
     
    jeffrey_unity538, Nov 9, 2020
    #2

  3. jeffrey_unity538

    jeffrey_unity538

    Unity Technologies

    Joined:
    Feb 15, 2018
    Posts:
    59
    hi @KNRichardson - would you be interested in being an alpha user for our cloud training service (specifically for the 2nd bullet around visual encoer using resnet)? If so, I can provide some more details. can you shoot me an emai to jeffrey@unity3d.com?
     
    jeffrey_unity538, Nov 10, 2020
    #3