Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.
  2. Unite 2023 Registrations are now LIVE! We are thrilled to announce that Unite 2023 Registration is now live and open for all!
    Dismiss Notice
New Forum User Notice Unite 2023 Registrations are now LIVE!

Question Keep neural network model when switching from training to inference while running.

Discussion in 'ML-Agents' started by YunaoShen, Aug 3, 2020.

  1. YunaoShen

    YunaoShen

    Joined:
    Sep 9, 2019
    Posts:
    10
    Hi, I'm working on a project that requires agents switching between training and inference model while the training session is running. I found it easy to switch mode while running by simply change the behavior type. But the agent actually loads the selected model before the unity instance start, not keeping the training neural network policy before switching. Is it possible to keep current neural network model while switching from training to inference? Seems I have to modify the source code but I can't find where to start with.
     
    YunaoShen, Aug 3, 2020
    #1

  2. celion_unity

    celion_unity

    Unity Technologies

    Joined:
    Jun 12, 2019
    Posts:
    289
    Hi,
    It's possible to load .nn files from disk during training (not .onnx files yet, though). There is some example code for this here.

    As of the last release, we don't create .nn files during training, only at the end. The next release (and currently on the master branch) will create .nn files when it creates snapshots.

    So putting those two together, I think you can do something like
    1) Determine which .nn file created by a snapshot to load
    2) Use the sample code to load the .nn file and produce a NNModel instance
    3) Call Agent.SetModel with the new NNModel, and set the behavior type to InferenceOnly,.
     
    celion_unity, Aug 3, 2020
    #2

  3. YunaoShen

    YunaoShen

    Joined:
    Sep 9, 2019
    Posts:
    10
    Thank you for your response. I got the idea by setting model. So currently we can't use the model snapshots when switching cause it doesn't generate .nn untill training ends. And your team is working on this probelm right? It's a great news to hear about. By the way is current master branch already able to do this or still in progress? I'm willing to try out now if the answer is yes.
     
    YunaoShen, Aug 3, 2020
    #3

  4. celion_unity

    celion_unity

    Unity Technologies

    Joined:
    Jun 12, 2019
    Posts:
    289
    celion_unity, Aug 3, 2020
    #4

  5. YunaoShen

    YunaoShen

    Joined:
    Sep 9, 2019
    Posts:
    10
    YunaoShen, Aug 3, 2020
    #5

  6. YunaoShen

    YunaoShen

    Joined:
    Sep 9, 2019
    Posts:
    10
    Hi. I'm trying this new feature in master branch now. It seems working fine. The only problem is that it doesn't generate snapshots while switching behavior type. Is there any way to generate snapshot and .nn models while switching from training to inference? Thank you.
     
    YunaoShen, Aug 5, 2020
    #6

  7. celion_unity

    celion_unity

    Unity Technologies

    Joined:
    Jun 12, 2019
    Posts:
    289
    Sorry, this isn't possible right now; snapshots are only generated at regular intervals during training (controlled by checkpoint_interval in the trainer config).
     
    celion_unity, Aug 5, 2020
    #7

  8. YunaoShen

    YunaoShen

    Joined:
    Sep 9, 2019
    Posts:
    10
    Okay. Thank you anyway.
     
    YunaoShen, Aug 5, 2020
    #8