Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.
  2. Dismiss Notice

ONNX Model inputs

Discussion in 'ML-Agents' started by hmusr09, Jul 21, 2021.

  1. hmusr09

    hmusr09

    Joined:
    Jun 28, 2021
    Posts:
    3
    I was trying to run inference the ONNX model for the Crawler example using python and onnx runtime. I was able to load convert and run the model, but the input shape of the model seems to have two inputs obs_0 and obs_1
    the shape is below

    obs_0: batch, 126,
    obs_1: batch, 32,

    obs_1 is what I would expect the model inputs to be, as set up by the CollectObservations function in the Crawler.cs file with 32 observations.

    But what is the obs_0 supposed to contain? are these 126 observations auto set up by the library? or are they just padded values to support an unused feature?
     
  2. ervteng_unity

    ervteng_unity

    Unity Technologies

    Joined:
    Dec 6, 2018
    Posts:
    150
    I believe they're two sets of observations, one from the joints and body,. and another from those added into the code. You should see an additional Sensor Component on the Agent, which automatically adds these additional observations.