Search Unity

How to get the output of a trained model (deep learning), object recognition and image segmentation

Discussion in 'General Discussion' started by Christin2015, Jan 25, 2019.

  1. Christin2015

    Christin2015

    Joined:
    Dec 1, 2015
    Posts:
    48
    Hi all,

    I would like to get the output of a trained model (Deep Learning) for object recognition and image segmentation tasks. I am looking for the right way how to use such a model in Unity that I have already trained with PyTorch or Tensorflow.
    Could anyone point me to the right direction? This would be great.
    What is the general workflow? What kind of libraries should I use?

    Is the ML Agents Toolkit a solution? As far as I am understand , it is "only" Deep Reinforcement Learning which solves Markov Decision Process problems and which is rather not related to object recognition and image segmentation tasks. I might be wrong, however.
     
    qstrinati_expleo likes this.
  2. sa2706

    sa2706

    Joined:
    Sep 10, 2021
    Posts:
    2
    did you find an answer for that?
     
  3. Christin2015

    Christin2015

    Joined:
    Dec 1, 2015
    Posts:
    48
    @sa2706 I have not pursued, but want to try again with Unity Barracuda. With Barracuda it is now possible to import Pytorch, Tensorflow models that have been converted to ONNX format.