Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.
  2. We have updated the language to the Editor Terms based on feedback from our employees and community. Learn more.
    Dismiss Notice
  3. Join us on November 16th, 2023, between 1 pm and 9 pm CET for Ask the Experts Online on Discord and on Unity Discussions.
    Dismiss Notice
  4. Dismiss Notice

How to get the output of a trained model (deep learning), object recognition and image segmentation

Discussion in 'General Discussion' started by Christin2015, Jan 25, 2019.

  1. Christin2015

    Christin2015

    Joined:
    Dec 1, 2015
    Posts:
    46
    Hi all,

    I would like to get the output of a trained model (Deep Learning) for object recognition and image segmentation tasks. I am looking for the right way how to use such a model in Unity that I have already trained with PyTorch or Tensorflow.
    Could anyone point me to the right direction? This would be great.
    What is the general workflow? What kind of libraries should I use?

    Is the ML Agents Toolkit a solution? As far as I am understand , it is "only" Deep Reinforcement Learning which solves Markov Decision Process problems and which is rather not related to object recognition and image segmentation tasks. I might be wrong, however.
     
    qstrinati_expleo likes this.
  2. sa2706

    sa2706

    Joined:
    Sep 10, 2021
    Posts:
    2
    did you find an answer for that?
     
  3. Christin2015

    Christin2015

    Joined:
    Dec 1, 2015
    Posts:
    46
    @sa2706 I have not pursued, but want to try again with Unity Barracuda. With Barracuda it is now possible to import Pytorch, Tensorflow models that have been converted to ONNX format.