Search Unity

  1. Unity Asset Manager is now available in public beta. Try it out now and join the conversation here in the forums.
    Dismiss Notice
  2. Megacity Metro Demo now available. Download now.
    Dismiss Notice
  3. Unity support for visionOS is now available. Learn more in our blog post.
    Dismiss Notice

Deep learning camera output for unity with ROS

Discussion in 'Robotics' started by maciejw94, Jun 10, 2022.

  1. maciejw94

    maciejw94

    Joined:
    Feb 11, 2022
    Posts:
    6
    Hi,
    I was wondering if anyone had experience with running DL models in unity for the robotics (mobile robot to be specific) oriented tasks?
    I am wondering if you would:
    a) train the model outside Unity and use the Onyx library to make detections inside Unity
    or
    b) publish an image/camera output (as ros topic), run the model outside of unity and then just send back the output (e.g. coordinates of detected objects)?

    Following on that, is there any "proper" way to publish the camera output from unity as a ros topic?