Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.
  2. Dismiss Notice

Deep learning camera output for unity with ROS

Discussion in 'Robotics' started by maciejw94, Jun 10, 2022.

  1. maciejw94

    maciejw94

    Joined:
    Feb 11, 2022
    Posts:
    6
    Hi,
    I was wondering if anyone had experience with running DL models in unity for the robotics (mobile robot to be specific) oriented tasks?
    I am wondering if you would:
    a) train the model outside Unity and use the Onyx library to make detections inside Unity
    or
    b) publish an image/camera output (as ros topic), run the model outside of unity and then just send back the output (e.g. coordinates of detected objects)?

    Following on that, is there any "proper" way to publish the camera output from unity as a ros topic?