Search Unity

  1. Read here for Unity's latest plans on OpenXR.
    Dismiss Notice

Feature Request Unity MARS Real-time Object detection

Discussion in 'Unity MARS' started by naveen-ds, Aug 10, 2021.

?

How to create real-time object detection using Unity Mars

Poll closed Aug 20, 2021.
  1. Realtime Object Detection

    100.0%
  2. Augmented Reality

    100.0%
Multiple votes are allowed.
  1. naveen-ds

    naveen-ds

    Joined:
    Aug 10, 2021
    Posts:
    3
    Hi Team,

    Using Unity MARS how can we detect real-time objects.
    Please suggest any supporting tutorials.
    Appreciate your response.

    Regards,
    Naveen
     
  2. jmunozarUTech

    jmunozarUTech

    Unity Technologies

    Joined:
    Jun 1, 2020
    Posts:
    266
    Hello @naveen-ds,

    Out of the Box MARS doesn't offer object recognition; for this you will have to use another package and write a provider for MARS to do so (https://docs.unity3d.com/Packages/com.unity.mars@1.3/manual/SoftwareDevelopmentGuide.html#providers)

    Depending on what your goals are you could use Apple's content anchors https://developer.apple.com/documentation/arkit/content_anchors/scanning_and_detecting_3d_objects or you could use a machine learning model with Barracuda (https://docs.unity3d.com/Packages/com.unity.barracuda@2.1/manual/index.html) and use it within MARS, again you will need to write a provider for it.
     
  3. Ricardotlpz

    Ricardotlpz

    Joined:
    May 17, 2021
    Posts:
    54
    Hey Naveen, just as @jmunozarUTech suggested, I'd use Barracuda. You can make a quick implementation using this mediapipe model and further build over it. You'll just need to make a port to Unity.

    https://google.github.io/mediapipe/solutions/objectron.html
     
  4. eslicenses

    eslicenses

    Joined:
    Oct 10, 2018
    Posts:
    8
    Thank you!
     
  5. eslicenses

    eslicenses

    Joined:
    Oct 10, 2018
    Posts:
    8
    Ricardotlpz likes this.
  6. gekko22

    gekko22

    Joined:
    Aug 1, 2013
    Posts:
    7
    It's hard to believe that there hasn't been someone to incorporate this fundamental feature into MARS.
    I would personally really appreciate it.
    @eslicenses, did you achieve?
     
  7. Ricardotlpz

    Ricardotlpz

    Joined:
    May 17, 2021
    Posts:
    54
    My guess is that MARS is an augmented reality framework, not a convolutional neural network thus they won't be adding support for that. Sure it would make work lighter but I'd focus on adding other features instead of this one.
     
unityunity