Search Unity

Feature Request Unity MARS Real-time Object detection

Discussion in 'Unity MARS' started by naveen-ds, Aug 10, 2021.

?

How to create real-time object detection using Unity Mars

Poll closed Aug 20, 2021.

  1. Realtime Object Detection

    2 vote(s)
    100.0%

  2. Augmented Reality

    2 vote(s)
    100.0%
Multiple votes are allowed.

  1. naveen-ds

    naveen-ds

    Joined:
    Aug 10, 2021
    Posts:
    3
    Hi Team,

    Using Unity MARS how can we detect real-time objects.
    Please suggest any supporting tutorials.
    Appreciate your response.

    Regards,
    Naveen
     
    naveen-ds, Aug 10, 2021
    #1

  2. jmunozarUTech

    jmunozarUTech

    Unity Technologies

    Joined:
    Jun 1, 2020
    Posts:
    297
    Hello @naveen-ds,

    Out of the Box MARS doesn't offer object recognition; for this you will have to use another package and write a provider for MARS to do so (https://docs.unity3d.com/Packages/com.unity.mars@1.3/manual/SoftwareDevelopmentGuide.html#providers)

    Depending on what your goals are you could use Apple's content anchors https://developer.apple.com/documentation/arkit/content_anchors/scanning_and_detecting_3d_objects or you could use a machine learning model with Barracuda (https://docs.unity3d.com/Packages/com.unity.barracuda@2.1/manual/index.html) and use it within MARS, again you will need to write a provider for it.
     
    jmunozarUTech, Aug 10, 2021
    #2

  3. Ricardotlpz

    Ricardotlpz

    Joined:
    May 17, 2021
    Posts:
    63
    Hey Naveen, just as @jmunozarUTech suggested, I'd use Barracuda. You can make a quick implementation using this mediapipe model and further build over it. You'll just need to make a port to Unity.

    https://google.github.io/mediapipe/solutions/objectron.html
     
    Ricardotlpz, Aug 19, 2021
    #3

  4. eslicenses

    eslicenses

    Joined:
    Oct 10, 2018
    Posts:
    8
    Thank you!
     
    eslicenses, Aug 31, 2021
    #4

  5. eslicenses

    eslicenses

    Joined:
    Oct 10, 2018
    Posts:
    8
    eslicenses, Aug 31, 2021
    #5
    Ricardotlpz likes this.

  6. gekko22

    gekko22

    Joined:
    Aug 1, 2013
    Posts:
    9
    It's hard to believe that there hasn't been someone to incorporate this fundamental feature into MARS.
    I would personally really appreciate it.
    @eslicenses, did you achieve?
     
    gekko22, Oct 18, 2021
    #6

  7. Ricardotlpz

    Ricardotlpz

    Joined:
    May 17, 2021
    Posts:
    63
    My guess is that MARS is an augmented reality framework, not a convolutional neural network thus they won't be adding support for that. Sure it would make work lighter but I'd focus on adding other features instead of this one.
     
    Ricardotlpz, Oct 22, 2021
    #7