Search Unity

  1. Unity support for visionOS is now available. Learn more in our blog post.
    Dismiss Notice

Question Object tracking on AR Glasses

Discussion in 'AR' started by Hijackz, Nov 26, 2023.

  1. Hijackz


    Aug 13, 2020
    Hi everyone!

    I was thinking about creating AR glasses with object tracking.

    However, I need an advice here: how to cover tracking object indicator with tracked object in such glasses (with small display in one eye and one camera)?

    I can imagine that my glasses will have a camera that can send video to the server or process it on the glasses' processor and detect objects on this video - it's quite easy to do, there are a lot of ready lib that can detect objects in video. It is also easy to put an indicator on a tracked object ON VIDEO (most libs do it out of the box).

    But I can't imagine how I can put indicator on glasses to track these objects. I won't have video feed on glasses. I just want to put an indicator on the glasses' transparent display. When you put indicator in glasses where it should be on video:

    It will not cover with real object. User will just see indicator in glasses’ display in place where it should be if we display video. BUT video will not cover with real world.

    In addiction camera is not in the center of our eye:

    So I should also calculate the offset.

    So our eye sees a bit different than camera.

    Thank you everyone in advance!