Search Unity

How does one stream AR annotations on top of video feed as a blended overlay

Discussion in 'AR/VR (XR) Discussion' started by vamrr-technologies, Apr 24, 2020.

  1. vamrr-technologies

    vamrr-technologies

    Joined:
    Oct 18, 2019
    Posts:
    1
    We are developing a cross platform AR Remote Assist application. We are using Unity with AR Foundation and ARCore and currently we are exploring using Agora for Video streaming and 2 way as well as group video communication.

    We are trying to solve the challenge of streaming annotations on top of video feed as an overlay, in real time. I request your expert advice on the best way to do this.
     
    vamrr-technologies, Apr 24, 2020
    #1

  2. ROBYER1

    ROBYER1

    Joined:
    Oct 9, 2015
    Posts:
    1,454
    Have a look at this, I would pass the video feed to this and you will need to do some machine learning work with YOLO v2 to train it to recognise things you want to overlay content on?
    https://github.com/derenlei/Unity_Detection2AR
     
    ROBYER1, Dec 7, 2020
    #2