Search Unity

  1. Unity 6 Preview is now available. To find out what's new, have a look at our Unity 6 Preview blog post.
    Dismiss Notice
  2. Unity is excited to announce that we will be collaborating with TheXPlace for a summer game jam from June 13 - June 19. Learn more.
    Dismiss Notice

Question How would I use Live Capture to make an app that tracks user to animate a virtual avatar

Discussion in 'Virtual Production' started by Aseemy, Nov 20, 2023.

  1. Aseemy

    Aseemy

    Joined:
    Aug 22, 2015
    Posts:
    207
    Hi, I want to create a standalone app which uses the front camera to track the users face and use it to animate a model (model has blendshapes). I don't want two separate apps, where one captures and streams data to another.
    Here is an example video.

    I want to do this on both Android and IOS. Let me know if this is possible using Unity for any or both OS.
    I am open to use any existing commercial plugin/asset like OpenCV, DLib.

    If this is not possible using Unity, kindly guide me on what tech I would need for this.

    Thanks