Search Unity

  1. Looking for a job or to hire someone for a project? Check out the re-opened job forums.
    Dismiss Notice
  2. Good news ✨ We have more Unite Now videos available for you to watch on-demand! Come check them out and ask our experts any questions!
    Dismiss Notice

Help Wanted ARKit Blendshape Remapping (FaceCap App)

Discussion in 'Animation' started by raoul-goedel, Aug 1, 2020.

  1. raoul-goedel


    Jul 9, 2020
    Hi guys!
    I am currently working on my Bachelor thesis and a part of it is the Face Tracking from Apple's ARKit. I am going to use the FaceCap App to record my face and connect it with Unity to drive a character. For a character I am thinking about using the Unity Digital Human. The Blendshapes there unfortunately are extremely different in comparison to the ARKit Blendshapes.
    So my Question is, is there any way to map the ARKit Blendshapes on the Digital Human character, which is using a Snappers Facial Rig. I think a normal Retargeting Asset is not suitable because the Blendshapes are just too different overall. But maybe i am wrong about that..

    If there is actually no way to do that, i would just use a Fuse/Mixamo character, which would be way easier.
    Would appreciate some solutions! Thanks! :)