Search Unity

  1. Unity 6 Preview is now available. To find out what's new, have a look at our Unity 6 Preview blog post.
    Dismiss Notice
  2. Unity is excited to announce that we will be collaborating with TheXPlace for a summer game jam from June 13 - June 19. Learn more.
    Dismiss Notice
  3. Dismiss Notice

Question ARKit Blendshape Remapping (FaceCap App)

Discussion in 'Animation' started by raoul-goedel, Aug 1, 2020.

  1. raoul-goedel


    Jul 9, 2020
    Hi guys!
    I am currently working on my Bachelor thesis and a part of it is the Face Tracking from Apple's ARKit. I am going to use the FaceCap App to record my face and connect it with Unity to drive a character. For a character I am thinking about using the Unity Digital Human. The Blendshapes there unfortunately are extremely different in comparison to the ARKit Blendshapes.
    So my Question is, is there any way to map the ARKit Blendshapes on the Digital Human character, which is using a Snappers Facial Rig. I think a normal Retargeting Asset is not suitable because the Blendshapes are just too different overall. But maybe i am wrong about that..

    If there is actually no way to do that, i would just use a Fuse/Mixamo character, which would be way easier.
    Would appreciate some solutions! Thanks! :)