Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.
  2. Dismiss Notice

Question Face Capture accuracy - lips not closing

Discussion in 'Virtual Production' started by godbeygames, Sep 22, 2021.

  1. godbeygames

    godbeygames

    Joined:
    Oct 3, 2020
    Posts:
    13
    Hi,

    I've been trying out the new Unity Face Capture app and it's pretty impressive. There is however one thing I keep running into. It seems it's hard to get the lips to close even though I am closing my lips during mocap. This makes the character being driven by the mocap have their mouth slightly open most of the time. After doing some research it seems like this is a common issue not exclusive to Unity. In this video it shows how to correct the problem of the lips not closing in Unreal Engine 4:


    All he seems to be doing is added additional offset to the blendshapes on the mouth. Does anyone know of a way to do this in Unity?
     
  2. ScottSewellUnity

    ScottSewellUnity

    Unity Technologies

    Joined:
    Jan 29, 2020
    Posts:
    20
    @godbeygames
    Currently, the way to resolve this issue would be to adjust the Face Mapper asset settings. Here is a summary of the steps:
    1. Open the Face Mapper asset you are using for the character in the Inspector window.
    2. Find the blend shape mappings for the lips and/or the jaw.
    3. Clear the Evaluator Preset field for the mappings if any are assigned.
    4. Set the Type to Simple.
    5. Adjust the Offset value for the mappings until the rest pose looks correct.
    In the future, we plan on having a calibration step done in the client app that should be able to automate this process.
     
    godbeygames likes this.
  3. godbeygames

    godbeygames

    Joined:
    Oct 3, 2020
    Posts:
    13
    Works great, thanks!