Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.

Using Lip Sync with Photon Voice

Discussion in 'Multiplayer' started by kmasui, Sep 26, 2022.

  1. kmasui

    kmasui

    Joined:
    Dec 28, 2018
    Posts:
    8
    We would like to implement lip-sync in response to voice for a voice chat function using PhotonVoice.
    Does anyone know of any assets or libraries that have a proven track record?

    Currently we are trying to use "Oculus lip sync", but it seems to be unstable.

    Best regards.
     
  2. Sebastien_P

    Sebastien_P

    Joined:
    Sep 26, 2022
    Posts:
    1
    Hi !

    We used the Oculus lipsync in some VR apps with Photon Voice and Fusion, and it worked well out of the box.

    I had some problem on macOS build related to the device performances - but no problem on Oculus Quest or PC (in VR or desktop mode).

    One thing that could help in all cases for performances, is to switch the lipsync provider algorithm: the one choosed by default is quite CPU-intensive, without bringing much to the table. In our dev, we changed this setting from "Enhanced" to "Original".
     
  3. kmasui

    kmasui

    Joined:
    Dec 28, 2018
    Posts:
    8
    Thanks for your reply.

    I am developing on macOS, which seems to be causing the problem.
    This time I decided to implement it using the "uLipSync" library.
    I will check "OVRLipSync" next time.