Search Unity

Third Party Using Lip Sync with Photon Voice

Discussion in 'Multiplayer' started by kmasui, Sep 26, 2022.

  1. kmasui

    kmasui

    Joined:
    Dec 28, 2018
    Posts:
    8
    We would like to implement lip-sync in response to voice for a voice chat function using PhotonVoice.
    Does anyone know of any assets or libraries that have a proven track record?

    Currently we are trying to use "Oculus lip sync", but it seems to be unstable.

    Best regards.
     
  2. Sebastien_P

    Sebastien_P

    Joined:
    Sep 26, 2022
    Posts:
    2
    Hi !

    We used the Oculus lipsync in some VR apps with Photon Voice and Fusion, and it worked well out of the box.

    I had some problem on macOS build related to the device performances - but no problem on Oculus Quest or PC (in VR or desktop mode).

    One thing that could help in all cases for performances, is to switch the lipsync provider algorithm: the one choosed by default is quite CPU-intensive, without bringing much to the table. In our dev, we changed this setting from "Enhanced" to "Original".
     
  3. kmasui

    kmasui

    Joined:
    Dec 28, 2018
    Posts:
    8
    Thanks for your reply.

    I am developing on macOS, which seems to be causing the problem.
    This time I decided to implement it using the "uLipSync" library.
    I will check "OVRLipSync" next time.