[RELEASED] Puppet Face - All-In-1 Facial Animation for Unity

I use Macbook M1

 

Is macOS ticked?

 

looked around can't find out anyone but that Other VR guy complaining about anything like this.
Error: performance capture button is missing from the component. component only shows the cam and mic dropdowns.

Code (CSharp):

1. IndexOutOfRangeException: Index was outside the bounds of the array.
2. PuppetFace.PerformanceCaptureEditor.OnInspectorGUI () (at Assets/PuppetFace/Scripts/Editor/PerformanceCaptureEditor.cs:96)
3. UnityEditor.UIElements.InspectorElement+<>c__DisplayClass71_0.<CreateIMGUIInspectorFromEditor>b__0 () (at <f7044ab663d344a2badf1160e57d1c1d>:0)
4. UnityEngine.GUIUtility:ProcessEvent(Int32, IntPtr, Boolean&)
5.  

22.2.1f1

 

Right, I hadn't been able to reproduce the issue -
If you make a new clean project with just puppet face and without vr enabled do you get the error? If not, could you then enable vr and try again. If it then errors, seems like it is vr that's the issue.

 

• created a blank urp project and it is the same.
• same thing in the console
• 22.2.1f1

but it does show with the virtual cams.....

 

Do you get a console error?

 

as noted it has same error in console... but i reopened the project again and the info and button doesn't disappear. WTF? so now it is working. something has got to cause it to disappear.

 

If I modeling a face with teeth, tongue, etc, import it to Unity, and attach the Puppetface Asset, does it automatically lip sync?

I'm asking because I don't understand what kind of asset it is. Have a nice day.

 

You then setup the phoneme shapes and then yes.

 

Hi, I am using Unity 2022.1.1f1 and I am getting this error:
Assets\PuppetFace\Scripts\LipSyncBehaviour.cs(12,26): error CS0115: 'LipSyncBehaviour.ProcessFrame(Playable, FrameData, object)': no suitable method found to override

Any suggestions for trouble shooting?

 

Hi there,

I'm interested in getting this asset to do performance capture on a 2d character (drive sprites instead of blendshapes/joints). Is that currently possible?

 

I'm also interested in this, possible?
Also wondering if the current versions are ok to use, noticed last update was Dec-2021. Not a probable to install
older version if it will be more stable?

 

I'm not sure what's causing that - Does it happen in a demo scene?

 

It hasn't been specifically designed for 2D - but there are definitely ways to make it work.
One way would be to setup the lipsync to scale up and down the mouth sprites (scale 0 when they are invisible and 1 when visible).
Another method I did in this gif was to use 2d meshes for the mouth and make blendshapes out of them!

I've tried it in the current latest version 2022.3.5 (LTS) and it works fine

 

Nice!
Think I'm going with blend shapes. I'm adding just a few more polys around the face on Synty characters and giving that a go...looks promising!

Thanks! Great asset!!

 

Hi Jamie! This asset looks pretty promising. I am wondering if it can cover runtime generation?
For example having a dynamic chat with an npc and generating talking/eye expressions bases on runtime generated audio files. Also for generation the correct blends/emotions can these then be blended/applied on certain timings?
Thank you upfront!

 

The lip sync from audio conversion uses an "exe" called rhubarb - I don't know if its possible to have this running live in game.