POLYPHEMUS - facial capture system - markerless - single webcam - [ Asset Store ][ Documentation ] REQUIREMENTS Unity 2018.3+ WINDOWS only A computer* with a connected webcam or a laptop with integrated webcam. *For a good capture quality is recommended a mid-range to high-end computer ( i.e. GeForce GTX 1060 - 7th Generation Intel® Core ) and an average quality -external or integrated- webcam ( it doesn't need to have HD/4K resolutions; a 30+ framerate, instead, is basically a mandatory requirement for a smooth capture. Good light conditions: A natural light condition is recommended, even though it could still capture in low and high light conditions. Avoid frontal and/or back intense lights. 3D model implementing morph targets via blendshapes ( or “Shape Keys” ). NB: This face capture system is based on facial landmark detection: Even if it can recognize a wide range of faces, it could have difficulties to detect some features in some kind of face and appearance. Does it support skeleton-based expressions? Polyphemus capture system is based on blendshapes. It still possible, anyway, write a FaceCapureAddon that rotate specific bones from points and metrics data. Does it need an external application? No, it works inside Unity. Does it track also eyes movements? Eye tracking is not officially supported yet: There's an experimental addons included in the example. Does it works like ARKit Remote face capture? Polyphemus use a single standard webcam. This limitation cannot guarantee the same result you'll get with a '3D' camera you have, for example, on an iPhone X. While it can capture several expressions, there's some, like a puffy cheeks expression, that it's impossible to get with this system. Does my 3D model need to follow a naming convention for the blendshape names? No, it's up to you. Also there's no guidelines about how many and which blendshape you have to implement. For complex models, you can follow this specs. Is it possible to edit captured clips? Yes. Polyphemus outputs standard AnimationClips. So you can edit frames and curves from the standard Unity's Animation Editor. It seems like it can't track properly parts of my face. Please check light conditions requirements. Also try to stay at 50cm / 1mt at 50cm from the webcam. You're face must be inside a rectangle big at least 80x80, so if you set a low webcam resolution, you'll have to stay closer to the webcam. Even if it can recognize a wide range of faces, it could have difficulties to detect some features in some kind of face and appearance.