Search Unity

Face Tracking + 3D mask

Discussion in 'AR/VR (XR) Discussion' started by martinamenegon, Jul 16, 2019.

  1. martinamenegon

    martinamenegon

    Joined:
    Aug 28, 2014
    Posts:
    31
    Hi everyone, I am trying to reproduce my instagram/snapchat face filter. It uses the face tracking system of these apps and attach a 3D mask that follow the user face positions and rotation. It does not animate mouth or eyes! it is just a static 3D mesh. I am getting crazy trying to understand which direction I should go, especially since I do not have iPhone X nor a device with the depth camera. I have an iPhone8, ipad 2 and a couple of android tablets.

    here is the description + gif / photo of my face filter: http://www.martinamenegon.com/familiar-stranger

    any suggestion?
    thanks in advance!

    best,
    M
     
    martinamenegon, Jul 16, 2019
    #1

  2. nick_unity838

    nick_unity838

    Joined:
    Jun 24, 2019
    Posts:
    2
    Are you using Arcore or foundation? Ive had success with Arcore, but No love with Foundation.
     
    nick_unity838, Jul 23, 2019
    #2

  3. alexeikovalev

    alexeikovalev

    Joined:
    Jun 3, 2020
    Posts:
    7
    Hi martinamenegon .

    If you still got this problem, you may want to take a look at Banuba's Unity 3D animation software. This tool allows you to create animated face filters which support the face tracking functionality just like the ones in Snapchat and Instagram for your Unity app. The SDK can be easily integrated into Android and iOS apps.
     
    alexeikovalev, Jun 26, 2020
    #3