Search Unity

  1. How can our website serve you better? Give us your feedback. Take our survey and let us know.
    Dismiss Notice
  2. Read here for Unity's latest plans on OpenXR.
    Dismiss Notice

Bug Mars Facemask weird behavior on ios

Discussion in 'Unity MARS' started by patpre, Mar 23, 2021.

  1. patpre

    patpre

    Joined:
    Jan 12, 2021
    Posts:
    21
    Just updated to Mars 1.3. and I am placing objects on the facemask and deploying it to ios. All worked fine when using 1.2. - now with 1.3. I have some weird behavior.

    It seems that when my face is captured by the camera on app start - the facemask or object gets stuck to one position and doesn’t react on face movements... and this stays like this...

    If I don’t let the iphone capture my face right away by pointing the camera away from my face and then later after a few seconds look into the camera the object fits perfectly on the facemask and reacts on movement. So everything is working as expected...

    As mentioned before - didn’t have this issue with 1.2.

    Any advice how to get this fixed?

    Appreciate your feedback!!

    Thanks!!
     
  2. jmunozarUTech

    jmunozarUTech

    Unity Technologies

    Joined:
    Jun 1, 2020
    Posts:
    245
    hello @patpre,

    We are looking into this; does this happen also without URP?; what version of Unity are you using?
     
  3. patpre

    patpre

    Joined:
    Jan 12, 2021
    Posts:
    21

    Yes - I don’t have URP in use... Version Unity 2020.3.0f1 but the same on 2019.4.18f1 - also tested with this version...
     
  4. mtschoen

    mtschoen

    Unity Technologies

    Joined:
    Aug 16, 2016
    Posts:
    139
    Hi there @patpre! Sorry to hear that you're having issues.

    Could you also please provide what versions you are using of the following packages:
    - AR Foundation
    - ARKit Plugin
    - ARKit Face Tracking

    It sounds like this is a simple thing to reproduce, but are you able to submit your project with a bug report? That will make it easier for us to investigate the issue and track the resolution. Simply go to Help > Report a Bug... and be sure to include and upload the Unity project.

    Thanks!
     
  5. jmunozarUTech

    jmunozarUTech

    Unity Technologies

    Joined:
    Jun 1, 2020
    Posts:
    245
    Hello @patpre,

    We have successfully managed to reproduce this and can confirm that its indeed a bug, we are working on a workaround for this.

    Thanks for letting us know about this! :)
     
  6. patpre

    patpre

    Joined:
    Jan 12, 2021
    Posts:
    21
    Thanks for fast response. Could you please post into this thread when you found a solution? That would be really great!! Thanks!!
     
    jmunozarUTech likes this.
  7. patpre

    patpre

    Joined:
    Jan 12, 2021
    Posts:
    21
    If still useful... here the infos:

    AR Foundation: 4.1.5
    ARKit Plugin: 4.0.12
    AR Fave Tracking: 4.0.12

    Looking forward hearing about the solution on this!

    Thanks!!
     
    jmunozarUTech and mtschoen like this.
  8. CiaranWills

    CiaranWills

    Unity Technologies

    Joined:
    Apr 24, 2020
    Posts:
    65
    I think I've got to the root of this, and a possible workaround: try downgrading the AR Foundation, ARKit and AR Subsystem packages to the latest 2.x versions and let us know if the problem persists.

    (Obviously we're going to fix it for the newer versions…)
     
  9. patpre

    patpre

    Joined:
    Jan 12, 2021
    Posts:
    21
    Hi, tried to downgrade... but it keeps creating issues and compile errors with AR Foundation... Do you know when to expect a new fixed version - so I can then upgrade? thx
     
  10. jmunozarUTech

    jmunozarUTech

    Unity Technologies

    Joined:
    Jun 1, 2020
    Posts:
    245
    hello @patpre,

    Strange, Which version of ARFoundation are you running and which version of ARCore/ARKit - ARKitFaceTracking do you have?
     
  11. patpre

    patpre

    Joined:
    Jan 12, 2021
    Posts:
    21
    Hi,

    I am using:

    2020.3.0f1
    AR Foundation: 4.1.5
    ARKit Plugin: 4.0.12
    AR Face Tracking: 4.0.12

    When downgrading I was trying to AR Foundation 2.1.18 (latest version)...same for AR Kit... and for facetracking I downgraded to the latest 1.x version as there is no 2.x version available... Also tried the 4.1.7 Version for AR foundation - no errors - but still the same runtime issue.
     
  12. jmunozarUTech

    jmunozarUTech

    Unity Technologies

    Joined:
    Jun 1, 2020
    Posts:
    245
    can you please try it out with ARFoundation 4.0.12 and let us know if it fixes your issue? it is necessary that the versions of ARFoundation coincide with ARKit and facetracking.
     
  13. patpre

    patpre

    Joined:
    Jan 12, 2021
    Posts:
    21
    Hi, have tried with this version as well - unfortunately doesn’t solve the issue
     
  14. patpre

    patpre

    Joined:
    Jan 12, 2021
    Posts:
    21
    maybe it helps for finding a solution... I have also found out that in the version i am using right now (1.3) it only captures „one face“... so lets say I put an object on my face and i pass my phone to someone else, then the object would not be placed on the face of the other person?? This was different with 1.2. - there the object was placed on the face that it captured at that time... Somehow it seems as if in the new version it doesn’t update or refresh during runtime? Don‘t know how to better explain this - maybe it helps...
     
  15. jmunozarUTech

    jmunozarUTech

    Unity Technologies

    Joined:
    Jun 1, 2020
    Posts:
    245
    mmm, @patpre, we are looking into this, could you share with us the compile errors so we can check the stack trace?
     
  16. CiaranWills

    CiaranWills

    Unity Technologies

    Joined:
    Apr 24, 2020
    Posts:
    65
    Ah yeah, unfortunately you can't downgrade to 2.x with 2020.3; I think you'd need to go back to 2019.4

    A fix for this is in the works, but unfortunately I can't promise exactly when it will be released.
     
    jmunozarUTech likes this.
  17. patpre

    patpre

    Joined:
    Jan 12, 2021
    Posts:
    21
    o.k. Thanks - I will try to also downgrade my unity version. Would be great, if you could post here when a fix is released. THX!!
     
  18. patpre

    patpre

    Joined:
    Jan 12, 2021
    Posts:
    21
    Just downgraded everything as recommended by you! Awesome - Problem is gone!! Thanks a lot for the great support!!
     
    jmunozarUTech likes this.
  19. CiaranWills

    CiaranWills

    Unity Technologies

    Joined:
    Apr 24, 2020
    Posts:
    65
    Just a follow-up on this; you should be able to workaround it on later versions by setting the Requested Max Face Count on the MARS Session to 1 (rather than -1)
     
unityunity