Search Unity

how to Pose Estimation, body tracking?

Discussion in 'General Discussion' started by mohammedghabyen, Aug 14, 2019.

  1. mohammedghabyen

    mohammedghabyen

    Joined:
    Feb 25, 2019
    Posts:
    2
    As subject, how to Pose Estimation, body tracking with unity?
     
  2. GameDevCouple_I

    GameDevCouple_I

    Joined:
    Oct 5, 2013
    Posts:
    1,762
    A bit more info is required for this.

    What have you tried so far? What is the actual end result you are looking for?

    Body tracking on what, with what? Pose estimation on what, a model, a person, someones VR controller hands?

    Some info please rather than this very vague question or I imagine it will just go unanswered.
     
  3. AndersMalmgren

    AndersMalmgren

    Joined:
    Aug 31, 2014
    Posts:
    4,685
    Low effort posts. I wonder how people with that low effort level ever can make a game.
    I wonder if there is an example of such a game
     
    GameDevCouple_I likes this.
  4. mohammedghabyen

    mohammedghabyen

    Joined:
    Feb 25, 2019
    Posts:
    2
    My apologies, its my first time to post here, What I am looking to do here is to be able to do pose estimation for human body, with laptop camera or mobile camera, so I can place an avatar character on front of the user on the camera, and this avatar moves like same as the user, here is a video for more details:


    I've found some possible solutions, but still unstable solutions with errors and looking for more possible solutions from experience people, and still need more testing on iOS devices to get more results.
    these solutions I've came up with so far:
    1-openpose which is from OpenCV
    https://github.com/CMU-Perceptual-Computing-Lab/openpose_unity_plugin
    2-tensorflow:
    https://github.com/infocom-tpo/PoseNet-Unity
    3-Arkit body recongintion
    https://blogs.unity3d.com/2019/06/06/ar-foundation-support-for-arkit-3/
    4-ThreeDPoseUnity
    https://github.com/yukihiko/ThreeDPoseUnitySample

    Still not sure which the best accuracy with highest FPS for iOS devices, and need to make more testing I know, but its much appreciated if you guys have any recommendations or info's to share regarding thie matter, sorry for my English its not my native language.