Search Unity

  1. Unity support for visionOS is now available. Learn more in our blog post.
    Dismiss Notice

Question Humanoid avatar using Mediapipe BlazePose

Discussion in 'VR' started by marholm, Mar 7, 2023.

  1. marholm

    marholm

    Joined:
    Sep 12, 2022
    Posts:
    1
    I am making an exercise game using Mediapipe's BlazePose in Unity through BlazePoseBarracuda (https://github.com/creativeIKEP/BlazePoseBarracuda). I am using a HMD, but not the hand-held controllers. I am trying to map the output of the pose landmarks from BlazePose to the joints of an avatar that I want to use to represent the player. However, I am struggling as all the examples I find use the position of the controllers to get the hand positions. Any suggestions on how I can do this without the use of controllers? I am taking inspiration from this project: https://github.com/maceq687/FullBodyPoseEstimation

    Thanks in advance!
     
  2. JPDevM

    JPDevM

    Joined:
    Oct 29, 2022
    Posts:
    1
    I'm working in the same topic. An Humanoid avatar using Mediapipe, but with a slightly different approach, I am adapting the Pose landmark detection data towards that required by Unity's Avatar structure. For now I have significant progress but there are others to be resolved.