Search Unity

Question Humanoid avatar using Mediapipe BlazePose

Discussion in 'VR' started by marholm, Mar 7, 2023.

  1. marholm

    marholm

    Joined:
    Sep 12, 2022
    Posts:
    1
    I am making an exercise game using Mediapipe's BlazePose in Unity through BlazePoseBarracuda (https://github.com/creativeIKEP/BlazePoseBarracuda). I am using a HMD, but not the hand-held controllers. I am trying to map the output of the pose landmarks from BlazePose to the joints of an avatar that I want to use to represent the player. However, I am struggling as all the examples I find use the position of the controllers to get the hand positions. Any suggestions on how I can do this without the use of controllers? I am taking inspiration from this project: https://github.com/maceq687/FullBodyPoseEstimation

    Thanks in advance!
     
  2. JPDevM

    JPDevM

    Joined:
    Oct 29, 2022
    Posts:
    1
    I'm working in the same topic. An Humanoid avatar using Mediapipe, but with a slightly different approach, I am adapting the Pose landmark detection data towards that required by Unity's Avatar structure. For now I have significant progress but there are others to be resolved.