Trying to move model to given coordinates

I have 3D coordinates of upper body positions. I want to move my model to those positions. So, I tried to move by follow this project https://github.com/keel-210/OpenPose-Rig. Arms of the model move correctly. However, the movement of hands and fingers are wrong. As you can see from the video, the red stickman show the correct movement while the fingers of the human model video are trying to move to the correct positions ,but the palms don't follow the fingers.

I have no idea about how to fix this. Pleas help!!
Thank you