Applying kickback force to Oculus Hand when firing a weapon?

I've been trying for the past few hours to apply a kickback force to the oculus avatar hands when firing a weapon, but for some reason the hands are not affected at all by any force I try to apply to them. I checked and made sure the rigidbody on them wasn't set to kinematic. How can I go about applying a force to the hands?