Question XR Grab Interactable with multiple colliders

Hello,

I have been working on a VR puzzle game. One of the puzzles in the game uses a combination lock with different cylinders for each dial. I am currently using XR Grab Interactable to make the cylinders rotate according to the hand movement, however, this only works when there is one contact point. When I try to enable different points to grab the cylinder, it doesn't move as expected, as it starts rotating with the movement of the wrist and nothing else.

Does anybody know how to work with multiple colliders while using XR Grab Interactable? I would like the player to grab the cylinder from any place and for it to rotate according to the movement of the player hand.

Thanks.

 

Have a parent grabbable and child the new objects into it (or use physics joint)