Question Controller not in sync when tracking type set to rotation only in Tracked Pose Driver.

I want to lock the headset position. I am setting the tracking type to rotation only in Tracked Pose Driver. But the problem is when I do this, the controllers are not working properly and there is an offset in the controller position. This offset moves the controller over the headset to the top left side.

I am using XR Interaction Toolkit 2.2.0 and Quest 2 headset. I am not sure if this is a bug or if I am missing something.

 

Anyone knows if this is possible and how?