Child Player character moving and "wobbling" when parent object is moving

Hello,
I've seen this question asked in the past but I haven't come across a fix yet.

I have the player Object as a child of another GameObject that has a NavMeshAgent component attached. When the parent moves using the Agent the player object will start to wobble when the player is moving around inside the parent Object.

The parent doesn't have a Rigidbody component.

Is there anyway to fix this issue?

I've tried a few things but without a fix.