Creating a tail on a rigidbody animal using a hingejoint without affecting the animals rigidbody.

So I'am creating a game where you throw animals like balls On these animals I want to be able to attach tails, legs etc. So in my first experiment I created a tail which I attached to the main body of the animal (a sphere with a rigidbody) using a hinge joint. Now while this works the tail will obviously affect the physics of the ball.

How can I come around this issue?

I also tried creating a kinematic rigidbody which I parented to the ball animal and then attached the hinge joint tail to this kinematic rigidbody. While this did work in a sense that it no longer affected the physics of the ball it had a sideeffect of lagging after the main ball.

Any suggestions how to attach limbs etc to a main rigidbody without affecting the rigidbody to which things get attached?

PS. I also tried changing mass of the tail object, the ball object etc but it's still affecting things.

Thanks!