Bug Nav Mesh Agent keeps twitching and going backwards

I have a gameObject set as a destination for the character.
The character movement and navigation works fine in set place, but in different place it behaves wrong.
While navigating to set destination, the character keeps jittering/twitching while also going backwards instead of looking forward.
The character has no ragdoll attached.

What I tried:
-rotating the character
-messing with NavMesh Agent settings
-re-baking the environment with different settings

 

did you set rigidbody to static.

 

The characters don't have a rigidbody.

 

I've seen this before where a higher level parent object (or another component on your object) also had something affecting the transform. They just get in a fight where one tells it to face direction A while the other sets the direction to B every frame.

 

Hello, did you find a solution for this issue? It's happening the same on my project