Recording a rotation animation for an object, but the position automatically records with it

It's a strange problem since I am doing the same animation for the camera and it does it with no problem. I am simply using the rotate tool to animate said object, but position is recorded and the object's position moves even when I'm only rotating. Any thoughts on this?

 

I tested it on a cube and it works fine, but my 3D game object, as well as others, have the same problem.. The pivot of the object in question is at the very center, but even so, the position should not be forced to move for any reason at all!