I was trying to copy the StateMachine as a whole. Right click, copy then paste. By doing that it removes the transitions.