ARFoundation Tracked Image forced perspective?

I'm trying to place an object into my scene using a tracked image. Once the object is placed, I want to transfer it to a point cloud tracker and turn off the image tracker.

The image detection works fine, but the problem I'm having is that once I transfer the spawned object to the point cloud and move the camera, it becomes apparent that the object was actually in a forced perspective position that simply made it look like it was in the correct place.

Is there something special I have to do to transfer an object from an image tracker to a point cloud tracker?