2D Video Viewer with Tracking/Stabilization

I'd like to create a 2D video viewer with tracking that changes the position of the video to mirror the location and orientation of the original camera using only the video as input.

My concept was to use UMP (Universal Media Player) and attach it to a texture, but I'm unsure how I could get tracking data to move the camera.

A video taken by someone who is walking down a street would result in the video moving horizontally, bumps in the video would cause the camera to shake but the content would be stabilized.

How would you approach this problem? Are there any assets that would create useable tracking data?

Thank you