GearVR Touchpad quick swipe

I'm working on a system that allows the player to be able to move an object based on their input. Ideally I wanted to use the touch pad like a dpad by taking a touch position but the touch pad doesn't support this.

So now i'm having to register swipes, the issue is that if the player swipes quickly it doesn't seem to register all the swipes. I'm not sure if this is a limitation of the touch pad or my code implementation?

I take the mouse position on a mouse down, then wait x number of frames to calculate the swipe direction.