Oculus Game FPS Drops In Unity Build

I am running on low settings. When I do maximize screen inside Unity 5, I get consistent 80-120 FPS. When I build the .exe and do direct to rift I get ~40FPS.

I have mirroring turned on when I startup the program (I don't know how to turn it off permanently). When I use an OVRMenu component to turn mirroring off, the mirroring just freezes on my desktop and the window stays, and the game gets like 1FPS so I have to quit.

Does anyone know how to turn mirroring off without starting the direct to rift exe? Does anyone know what might be causing the frame rate to drop 60%? Thanks.