Hololens connect to tablet app

Sorry I am not sure how to title this or if I am posting in the right section but I am working on a hololens based project and the idea is I have a scene loaded in the hololens and I want to create basically a touch pad controller on an external tablet to manipulate the objects in the scene. I am considering a multiplayer server to accomplish it, but I am not sure if it would be possible that way. The other alternative I am considering is a bluetooth based connection but I hear there are issue with unity and bluetooth. Any advice on this would really apprieciated