Unity remote won't play in phone if I play the game once before connecting

So I noticed something....even if I start Unity but do not press the play button, then connect with my phone it works ( also noticed first time I press play, it takes a little more time then the rest).
But if I start Unity and press the play button once or more and then connect with my phone it won't work and I've to restart Unity.

Is there a way to reset this 'play' thing while in Unity so that I don't have to restart Unity?