[HLAPI] Android Wifi Random Timeouts

I'm having issues with network stability with my Android app. I'm using wifi to connect devices but clients will randomly drop out with a ClientDisconnect message in the log. I'm using 5.3.2p1 but it has been an issue in other Unity versions.

 

I get "Client disconnected" on the client with NetworkTransport error code 6 (Timeout Error) and "NetworkServerSimple disconnect client" on the server with presumably the same error code since I don't get a server disconnect error in the log.

I'm using NetworkManager for my network.

I get the Timeout error even when I'm sending no data between server and client, regardless of the number of clients. It seems to be only as prevalent in 5.3, but the randomness of the Timeouts makes it really difficult to tell.