Online multiplayer : Prefab using different materials

Greetings

I'm currently trying to create an online multiplayer ball game where players control their balls within various gamemodes.

Here's the problem though, I'm having a hard time trying to find a way to make it so that each player sees their balls objectively. Eg. everyone sees player1 as red, player2 as blue and so on.

The main issue is that I'm unable to assign each player certain materials needed to represent their respective gameobject. Furthermore, I'm planning to give each of player ability to change textures of their balls which at the current time, seems way beyond my experiences to implement such thing.

Here's the concept of what I've been talking about :

 

Cmd / RPS are probably what you are looking for. You send a message from server to the clients saying "Set player X to Y material"

 

an example would be greatly appreciated as I have little to no experience in terms of multiplayer networking.