Third Party Photon: All Observed Components on one Photonview

Here is my case:

Lets say i have one PhotonView(Reliable Delta Compressed, takeover) and all my ObservedComponent on this one. We talk about 100 Components on different Objects. With four Player using this objects, taking the ownership and serialize things like light on/off or change color. Nothing so serious but it can happen time to time. Transform data excluded obviously because of the traffic.

Is there a reason not to do it that way? I realy like the idea of a Singleton which provides me with a photonview and all my tools, objects etc. register the observed components.

I am concerned about race conditions and I am not sure if the data transmission speed will suffer if the number of photonviews is reduced. Reduced to one .