Can a light affect only dynamic objects?

Hi there.

I'm doing a FPS multiplayer, so you can imagine my rendering time on each frame has to be as low as possible. I'm using Built-in RP, and Unity 2020.1.0b2

I've managed to baked all my lights the way I want, the scene looks great, but naturally the players are dark, because all lights are set as 'Baked'. So, the ONLY thing I need is a light for the players, just enough to see their colors. But as soon as I add a directional light, the whole scene lighting messes up, specially the dark tunnels, leaking light from above, and I think light probes could be expensive and unnecessary.

I heard "mixed lights" a lot, but the lighting modes (https://docs.unity3d.com/Manual/lighting-mode.html) for mixed lights, all seem to affect the scene, and I don't want that, I want the scene like it is.

Any thoughts? Thank you.