Question Force specific layer or mesh to use a different intensity lighting?

I'm setting up a scene where the environment needs very intense lighting. However, I don't want the player to be as intensely lit as the world. All world terrain is on the default layer, while the player is on a separate layer dedicated to the player. Originally, I tried just making a second directional light that affects ONLY the player layer and used culling mask to keep the intense light from affecting the player. This worked, but now the player neither receives nor casts shadows on the world geometry. Is there any way I can force the player to be lit differently and retain shadow casting/receiving from the world geometry?

I should also mention that the Unity version for this project is 2019.4.31.