VR Horror Lighting

What a Clickbait title!
So, I'm trying to get some decent lighting for a VR Horror game, I'm experimenting 3 days now and can't get any acceptable lighting in my block out.

Setting is inside a house, I made a basic enclosed floorplan. Most of the time I have the problem that light is randomly bleeding through thick walls and nonsense like that.
I got the best results using the HDRP, but it cant support the 90FPS even in an empty scene.

Maybe someone can give me advice what lighting technique to use?

I considered several things:
- HDRP
- Increasing the GI Resolution
- Baking and then Switching Lightmaps
- Using no indirect light

Non of them fits the needs, as you have quite some lighsources inside the house that all need to be toggleable and adjustable.

You see the problem here, with this only lamp enabled the little bathroom must be pitch black: