Sun behind the objects is reflected on the materials

Hello
Could you tell me how can I make sun not reflecting on materials if sun is not visible/behind the wall?
Unity 2020.3.6 hdrp

 

Enable shadows

 

They are enabled.

 

So you must update shadow distance settings

 

Those setting didn't change anything with my problem, one thing what helped is dimmer set to 1, sun not reflecting on objects if they are covered by walls anymore but it makes shadows too dark.
Is there other option to make shadow not so dark without changing dimmer?

 

That looks like light leaking due to poor shadowmap utilisation.
You can try using a closed-mesh, where the edges are welded together, instead of two seperate objects placed close by.

Otherwise increase shadow resolution or decrease shadow distance.

Unity's shadow-projection fitting in HDRP is still very poor unfortunately. (Equivalent to the stable-fit in legacy pipeline, they don't offer a tight-fit)

You can also try enabling micro shadows, which can fix up small artifacts.