Artifacts after I baking Lightmaps

I'm getting artifacts after I bake my scene. They are prominent when you walk close to the building, otherwise they don't show. How can I ensure this isn't happening? I generated UV lightmaps for all my mesh during import.

Bake Settings:


Quality settings:


UV lightmap settings

Thanks in advance

 

@scr33ner
In the material of the mesh, enable double sided illumination. Hopefully, that works.

 

Thanks will give it a go

 

Alright.