Why Does My Lighting Look So... S@&$?

So I'm starting to play around with lighting in my game again, having just left it alone for a while. I'm totally stumped as to why baked lighting looks so awful since the Unity 5.x/Enlighten change over, and I'm hoping that I might be able to get some tips to improve things.

So here's 3 screenshots. I think they pretty much speak for themselves in terms of "What's Wrong" (with the second one). I've also included the Lighting panel settings that I'm working with in case I'm doing something glaringly wrong.

Screenshot 1 = Unity 5.x with all the wall torch lights set to Realtime.
Screenshot 2 = Unity 5.x with all the wall torch lights set to Baked (NO other changes).
Screenshot 3 = Unity 4.x with all the wall torch lights set to Baked (ahhh... Beast).

 

Perhaps globally changed colorspace linear vs Gamma. Other suggestion- hidden light or cast shadow negating light

 

I'd like to raise this thread from the dead (ha) again.

Is there anyone that's been able to create a light-maps-only game in Unity 5.x? i.e. not using ANY realtime lights? If so, can you share your thoughts - what type of game is it, the sort of settings you're using, maybe some screenshots of the results you're getting?

 

Here's a shot from Unity 5.4.0b10.

 

Looks pretty good... sadly, I have characters that will be in my levels fighting, and I need to make sure mixed mode is working... is mixed mode working in 5.4?