Question Normal from height node acts weird

I am scratching my head with this for a best part of two days now... When I use Normal from height node, normals are not "fixed", but they react to "viewing angle" and rotation of camera, for lack of better words (or my better understanding of this issue)

When I plug in any BW texture, or noise, it does this... I don´t see how this could be a wanted behaviour...

Attached screen hopefully demonstrates the issue better. I would like all cells to behave like those in the middle, but they get "deformed" under the steep viewing angles..

Edit: It seems that the lighting also affects the normals... (and yes, I am aware that I have normals plugged in albedo, but it is to visualise everything better)