Adding a window icon to Utility Window's in unity

I currently have a custom editor window, which I have a custom icon for.

it works fine when my editor window is dockable (not utility), however, when I change my editor window to Utility, it doesn't show an icon.

Anyone had this issue and fixed it? below are images showing the difference.