Error when clicking off UI element

I'm setting up a simple UI system. It works fine when used correctly. When I click off an active element (the save/play buttons when disabled or the background), I get the error:

Attempting to select <Some GameObject> while already selecting an object

It's acting like it's moving on to the next UI element in the chain.