Unity UI Button not changing sprite when clicked

I have a button that has the sprite swap transition and a pause and unpause sprite, and I've also deleted the text child that comes with the button. I attached the pause sprite to source image, and also to highlight, selected, and disabled sprite. The unpause sprite is on the pressed sprite, and I have an image that has the pause sprite attached to it as my target graphic.

However, when I click on the button, the sprite does not change to the unpause sprite, despite interactable being on. How can I make the unpause sprite show up when the button is clicked?