Question is an image with a source image sprite more performant than with no sprite?

All my buttons consist of many images (for decoration). Since all of them are rectangles, would it be more efficient to use a small white square as the source image and change the image type to sliced? I'm assuming that would be performant than whatever unity does to fill the image size when there's no sprite to reference, but that's just a guess.

 

Bumpity