best way to avoid label interference in touch based UI

hey folks, i'm using Unity as a musical performance interface, and i'm running into issues with the labels interfering with the touch events on some sliders. my sliders are somewhat wide and i actually place the label inside of the slider area. this is somewhat similar to how the TouchOSC app for iOS and Android works.

so, i have set all the labels to the Ignore Raycast layer, but i am curious if anyone's run into an issue where a non-interacting object is interfering with an interactive one. do you use Sorting Layers for that situation or set the Z depth to be below that of the slider object? i would appreciate opinions on making the interaction work more reliably without having to move the labels out of the slider area if possible. thanks in advance!