XR Interaction Toolkit - Set interactable to unselectable by other interactors while selected

Hey guys a quick question,

Is there a simple way to make an object unable to be selected by other interactors while already selected by another?

EX: interactable is in left hand, right hand should not be able to select it

I can't seem to find a quick and painless way to accomplish this, so I'm sure I'm overlooking something.