AR kit facial tracking and image tracking at the same time? Possible?

I'm looking to use AR kit to do a simple facial tracking app that also checks for an image at the same time. I only want to allow the users to us the facial tracking if only they are wearing a hat with an image on the front. So far I haven't had luck making them work together. Anyone have an experience with this?