Multiple character meshes animated by one armature object

I have a character controller and several character models with different outfits which were all rigged by mixamo and thus have the same rig. I am trying to set up an armor system so that the player can switch armour and the character model mesh changes to display the change, while still keeping the same armature as my one armature has multiple IK and other objects attached to the bones. It is troublesome for me to create new character controllers for each model and have them have separate armature objects. Is there a way I can have my controller objects have the different character models as child objects and all be animated by the same armature object?