Creating layer frame by frame

I'm trying to make something new. In a nutshell, I have a video of a group of people or one person. This video will be the background. I’ve already done that. I also have a JSON file gives me human body’s coordinates frame by frame. With the coordinates, I just want to create layers from the video. So an fbx/alembic object can be seen over/under human body on some frames. I’ll decide when it shows or not with coordinates and time frame. Do you think is that possible?