Vertex painting two meshes that have the same material with GPU instancing causes strange behavior

From what I can tell depending on which mesh is on screen the vertex data from that mesh gets used on all other ones. Here is a gif that explains the problem better: https://gyazo.com/7eeb59a517ddb52d6d13796f224d2303