Bug 1133241: Test category filters include unrelated tests

I reported 1133241 because I was seeing cases where picking one Category in the Test Runner filter was including multiple categories. My test has 104 tests, with test categories AA-AZ, BA-BZ, CA-CZ, and DA-DZ. If I then try to filter for just one category, for example "AA", it ends up selecting categories BG, CM, and DS as well, with no ability to just filter to "AA".

 

How are you setting the filter? Can you show us?

 

Sure. There's a dropdown in the top-right of the window. I'm pulling it down, and selecting a single item. However, this results in more than one item being selected. In this example, from my realy project, I chose VisorCommSystemController from the dropdown, but that resulted in two categories being selected.



When I pull down the menu again, I see "Constants" has been checked, along with the one I actually chose.



If I unchecked the unwanted category, it unchecks both.

It almost seems like the various Categories are being mapped into a 32-bit value, and when there are more than 32 categories, it starts duplicating values.

 

What Unity version are you using?

 

2018.3.6f1. The bug reported I submitted contained a sample project where this is occurring.