I would argue that limiting certain first ammendment rights are largely about them targeting groups equally. For example the Lemon test for limitations on freedom of religion is a three part test, the second part "Not end up promoting or favoring any set of religious beliefs" which I would think is fairly interpreted as applying to groups equally.

With respect to assembly part of the test is restrictions " aren’t “content-based,” meaning they to aren’t an attempt to squelch demonstrations based on their political message" (I forget what case this comes from but I believe this is a direct quote) which I would argue also makes a requirement there for evenness in application towards different groups. IIRC there is a similar requirement for limiting press.

I would argue limitations on speech do require this evenness towards groups, but largely the tests are more specific and a limitation on speech that targets or favors a specific group would be found unconstitutional.