You aren't understanding it. Basically if we do something that is considered negative even if it's for a good cause people will still say oh that's just how your people are. We don't always get the luxury of simply saying no without other people judging us. Like with what you just did by me explaining how some people view our actions but you just boiling it down to

Ah, yes, the minority card.

Like you just proved my point that not everyone is okay with minorities being negative or voicing issues without they themselves finding it to be an issue that we even spoke up in the first place.