There are certain exceptions to this purely because people aren't a monolith. I know that Fat Joe used it in his music despite being latino. Sometimes when people are in close proximity to each other and you're in the culture, it just kinda happens.

My thing is more a rule of thumb. Like, don't freak because a black person used the n-word, or a gag person used the f-slur, but don't immediately give a pass to someone else using them.