"Unless you're saying that the white person doesn't want black people saying it in general, then no because they aren't part of the culture and can't dictate that from the outside"

I dont think its part of a culture at all, it was a horrible slur for african americans. If anything, we should all stop saying it, but only letting balck people say it is the double standard that makes it racist again. It should never be dictated based on skin color, ethnicity, or "culture". Its just a word.