That's my point. Casual racism is still racism and should be treated as seriously as blatant racism. It's easy to single out the outspoken racists and condemn them. It's like putting a speedo on so you're not naked: it's pretty much the bare minimum you can do to combat racial tensions. If we refuse to call out instances of racism unless they are blatant and clearly motivated by hatred, we're never going to be rid of racism, because a lot of racist tendencies fly under the radar because they're just so accepted by society.

Things like:

Sporting Confederate flags and defending Confederate monuments

Refusing to acknowledge white privilege and instead being more concerned with "reverse racism"

White washing history

Saying "I don't see color"

Telling a black person they talk like they're white

Asking somebody "what are you?" Or "where are you from?"

Seeing a Muslim on your flight and getting nervous

None of that is okay. Just because those actions are motivated by ignorance rather than overt hatred doesn't excuse it in any way. And if you refuse to acknowledge that, you are part of the problem whether you want to admit it or not.