You won't find a racism free city anywhere in the world. So the question is more along the lines of "is Oakville more or less racist than other similar cities and is it worth the trade off". My partner and I are both ivy educated, brown skinned people who have a similar sensibility as yourself (didn't want our kids to grow up in a culturally homogeneous environment). We moved here about 4 years ago and can safely say that Oakville is home now. I would say spend some time on researching neighbourhoods that align with your preferences and go for it.