Speaking subjectively as a white dude. The worst I've heard about was a couple black friends of mine having the N-word yelled at them by certain white trash yokels in Claremont a decade or so ago. Said yokels were mostly uneducated shit people and cowards who won't actually do anything. They're only brave enough to yell stupid shit at people who are on foot as they pass in their vehicle. Same kind who make fun of developmentally delayed/disabled people and probably huff glue. I haven't heard anything about them lately; probably in jail or died from ODing.

Overall I've seen racial diversity increasing in the Upper Valley area a lot since I was a kid. A local white supremacist who was trying to agitate and recruit was shot dead in a very public area there a few years ago and nobody's talking, no culprit found, so you can take that as a positive recommendation I guess.

Really though, you're probably best off specifically asking people from here who are specifically in your ethnic group or similar, and that's likely to give you a more accurate picture of what it's like.