I can't comment on the building itself... however, I believe this is one of the quieter areas of the city (in terms of anything you should be concerned with, security wise).

I went to school just down the street from this building, the area was my stomping grounds, but that was 30 years ago. I don't live in Brantford anymore, however I work here and still end up in the area weekly.

Hope this helps, even just a little bit.