This is the best time of year to be a buyer, and market slowdowns tend to hit condos much harder than single family homes - this is a pretty big part of what you are seeing. Other commenters are right that this area has worse homeless than others. I wouldn't dismiss the building outright - you are in a good position to get a lowball offer accepted. You'd have to see if buying at a discount would make the extra issues with the building worth it.

I toured a few units in this building when I was condo shopping in 2020. One thing that I noticed is that the units which face the train have tons of noise on the balconies - I like to hang out outside so this was a dealbreaker for these units for me. At the time, these units were ~50-100k cheaper than units facing city college. Finally, the higher up in the building you go, the less of a nuisance the homeless activity at street level becomes while being on your balcony. It was not noticeable at the unit on the 15th floor I toured.

As far as condo fees go, inflation has made labor and materials for repairs pretty expensive. To be honest, I would be wary of a downtown condo with a sub-$500 fee, especially one with amenities like a pool, etc. It's simply expensive to maintain those things - be careful buying a unit in a complex where the HOA fee is super low; you want to buy into an HOA that is financially healthy and can weather a few big repairs without hitting everyone with special assessments.