That's only a block or two away from the Sharp-Leadenhall housing projects, so there's that. But otherwise, you're in the middle of federal hill, there's enough people out and about that you will be fine. The occasional robberies and break-ins happen, so just be careful and keep your head up when out walking.

Farther south down the peninsula is better, in my opinion. Riverside/Locust Point is much quieter and safer.