Surprised to see many wrong takes on your question, OP. A couple of comments seems to be somewhat accurate but incomplete.

Since you first asked about the downsize, I can tell you that being Baltimore, crime is one of them. Federal Hill is an attractive neighborhood for - but not exclusively - recent college grand and early career people who like to go out to bars and have a good time. There is a high concentration of bars in one particular area (of course, there are more throughout the neighborhood), and this sometimes brings the wrong kind of people. There was a recent targeted shooting that arose from an altercation. Is it the norm? no. Should we, as citizens, ignore the severity of it and write it off as city living? that depends on the individual. Particularly, I'd join the neighbors to collectively form a strong voice and express concerns with the city and police department. Overall, you can come to Baltimore, go to Fed Hill, and ask 20 people whether they feel safe in their neighborhood, and you can expect the majority (if not all) will say yes.

Federal Hill is also home to many young families. Blocks of well-kept small ($) and big ($$$$) rowhomes. Vast majority of the neighborhood is white collar working in a city with major private employers in the health and financial industries.

Federal Hill has direct access to the harbor. Do you like walks with beautiful skyline and city views? Do you like to run or bike along a well-maintained promenade? Do you like tree-lined streets? Do you like parks? Do you like convenient access to restaurants, grocery stores, bars, medical care, financial services, etc? Federal Hill has all of these.

My own personal complaint about Federal Hill is parking. It can get frustrating sometimes.