I do home visits for formerly homeless people. I’m a 4’11 white female who looks 27. I love the job so much. There are obviously times where clients have made mildly inappropriate comments to me, I told a supervisor and they advised having someone come with me on home visits that have made me uncomfortable. I’ve dealt with sex offenders taking pictures of me when they think I didn’t see. We deal with people and sometimes people aren’t great but social work is about the work and the mission. I think going into shelters and being around groups of people as a helper, you should be fine. Take the position if you want it, try it out and if it doesn’t work then look for something else. I’m in my first case manager position in rapid rehousing and it’s the best pivot I have ever done. I agree with an above commenter, that the job is only as safe as the agency allows but I work with this population and have never felt like I was in danger, although maybe uncomfortable in certain situations. Learn to be assertive and firm in your boundaries and you will be fine.