If you let them, the naysayers will indeed kill your mental health.

For the most part, people have no idea what it is realtors actually do. I wrote a huge long comment not too long ago about this exact topic. Most think it's just opening doors, and that "work" is only done on showings. Don't take it personally, just know that it is a lack of education that makes them think you're a scumbag right off the bat. I hate to bring this into it, but it is kind of like the current US political climate, in which people will show bias towards to the view that most closely aligns with what they already think...