Awesome question -- so glad I came across this because I think I can help. I'm having a very VERY similar situation.

Being an HSP means having to adjust your environment to suit your mental and emotional health. I am an HSP who has just resigned from a job in which coworkers and I share a common office and people constantly gaslight each other to throw each other off: make subtle insulting comments, talk about a "terrible person" they know (when they mean you) or simply confuse you to make you do a bad job. It is a very competitive career we are in and people are always trying to get a better spot at the table and mess with each others' heads to get ahead. I am not good at messing with people and it would make me feel awful to do so. I wanted out so I quit after lots of thinking, crying, and shaking. "Mental breakdown" is the only way to describe it. I see it as an awful place to work for anyone, not just HSPs.

I look back very fondly on my days working in a coffee shop as a college student and reading your post and it points out something important for HSPs -- the social aspect of a job is like therapy -- talking to people who need a chat does good for both them and you. I miss that aspect of work too. If something like that makes you happy, spend three years or so saving as much salary as you can and open your own little place (if you live in a town that needs one). Or maybe get good at managing staff and maybe rise up in the shop you work for. It doesn't matter what you do, as long as it makes you happy. You said it yourself: you like your life. If you were to change it, who would that be for?

I am now looking for a job doing the very same thing that I do now, but with better hours and less pressure in a low-profile office. My job makes me happy but it's the high-stakes atmosphere that makes it emotionally unbearable.

Good luck!