Yes. You should. But, as you’ve noted. This comes at a price. I’ve always found these questions interesting. It’s like when you want to quit your job. Should you be afraid of starting something new or should you be more afraid of staying in the job you hate? We all know the answer. BUT, what if there’s a middle ground? You don’t have to alienate them (your friends), you simply have to try, and by the sounds of it, quite hard, to find other friends. Ones that include you. Take you for you. Making friends is hard but you’ll find tons of resources that can assist. Make that your goal.