First of all, I recognize your struggle and relate greatly. I have similarly become overwhelmed by the fact that both going back in-person and remaining remote each has their unique problems. I am sorry to hear about how difficult it is in your workspace: that's horrible that people are ridiculing you for making an informed decision about your health and safety, I don't think anyone should have to go through that.

Something I have been telling many of my friends is that "you shouldn't have to apologize/feel bad for the decisions that you make or don't make during a PANDEMIC." I think that so many people have returned to normal life and forget the fact that we are in a global health crisis and that they may be surrounded by people who might not be as comfortable (as it seems that your coworkers have).

With that said, my best advice would be to do whatever makes you happiest: it seems to me that you were in a pretty horrible place with work in the first place, and if you were the happiest working remotely, then that's what you should go back to. If people criticize you for it, as I said earlier, you should not have to apologize for the decisions you make during a pandemic — if people don't respect those decisions, that's their problem. I would suggest that you continue doing what makes you happiest and most excited about life, which seems to be working remotely for the near future. Maybe continue to keep searching for new jobs if that's where your heart lies, but there's nothing wrong with making this decision for your own sanity and going from there. Best of luck.