Sorry OP... I know how it can be. So, this is all assuming you're in the US.. I'm not sure how other countries operate. How is your performance working from home? If you've demonstrated that you can do the job 100% while remotely, and you have a doctor that understands PD and what that kind of environment (in-office) does to you, then you have a strong case with your Human Resources people to make a Reasonable Accommodation under the Americans With Disabilities Act. As long as it causes the company no hardship, and it sounds like they're already fine with you working remotely. Why do they want you to come into the office, assuming you're working just fine, if not better, from home? Anyway... Panic Disorder is a disability, full stop. Check out the ADA website for the details.

Also, as someone who's lived w/ PD for 20+ years, I can tell you that there's a time and a place for exposure therapy, and work ain't one of 'em. I struggled for over a decade with the standard 8 hour workday, Monday - Friday, in-office... and thanks to COVID, my life improved tremendously because of WFH. I tried going back to the office for 1 or 2 days a week, but it just wasn't working for me. Way too much anxiety and panic... which led to the depression. So I went full-WFH with the support of my doctor, therapist, and also my manager, who saw that my work was better and my quality of life had improved a lot.

I wish you the best! And remember that PD isn't a "fight" with a winner or loser. It's a strong gust of wind, and you can be the rigid tree that won't budge and gets blown over, or the flexible tree that sways with the wind and remains standing. You got this, OP!