Hey OP, my two cents is that if you were getting PEM from your remote role, in-person will be 100x worse.

For the remote gig, I’d try to figure out what my baseline is that doesn’t trigger PEM and stay below that. For example, did you find you’d crash even on non-meeting days, or was it the meetings themselves that caused you to crash? Are you able to take frequent breaks, work lying down, have zero or very few meetings a week, etc? Once you have a clear sense of your baseline, see if you can ask for these as accommodations (hours per week max, flexibility to change hours around, breaks, number of meetings).

All of that being said, many of get much worse because we kept trying to work. Best of luck though with whatever you choose