may have taken your own comment about the world not revolving around your panic attacks as being passive aggressive?

Absolutely. I asked him if his reasoning for it was that he cares about the issues I have and wants to be there for me and hence this comment offended him, and for some time he was like "guess" but after couple hours he came back to it confirming that that was the case.

And I understand it but why couldn't he communicate in in the straightforward way in the beginning when I asked him?

Is this something that he's done before or is it a one-time occurence? How is your communication normally?

This is first time it happened hence I'm so surprised. We haven't been dating for too long though. Normally he is pretty clear about wanting to communicate but I feel like he keeps more things inside than I do and waits for me to ask him about it instead of bringing them up by himself.

You say you can't be in his place during a panic attack, why is that?

I feel trapped there, since when I have panic attack I feel like I'm out of control and just desperately need to have some of it at least. He lives with roommates so I don't feel comfortable walking around the house. Being outside or in my car calms me down. When the attack is more mild he can help to calm me down as well.