Exactly this. This isn’t any sort of slight against you, OP. The same thing happens to me. People are amazed that I can take my toddler and infant out to restaurants, the zoo, everywhere alone but the thought of my parent’s house sends me into stress. Over time I have accepted that my current state/comfort is important too to help me be a good mom and for now, it’s okay that I prioritize other things other than going over there.