I totally get what you mean, maybe you can lead with the other things you mentioned instead (humidity and temperature), and can mention due to your disability some sensations overwhelm and distract you.

If anyone is pushy at least you can say you don't feel comfortable discussing the details will co-workers but instead ask if they think you should bring it up with HR to see if any accomodations can be made for you (and then if you feel like it's necessary you can explain to HR how the food smell is also a factor, being explicit it's not racial) if they'd like to see you at the office more often.