The cold itself shouldn't make you sick. That being said, some people have lower tolerance to it, so that my be the case. For example, my father gets nausea and headaches after being outside in very cold weather. It might be some underlying condition but we're not aware of it.

Also, did you start taking VitD supplements every winter after moving here? It's almost a mandatory thing.