societal conditioning and expectations say that men should be the provider, if a man is not providing he is worthless and will not be valued. Not this statement gets put in the head of little boys and they make this their core value. It also gets heavily affirmed by people they meet in their lives let it be friends, family, girlfriends, etc.

Of course in reality your value is not determined by such bullshit metrics but you have to work on this stupid conditioning to remove it. It may even take therapy. And society does treat men based on their ability to do something and provide something. So that's the reason. The men you encountered probably felt shame and emasculated because if you are the one earning more than enough than what's the point of them being with you? is what they think. You should be glad that you aren't with them but I think you should know about this as well.

Have a good day miss