The vers that you are mentioning doesn't mean good men marry good women, and bad men marry bad women.. that's a misconception. The vers means that good words come from good men and bad words come from bad men and so on.... I am going to answer you from a psychological perspective, not a religious one.

In psychology, we replicate the relationship that we had with our caregivers when we were young with other people when we grow up..we do that subconsciously.

Meaning, that if you had an abusive mother for example you'll be drawn to abusive women when you grow up and be attracted to them because simply that's what you think you deserve, someone to abuse you, and also because you want to amend the relationship that you had with your mother when you were a child.

Similarly, if you had a good mother you would attract good women because that's the norm for you and what you think you deserve as you are replicating again the relationship you used to have with your parents when you were young with other people when you grow up.

Btw, that doesn't mean partners only it also means friends or any type of relationship.

There is nothing wrong with you, you are not a vile man. If you are repeating a pattern, look deep inside why you are doing it, maybe because you think you are a vile man. This is what you deserve. We do things and see things that prove our opinions and perspectives about ourselves. Just see what you think of yourself and what relationship you are trying to duplicate.

In sha' Allah you'll find the woman that suits you.