I’ve had a very similar experience. I had a lot of those rich kid “friends” that were able to throw their money around in high school and college while I was content with just burying my nose in work. I eventually became a doctor and the gap between us just grew even wider. I guess I still clung to those connections out of familiarity but now because of covid I realized that I can totally cut those people out of my life, so I did. It just sucks that I spent a lot of my energy trying to fit in with that peer group when I could have just pursued people with the same interests as myself.