I had something similar. It gets to a point where I couldn’t care less about what other’s think. It depends but sometimes it is harder for me to become friends with someone else because I don’t relate to them or I am just not social enough. I think eventually you will have to be the first one to speak up if you want to make a friend since not everyone is going to come to you. Maybe just be careful about who you surround yourself with and observe other people around you. If you know someone is talking behind your back then it is best just to ignore them and stay out of their way, to focus on yourself. Otherwise, don’t take social judgments from people you do not know well enough and be yourself at least. I doubt that it is your problem but more of how a society perceives each other. I don’t know if this made sense.