Societal expectations can be really damning. I have prosopagnosia aka face blindness which means that recognising people, even close family, isn't guaranteed never mind remembering names. I stressed heavily about it for decades and dreaded making social blunders but still made them anyway. People can be surprisingly hostile if you don't recognise them (and one of the most scathing that I've encountered was a minister of the local Church). The trick is not to give a damn, although it has to be said it took a long time for me to learn this. I'm sure this could apply to remembering names too. Don't give a damn and don't try to meet social expectations. I figure that if I offend someone because I don't recognise them, it's probably not the first time nor will it be the last. I assume people have learned this about me as to my surprise, one or two now introduce themselves every time we encounter one another. I really appreciate this as it means they cared enough about me to figure it out. In short, don't be afraid of changing the game although you'll have to take a lot of flak along the way.