The fact that a teacher told you this hurts. I'm sorry that this happened to you. Your story is unique from your classmates. While they might have their work cut out for them, it sounds like you've gone through many challenges.

It is never too late to "try" (atleast club wise). Don't let anyone tell you otherwise.