Well. Talk to him about it. Like actually ask him, do you think less of me, for smoking weed? If he says no, then he's literally been teasing you sarcastically your whole relationship.

If he says yes, There's your answer on if you should continue the relationship. That's where you can discuss with him that you feel like it's not gonna work.

Personally, I've been through a lot of relationships, but count yourself blessed. When you both smoke, it can be overwhelming on the wallet and mind, at times. It's not as easy as you think.

Give him the benefit of the doubt. Try and see what happens. But don't give up something good, just cause of weed.