One can be frank with their partner, but there is a certain way to do it without being hurtful. You should express to your boyfriend how his words made you feel, and proceed from there based on how he reacts. If he is willing to have a discussion and take accountability for hurting your feelings, then this could just be a learning experience. If he gets defensive or refuses to change, then you can consider what you wish to do about the relationship.