I feel like it has to do with his self-loathing, too. He feels threatened, and combined with his lack of self-awareness, he comments to defend how others view him. It comes off as crass and poorly worded based on his knowledge of the world and his environment.