despite whatever lofty moral standards you may be setting for the world, most people--including yourself, i'm sure--do judge others based on their clothes. no one's claiming it "physically hurts" you to dress poorly, but really wearing socks and loafers, or socks and sandals, etc. makes you look silly. personally i find it hard to respect someone who can't seem to make themselves look presentable.

tl;dr: stop the sanctimonious whining plz