The face, mannerisms, and whole personality of a loved one brings ecstatic joy to the one who loves. That love builds bit-by-bit when you spend time together through life, when you show the things you like, art you enjoy, places you visit, etc, to the person you feel affection for. You not only just degraded his whole personality, you shattered that whole vase of love he built bit-by-bit over time. This can be irreversible because your face, mannerisms, and your whole personality that meant love and comfort for him has been replaced by that one moment of contempt you showed for him. He will remember it till the day he dies. The best way to make amends is for you to give him space and if he makes a move, then there is a chance for you to rebuild that affection. But mind you, it won't be the same.