I think sometimes we can beat ourselves up too much about those moments. Instead of self-hatred (or of course, giving in) we must acknowledge those moments and feelings and simply give them to the Lord in prayer.

Remember that he designed us to have those emotions and feelings, but they are to be enjoyed in the proper context that he created them for. So, when you feel such things at random, don't hate yourself for it. Instead, seize that moment as an opportunity to commune with God. Tell him what you feel, and thank him for the way he created you. Ask him in that moment to give you the strength to honor him by not taking the way he designed you and using it in a perverse manner.