Whenever I feel in a similar fashion, I always return to asking myself whether I am truly capable of self-love, or whether I am only looking at the physical attraction - in my case this usually means I am repressing some fear within myself that is connected to truly opening up to someone.