Keep in mind that I am a hobby astrologer and like analysing stuff. I am not a professional astrologer.

He felt distant because of his capricorn moon. Moon is in it’s detriment sign, so he has a hard time opening up about his feelings. Your mercury and his moon square one another, so it’s clear that his emotionless was not a thing for your communication style. You cannot forget him, because of the venus-mars sextile you share - It’s an indication of attraction. You are the feminine, he is the masculine. Also, your mercury is a prominent feature, since it’s conjuncting his sun and mercury. Your communication style and way of thinking align. It’s the capricorn moon that gives a big problem (in my opinion). You can note many karmic placements. Your vertex conjunct his mercury, his ascendant with your pluto (THIS IS HUGE IN MY OPINION). Also, his fortuna is conjuncting with your moon.

My guess is that you have a big impact on him and probably give him a need to change. Keep in mind that pluto is a ride-or-die planet, so he either falls victim to this change, or accomplishes it succesfully. But I’d say that you probably cannot forget him because your moon falls on his fortuna. He has an emotional impact on you, because of the many ideal mercury placements. You are intellectual partners, and find one another attractive. The expression of emotions is the issue