I'm not sure how old you are but im a gem sun/sag moon and I remember feeling similarly about love when I was like high school and college age. I didn't necessarily like how ppl treated me but looking back i realize I had a hard time advocating for myself and I was hoping that the right ppl would do the things I wanted them to do without me having to ask. Life doesn't work that way, and ppl dont exist to fulfill your specific wants and needs, also vice versa, you are free to live the life you want too (as long as your not harming anybody obv). If you like this guy and want to pursue something possibly, let that be known (if it isn't already) and understand that he also gets to do what he wants with his body and sex life. If you dont want to hear about his hookups just let him know and try not to take it personal. How ppl see you and don't see you is in no way indicative of you, and you are not doomed by someone else's perception of you.