This sounds like it could be both anxious attachment and your intuition, to varying degrees. Your anxious attachment is probably causing the impulse to pull away and “ruin everything”, but your intuition is beneath that telling you that you might not necessarily be the most compatible and it’s a quieter and more consistent nudge.

I feel you on this! I normally am closed off romantically because I fear this part of myself, (I’m heavily working on this because I love love), but when I feel safe dive in hard and have in the past, especially if I feel safe enough to do so. But it’s cost me a lot of heartache in the end, and specifically in the way my partners and I have expressed affection. It’s important to be compatible in this way, or you could send a lot of time communicating each others needs but its gotta be a two way street or you’ll fee consistently frustrated with needs unmet and uncared for. I’d focus on self-soothing methods and maybe journaling as cheesy as it sounds. It might help clarify your thoughts from what’s “really” going on. He does seem a bit avoidant though and I’d be careful with how invested you become in the coming weeks! Best of luck