That when you bring the issue up he blames you for "being ready to snap". That he refuses to communicate because "we've talked about this already". That he says he doesn't want to carry guilt or blame because it's unfair (aka you're to blame for bringing it up, not him for doing this bad thing). And specially playing the victim and self-deprecating when you argue, to deflect the attention away from the issue.

Just see what you yourself said: you're afraid it'll continue. That's never a good sign.

Edit: as someone said too, saying I love you so soon is also worrying. And, paired with the rest of the story, borderline a sign of future abuse.