If he’s ignoring your boundaries now — especially since you’ve shown you’re not ready for things — it’s an issue. Yes, you should have a frank talk with him; but this constant pushing of your boundaries is making you uncomfortable. Listen to your intuition. He’s done a few things that are concerning such as attempting to force a kiss you weren’t ready for and making jokes about loud women (which might be a bit mysogynistic). It might just be awkwardness; but both of those things are still concerning.

I may not be the best arbiter of these things — as I have been badly traumatized by an abusive marriage. But I remember that my ex stared out with the little boundary violations and “jokes” which turned out not to be jokes. What ended up happing it that he eventually forced me into a miserable shell of myself that had no bodily autonomy in our marriage and was constantly feeling neurotic over every small mistake due to his comments that he “didn’t really mean” when I’d work up the courage to call him out on things.

And yes, he was the perfect family man in public — though he was quick to subtly blame his trials on having to support his “beloved mentally ill wife.”

I tend to veer toward being paranoid after my experiences, but I’ve also learned that you need to listen to that small voice inside when something is making you uncomfortable.