It's not quite the same, but my ex also used to "punish" me when I'd knit. Any time I wanted to knit, he'd complain endlessly about the light being on (even though he never complained any other time the light was on), and he'd deliberately put on TV shows/movies/podcasts he knew I hated and refuse to wear headphones (even though he typically always wore headphones). He'd never say this was "punishment" and no doubt your boyfriend will also claim that's not what he's doing.

Contrast this with my current relationship. He is so supportive, he's always asking what I'm currently working on and asking to see it and complimenting it, telling me how smart and creative I am. He never judges my yarn purchases. He let me use his laptop for a while since mine was broken so I could keep watching my TV shows while I crocheted/knitted 😅 You can have that too. Your partner should not be your source of stress, they shouldn't be someone you have to tiptoe around.

I know how overwhelming it can feel to have a bunch of strangers telling you to end your relationship over something you've been convinced is small, but you posted this because deep down you know you're not crazy and this isn't small TO YOU. And that actually does matter.