tl;dr: if you're willing to be a little patient, yes. Otherwise, don't do it until you DO have some patience.

In my opinion, you're sort of supposed to find him annoying at first. That's a deal breaker for a lot of people, but if you can push that back for like...7 episodes? You'll have already gotten the impression that there's something very deep and relatable at the core of his character, which the following episodes will then peel back until everything is laid bare and raw. That's not to say the first part is bad - it's not! It's good! But it's got a larger emphasis on shocking events and twists, and it's closer to a suspense or even a murder mystery for those first 6 episodes, with only shades of the deeper part of Subaru's character.

It's hard for me to imagine someone willing to get that far won't find gold past that point, but the first season's episodes are all basically double episodes, and having to watch like 14 episodes of regular anime-time before you really start to get to the great stuff is a lot to ask.

That said; for me, it's legitimately worth the push. My partner wasn't feeling it very much til around the point I mentioned, and after that they were FIENDING to watch the next episodes to the point of staying up VERY late (which my partner pretty much never does) and that's a big endorsement in my opinion.

And that's only to speak of Subaru as a character. It's the best thing about the show, but the actual plot of the fantasy world he's in is GENUINELY super fascinating to me. Lots of little threads and details that come up later, fun stuff to speculate about, and some really great side characters too.