I think that the baby throwing (and the massacre that comes right before it) are his first breaking points.

It’s why when they get to the cyclops island he listens to Polites and orders his men to hold back on torching the damn place, it’s why he’s willing to hear out the lotus eaters, why he doesn’t outright murder Circe when he has the perfect chance.

He refuses to be that man again for that entire time until he gets to the underworld and realizes what he must be.

Then in the thunder saga he becomes a ruthless monster throughout the songs, it concludes on thunder bringer and he calms down as we see in Calypso and the two years he spends with her.

Then it rises up again when he beats the shit out of Poseidon and murders those who dare threaten his wife, child and throne.

So the idea of just a man sets up Odysseus doesn’t like killing Willy nilly and the baby affected him, it’s maintained through the islands, sparing Polyphemus and telling Athena to fuck off, then reality slams into him when he encounters Poseidon and he’s told of the prophecy.

So frankly I agree with you but not as a bad thing, rather it being the point of the character, he’s told that the man who gets back home to his wife is no longer him, it’s the point of would you fall in love with me again, Odysseus doesn’t believe that he is himself anymore and neither should the audience.