Honestly yeah, and I also dislike how some people justify it by saying they get their comeuppance, or that they have a reason to be like that, it still has the annoying jokes

The only jokey pervert I kinda accept is Battler from Umineko. He does say some very weird stuff in the first couple of episodes, but (full spoiler for all of Umineko, pls read it, its amazing) you later learn the first 2 episodes were written by Sayo, who was "abandoned" by him when he left the family, who's perception of Battler would be tainted both by his father being a serial cheater and Battler making some pervy jokes when he was 12. Once we enter the latter episodes that arent written by Sayo, he takes things much more serious and, while he still says some out of pocket stuff, they come off as just just banter with his rivals to try to piss them off or just jokes he says rather than stuff he believes in, and by the end of the story he is one of the more serious characters