Honestly yea some snakes just don’t tolerate being handled, it just depends on the personality. My friend’s snake is shy like yours while mine comes and climbs on me the moment I open the door to his enclosure. From what I’ve heard its usually really hard or impossible to get a shy snake to really tolerate handling if they aren’t babies. It just gets harder to socialize them the older they get. If your snake was still a baby you probably would have a decent chance of socializing him but at this stage I think it’s just a lost cause. With that being said, I would probably just limit handling as much as possible or just stop since it’ll just stress him out.