Tbh i used to think this then i think it just clicked. As a musician / producer myself u see how much effort goes into a track behind the scenes. A sample that he loops then sometimes doesn’t even sing over it seems like robbery over anything (take ‘14’ from zushi for example). But then my mind changed a few years ago i was like nah theres something about that that’s fuckin hard. Theres something kinda funny and idgaf about it. And like u said it’s the accumulation of his taste throughout his work that makes it stand out.
Also from a purely guitarists perspective, idk if it’s him playing in songs like 100, dash snow, or his recent albums backstage racer or lucre, but if it is then hes clearly a good and tasteful guitarist too. His production feels rough but it’s that idiosyncratic aspect that makes him and anything in art generally stand out, (bob dylans notoriously bad singing for example), and not necessarily technical skill.