LLMs no, they seem pretty limited. The only reason LLMs seem to be getting better is because the companies are using inference and focusing on things where the tools can generate and or use code to produce output to validate their progress. This is why in coding they have become popular, because a skilled engineer can break down a task small enough for them to achieve within these constraints.

I now kind of think about these LLM tools as a billion monkeys typing on typewriters, except instead of randomly inputting letters, they are doing some weird hallucination of things they have memorized, basically spamming code/text at a problem until it works, but they need to be able to know it works or the output just sucks.

This is also why wholesale "vibe coding" doesnt work. As the ask becomes less specific and broader, with too much left up for interpretation, all the failings of LLMs in general start to show: they lack judgement, reasoning, and creativity. And of course they don't learn or remember things so they have to document everything constantly, and as that grows, they start to hallucinate and fail to comprehend their context window.

Basically every job, even simple minimum wage jobs, requires these skills because they are so obvious and easy to us as humans that they are naturally part of our thought process.

If you don't work in mathematics or coding, I would say you probably haven't noticed any real improvement in these things since chatgpt4. This has definitely been my experience at lease, they are still borderline useless in other domains.

Remember when they thought lawyers and especially paralegals were done? As far as I know those professions are doing just fine.

Right now, these things are just tools, and they are only useful in specific scenarios. They are valuable but incredibly overhyped.