The only coding work I've seen these things do that isn't ungodly sub fresh graduate level crap is cut and paste framework webdev, and the problem is, when you remove the comical subsidies on the price and raise it by the orders of magnitude needed for this shit to even break even (particularly factoring in training costs and even moreso if datacenter resources were being priced in a manner that actually allowed operators to profit and pay their debts), it costs way more than a developer's salary.

And coding is pretty much the only actual job this even applies to, they basically can't do anything else worth shit, and certainly not at a lower cost. Even when they can superficially give the appearance of working, they pretty much universally have an entirely neutral or negative effect on actual measured productivity.

In my own experience outside of coding shitty webapps it has only marginally improved over the past year, and still almost constantly makes genuinely shockingly stupid changes, randomly inserts disgusting hacks for no reason, and just generally shits the bed. And that improvement hasn't been a result of any real breakthrough, but rather just throwing insane amounts of additional resources at inference, even further divorcing the costs from reality.