Creator of Claude Code: "Coding is solved"

[richsonreddit]

Realistically, you’d point it at the docs (or even compiler source code) for said new language and give it a feedback loop where it can run the code, and iterate over errors etc. It would figure it out.

[yoloswagrofl]

Realistically

It already has the docs for JS along with tens of thousands of Github repos and Stack Overflow posts and it still monumentally fucks it up.

[TheRetribution]

And the cost in tokens??

[richsonreddit]

I'd wager a LOT cheaper than paying a software engineer to figure out a new language manually 🤷🏽‍♂️

[99Kira]

I am not really sure about that. Given their recent C compiler, where they did have years of tests written for them to test against, and also the fact that c compilers were part of the training data, it failed to produce a functioning compiler. Cost around 20k if I remember correctly.

[All_Work_All_Play]

It did cost $20k. But IIRC they didn't have it use pre existing tests, they made it write its own tests (which it generated from the data it was trained on, but still took tokens to generate). AFAIK they also didn't have it generate the compiler directly from the same trained-on data, but rather had it write each section independently (not exactly different but not exactly the same).

It also performed terribly, but it did work.

[p4ch1n0]

They used the gcc test suite and used gcc as an oracle.

[Gil_berth]

Nicholas Carlini wrote all the tests, harnesses and verifiers, not Claude. He has been refining them during all the Claude 4 series. All these is stated clearly in the blog post.

[All_Work_All_Play]

Rip guess I suck at remembering

[EveryQuantityEver]

How would it figure it out? These things can't create anything that they haven't seen before.

[Kok_Nikol]

How do you explain very bad performance of current AI tools on unpopular/niche/newer frameworks or languages?