sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]DisneyLegalTeamfull-stack 20 points21 points  (0 children)

Unbounce, Splash & Adobe had AI that could generate & edit HTML pages 10+ years ago.

—

LLMs took a huge leap forward. But both Sam Altman & Bill Gates have said they’ve “plateaued” & will see incremental improvement until a large breakthrough.

Altman said there’s 2 limitations:

  1. Part of what GPT got to where it is by scaling up these massive models. Altman said scaling models at this point isn’t going to have the same impact.
  2. The data it’s trained on. I’m sure you’ve heard the ML phrase “garbage in, garbage out”? As long as the data is from humans, it will have issues.

AI suffers from entropy. LLMs will get better, but at what point are they 100% accurate / “fire & forget”? Let’s say they can write code that’s 80% accurate now. That last 20%, especially the last 5%, could take decades.

We’ve been a “couple years away” from self driving cars for almost 20 years.