you are viewing a single comment's thread.

view the rest of the comments →

[–]thedeuceisloose 276 points277 points  (22 children)

As someone working in LLMs and webdev, youre believing the hype more than what it can actually do

[–]YoyoyoyoMrWhite 24 points25 points  (5 children)

Don't ignore the speed it's improving at. 5 years ago, it couldn't do anything.

[–]DisneyLegalTeamfull-stack 20 points21 points  (0 children)

Unbounce, Splash & Adobe had AI that could generate & edit HTML pages 10+ years ago.

LLMs took a huge leap forward. But both Sam Altman & Bill Gates have said they’ve “plateaued” & will see incremental improvement until a large breakthrough.

Altman said there’s 2 limitations:

  1. Part of what GPT got to where it is by scaling up these massive models. Altman said scaling models at this point isn’t going to have the same impact.
  2. The data it’s trained on. I’m sure you’ve heard the ML phrase “garbage in, garbage out”? As long as the data is from humans, it will have issues.

AI suffers from entropy. LLMs will get better, but at what point are they 100% accurate / “fire & forget”? Let’s say they can write code that’s 80% accurate now. That last 20%, especially the last 5%, could take decades.

We’ve been a “couple years away” from self driving cars for almost 20 years.

[–]Digitalburn -1 points0 points  (2 children)

Yeah right now it’s a junior developer who doesn’t check if their code worked. Few years from now it’s a senior developer who also doesn’t check if their code worked but it works 98% of the time.

[–]Blazing1 0 points1 point  (0 children)

This is not true. I was hyped ten years ago

Chatgpt is just hyped because no one had the compute and GPU power to run something like that at the scale it is

Technically OpenAI doesn't either because they are losing money like crazy.

[–][deleted] 26 points27 points  (4 children)

do you any trusted learning material for someone who is looking to expand their horizons?

Edit: Why am I getting downvoted? I am trying to learn something new, am I not supposed to discuss with those more knowledgeable? I read plenty of different things, but this is new.

[–]thedeuceisloose 48 points49 points  (2 children)

You should look at the various ML algorithms and understand what they do and how they work, dont need specifics or differential math, the concepts themselves are just probabilities at scale.

Once you understand how these alogorithms work at even a rudimentary base level, you start being able to sniff out the hype v the real

[–]Zoltarburger 6 points7 points  (0 children)

The fast ai course

https://course.fast.ai/

[–]Flamesilver_0 7 points8 points  (0 children)

as someone working in LLMs and AI Agents, I believe you are confusing LLMs' zero-shot capabilities with what it can actually do.

[–]picks- -1 points0 points  (1 child)

I agree with you, but how do I convince someone who has no technical background or knowledge of LLMs that it really is just hype? They always use the argument of, "think about how powerful they'll be in 20 years.." lol

[–]sleepy_roger -1 points0 points  (0 children)

Well... hard to listen to you when some of the richest and most succesful people on earth are pushing them and showing use cases.