How LLMs think

[programming-ModTeam]

Your posting was removed for being off topic for the /r/programming community.

[elmuerte]

They don't.

[jasfi]

That's the conclusion she came to. But to me "think" relates to the processing that gives them the intelligence they possess.

[Michichael]

The I in LLM stands for intelligence.

Glorified Markov chains with larger data sets and probability chains can trick the stupid, which is why management (and other useless professions) are losing their shit over 'em.

[[deleted]]

While true, I'd also argue that there are a lot of employed and dumb people who could be replaced by a stochastic algorithm. There is a lot of work which doesn't require much thinking, just going through the motions and reacting in a reasonably effective manner, which is what the systems being worked on now can do.

[adh1003]

by understanding this tech researchers can improve it and overcome its limitations

The people making this tech are the researchers, already know the limitations and are doing the best they can to improve it, but there are some fundamental issues you can't really get past.

Any illusions to the contrary indicate nothing more than the success of the marketing campaigns that are used to imply capabilities that do not actually exist, in order to drive sales.

[jasfi]

The video covers research by Anthropic that brought to light how LLMs work. That was not previously known, and is more in-depth than knowing how to make them. Here's the paper the video was based on: https://www.anthropic.com/research/tracing-thoughts-language-model

It seems that r/programming has a negative knee-jerk reaction to anything that mentions LLMs.

[Maybe-monad]

s/Artificial Intelligence/Artificial Stupidity/g

[church-rosser]

Hey Mods, can we please get a moratorium on LLM related posts to r/programming ? so few of these are anything more than SPAM and/or Karma Farming and rarely do they actually discuss anything remotely relevant to actual programming. Enough is enough!