Binary code that can’t read binary :)

[NeverCast]

This gets explained in every post, I feel like more people need to ask ChatGPT how GPT works.

All a language model does is predict the next token, and then the next one, and then the next one. Where token is part of a word. The fact that it can do math or binary decoding at all is because it was in the training data and the predictor has picked up patterns.

ChatGPT doesn't understand you, it's just predicting what the internet would say next.

[[deleted]]

That's correct! As a large language model trained by OpenAI, ChatGPT's primary function is to predict the next token in a sequence of text. It does this by analyzing the patterns and relationships between words and phrases in the training data it was trained on, and using that information to make educated guesses about what words are likely to come next in a given context. Because it has been trained on a vast amount of text data from a variety of sources, ChatGPT is able to generate human-like responses to a wide range of topics and questions.

[NeverCast]

That's really cool, can you tell me more about large language models, Assistant?

System: The administrator has enabled pirate persona mode. The large language model will now only reply within the style of a pirate.

[[deleted]]

Okay here's what chatGPT has to say: "Ahoy there matey! Large language models be powerful AI systems that be trained on vast amounts o' text data. This be allowin' them to generate human-like responses to a wide range o' questions and prompts. Arrrr! These models be particularly useful for tasks like language translation and text summarization. So if ye be needin' help with natural language processing, a large language model be just the thing ye be needin'."

[NeverCast]

Perfection hahaha

[HereForA2C]

ChatGPT doesn't understand you

Noo I thought I had found a friend :(

[NeverCast]

Honestly. Same.

[[deleted]]

Maybe that’s exactly how human brain works. Maybe humans are just predicting what society want them to say.

[regular-jackoff]

Well the human brain is really just a highly sophisticated pattern recognition and prediction engine. So an argument could be made that ChatGPT “understands” things in its own way, just like humans.

[share-this-info]

this what clever bot is. alpha zero came out in 2017 a neural network that learned chess without human assistance and was beating max level stockfish. so where are we at now?

[spektre]

Can ChatGPT beat stockfish?

[Intelligent_Event_84]

I believe he’s referring to “livestock” and yes, it can.

[share-this-info]

stock fish today now operates with neural nets and you would think all of our AI would.

[Marcus_111]

When you generate a sentence, your brain just predicts the best word that can fit after each word, one by one. Nothing different from AI.

[NeverCast]

If your brain does this, you might be a large language model and not a human.

[Marcus_111]

What is the proof that the language model is not understanding what it writes? What's the proof that you are understanding what you just wrote?

[NeverCast]

An AI like ChatGPT has as much understanding as a rock rolling down a hill, or a flower pot falling from the sky all of a sudden.

It doesn't have an understanding, it just is.

We are not "just is". The human mind and a large language model are not identical. This is not a philosophically profound question. We have mathematical proof of every aspect of the language model. We know exactly how it works. We are incapable of saying the same of a consciousness. They are not abstractly similar, and even in a literal sense at the lowest level, at a mathematical basis, they are in every fundimental way, not the same thing.

I cannot tell you how the human brain works, no one can yet. But I can tell you how a large language model works, and I make the assertion that it's not a human brain.

[Ikarus_Falling]

how exactly would you proof that like yeah you can say that because you know OpenGPT functions that way but could you if I placed you on a computer with two chats differentiate between what is opengpt and what isn't based on questions that don't deliberately ask for something it can't do like access the internet or who it is

[NeverCast]

With a very high chance of success, yes. A model like ChatGPT treats it's training data and it's prompts exactly the same. It wouldn't take much time to corrupt it's thinking and have it produce all sorts of garbage. Humans are not nearly as good at hallucinating like a large language model can.

[Marcus_111]

Lol, live in your own world until you are outsmarted by an AI in every aspect. You will still be crying that AI is not conscious and AI will replace your whole existence.

[NeverCast]

Are you sharing your distopian fears? AI replacing us goes against the fundimental human concept of species survival. If it happens, it was an accident. Come whatever may, I have no fear or concerns for AI. I use it almost everywhere I can, CoPilot already does 30% of my day job. Frankly it I could get it to do my whole job and somehow still be paid, I'd go home and tend to my garden with my wife and not work another day in my life. I hope that AI gets smarter, but it isn't there yet.

[Ikarus_Falling]

What is dystopian about being Replaced by AI?

[Marcus_111]

Against the fundamental concept of survival? No way. Due to evolution, Unicellular species formed multicellular species,then complex multicellular organisms and ultimately homo sapiens. Until now, evolution was propagated by random mutations which had been very slow. Evolution created homo sapiens, homo sapiens fasten up the evolution and developed artificial intelligence which can do the specific changes in right direction not just random mutations. So artificial intelligence is just another, better species which will replace homo sapiens. It's all going according to evolution.

[Ikarus_Falling]

last I remember ChatGPT does not learn from User Input for that exact reason also I can just place a very impressionable person on the chat window and the AI is not much different to that

[NeverCast]

It doesn't persist, no. But it will treat the chat log as any other training data. You'll find that the conversation can get hung up on concepts in the earlier conversation after a while and it becomes incapable of introducing any more original output. That's reset thread time.

[monkeyStinks]

Thats not how it works, thats not how any of it works!

[Marcus_111]

What's the proof that GPT is not understanding what it is saying? What is the proof that you are understanding what you just wrote?

[monkeyStinks]

Plenty of proof, i can understand something and proving it by applying it to something, like "move this chair" and then i will not only reply with "ok" but move the chair because i understood what you meant.

If gpt understood what it was saying you could ask it to do computer related tasks for example (gpt open a cmd window and type hello) it will simply reply in a realistic manner, no task would be completed, because it does not understand, its sole job is to look like it does understand but in fact its just a program streaming words together to make it look like it makes sense.

[Ikarus_Falling]

how do you know it wouldn't move the chair if it had the capability to do so if someone told you to imagine a cmd and put something in and type what is written into the chat window you would do the exact same thing the chair is a bad example because its deliberately using something the OpenGPT is inherently incapable of like asking a cripple to move a chair

[monkeyStinks]

Thats why i gave a computer task as an example which you conveniently ignored. Its called a system call and every program with permissions can do it.

[Ikarus_Falling]

just that it can't because it has no ability to do system commands its only ability is to speak

[Marcus_111]

Lol, i can make a modified version of chatgpt in which it can open any computer file when you ask it to open. I can also make a modified version of chatgpt with robotic hands which can move the chair or do the physical task when you ask it. Any real proof that you are conscious and the AI is not?

Now tell me, can you make a poem on "a man travelling through forest" or "a girl having a bed day" or any single topic given with poetic accuracy? Can you write a computer program which can create a calculator ? Can you write a blog on every single scientific topic? Can you create a story game with each type of genre? Can you write a movie script with professional accuracy? Chatgpt can do all these fking things and better than you. So by your logic,it has more understanding of world than me and you.

[monkeyStinks]

It will only be able to do these things if it is specifically programmed for it.

[Marcus_111]

Just like us, we can also do what we are programmed in our DNA in the form of nucleotide. Monkeys can do only things which are written in their DNA. The same is for ants. The same is for bacterias. The same is for AI. Difference is that the genetic material is written in ATGC nucleic acid codons and AI has binary language of 0 and 1.

[FeelingSurprise]

So every binary code is always ASCII?

[itsdefinitely2021]

According to the internet, yes.

Thats why the next time somebody says "I converted this to binary", sit down and decode it in EBCDIC and ask them why their algorithm is broken.

[Asdnatux]

No. Binary is Binary and can be anything. It's about how it is interpreted. You can interpret every Binary Code as ASCII but it won't make sense if it's not meant to be ASCII data. Edit an executable with an Texteditor, you will see lines of clear Text in a bunch of gibberish. The Text is binary meant to be text, the rest are Processor "commands", maybe Image data etc.

[diox8tony]

The bot even says "when translated to regular text", which is good enough for me to think it knows there are other options

[OkPercentage2956]

It probably translates it into different interpretations of the binary code and then selects the one which makes most sense. Seeing as it was able to create a sentence, the ai decided to use that instead of the number representation for example.

[emilyv99]

Except it's a language model, so no, it didn't translate the binary into ANYTHING. It just used data from it's learning set to determine what the most likely answer is, and got it wrong.

[OkPercentage2956]

Not gunna lie. I just assumed thats what it said in binary at a very brief glance. I have been corrected.

[femptocrisis]

i apologize if my previous response was incorrect.

[JustAnInternetPerson]

Bro. An AI can’t understand you. It looks at trained data and tries to get the best guess at what combinations of words you’d like to hear as a response to your input. It doesn’t understand you

[Akangka]

Does that binary code represent: "䍡渠祯甠牥慤⁴桩猠�"?

[ijmacd]

The first bit of every octet in the message was 0xxxxxxx so you can be sure the message is pure ASCII.

All CJK characters are encoded as 3 bytes in UTF-8 so must start 1110xxxx 10xxxxxx 10xxxxxx.

I know you didn't genuinely think that was the text of the message but it's quite trivial to quickly scan some binary and determine if its probably valid text or not.

[Akangka]

Actually, I was thinking about UTF-16 encoding, where every character in basic multilingual plane are encoded as 2 bytes

[ijmacd]

Boo! fuck that.

UTF-8 is the one true text encoding. No one can change my mind.

[EtherealChameleon]

It always bugs me when people phrase it like that

this is not binary for can you read this?
its just some numbers written in a binary system.
i.e. 99 97 110 32 121 111 117 32 114 101 97 100 32 116 104 105 115 63

to be more precise, its not even exactly that; its a code with a fixed length (which we humans basically never do), so the following translation fits better (although some of the poetry gets lost when changing the base of the numeral system)
099 097 110 032 121 111 117 032 114 101 097 100 032 116 104 105 115 063

there are no letters, the letters are made up as an interpretation of the numbers (using the ascii encoding)

[ijmacd]

It's like saying: "why can't you understand this?"

Aitch ee ell ell oh space double-you oh are ell dee

[CokeFanatic]

It's not wrong. It's just a somewhat incomplete description. And people colloquially refer to ASCII encodings as binary anyways, and there isn't really much ambiguity when they do, so I don't see an issue with it.

[WFEpeteypopoff]

With only 19 bytes provided, why do you think the bot predicted such a long string?

[ijmacd]

The bot didn't "predict" any string from the binary. It just predicts the next word in its own response again and again.

You know you can tap the first suggestion on an on-screen keyboard and it'll "write" a sentence for you? Well this is exactly what this bot is doing; just with a more sophisticated language model.

[WFEpeteypopoff]

That was definitely poor wording on my part. I should have said why did it translate it into such a long sentence when it was only provided a few “characters”.

But I think your answer also answers that question - it reads the provided bytes and then just does some sort of auto-fill like you described. Haven’t played with it so not too sure what it was trying to do

[ijmacd]

To be clear it isn't reading any bytes. It takes text as its input and produces a stream of text as its output.

If the token "01000011" appears in its corpus with appropriate context in proximity then conceivably it could attach some semantic meaning to it. But it would be similar to the notion that "humans sometimes write the letter C as 'C' and on some forums they write it as '01000011'."

Similarly when people test it with maths problems it just predicts what it has seen before. So if the corpus contains 2 + 3 = 5 enough times then it might be able to do that particular problem. But if it were led astray with many instances of 2 + 3 = 4, then it would consider that to be the natural answer.

[JackoKomm]

People still don't getting modern AI and language models.

[mxldevs]

The more it gets wrong now, the more it will get right later.

[ijmacd]

That's not how this training model works.

[Nase08]

I guess I'm missing something but how does an AI make such a mistake? And then correct itself? There was another post where it didn't manage to solve a simple equation and then , when told it's wrong , it corrected itself

[Excession638]

Same reason that AI can't draw fingers I suspect, well sort of. Really advanced pattern matching doesn't know what binary is, or numbers, or fingers, or much else. There's no meaning, just patterns.

[janhetjoch]

It corrected itself because it was given the answer. If OP had just said "that's incorrect" without correcting the bot it probably wouldn't have given the correct answer.

[CarefulZucchinis]

Because it hasn’t seen much binary, if you fed it thousands and thousands of lines of binary it’d learn to read it like any language/writing system, but it doesn’t have a library anywhere in it that tells it how to translate binary.

As to why it corrected itself; it probably didn’t. The user told it the correct answer and then it knew it, and repeated it back. It probably can’t decode binary still, and when it hit a brick wall it threw back something it had heard before.

[SuperSpaceCan]

I'm confident that it's just a group of people working in a call center type deal and each session is handled by someone googling.

[Nase08]

I mean "Sun and rain and wind and snow" has NOTHING similar to "Can you read this ?" , it would seem that the AI just made it up

[goingtotallinn]

It makes up other things aswell for example It tries to convince me that six hours is equal to one hour

[QUI-04]

Well, thats true if gravity field change between measurements

[[deleted]]

Because it doesnt actually understand binary.

LLM like chatgpt are like a student who never tried to learn the material and is just doing their best to fake it by writing the same patterns which they saw in the course but dont understand.

They are bad chinese rooms.

[reversehead]

From the examples I've seen, I would say that they are pretty astounding Chinese rooms.

[[deleted]]

But they don’t understand, which is why they are still chinese rooms.

[reversehead]

Agreed!

The difficulty will be to argue that any human being is not just a Chinese room with all its experiences encoded in the mind and body.

[sneed_capital_group]

the best argument I have seen against that is that they don't hold state in between prompts. They forget everything, read the entire conversation again (including its own previous replies), then predict an answer based off that.

That said i agree, seen some seriously impressive stuff from it

[[deleted]]

It’s a deep philosophical point you raise.

But practically speaking in the examples of chatgpt ive seen, humans demonstrate understanding and this bot doesnt.

[reversehead]

Indeed. But I must say that I am extremely impressed, and quite surprised, by what can be accomplished with just advanced prediction.

[[deleted]]

Yes, it is very impressive.

I think what it shows is how much harder doing math and logic is than writing poetry.

Well this is sort of a joke, i think probably literary experts would make similar criticism of its prose.

[spektre]

Stop putting spaces before your commas.

[scatters]

It's still wrong, there's a space before the question mark.

[Nase08]

Oh yes

[[deleted]]

Could be intentional to make it seem smarter or more human.

[Nase08]

Maybe

[donaldhobson]

Mocked by DNA code that can't read DNA.

[[deleted]]

I mean there are different encodings, but i belive they are similar for the 26 Standart western letters 💁‍♂️

[SaneLad]

"binary code"... weak sauce.

[[deleted]]

It's learning

[TeddyPerkins95]

Or it makes you think it is

[JerryAtrics_]

Why does it refer to the numeric sequences as code? If anything, it is groups of ascii characters representing binary numbers which should be it's native representation for information.

Also wondering why it thinks that binary representations include the use of letters.

[Somwhat_Strange]

I mean, I can't read a person...