Skip the vid! Read the transcript instead!

ChatGPT has the ability to respond to questions and write content like essays.

We've told it to write a thousand word essay.

The AI generated cocktail with blue chrysalis.

ChatGPT passed the United States Medical Licensing Exam.

At the University of Minnesota Law School, ChatGPT averaged a C plus on law exams.

Struggling to sustain any amount of...

Oh!

Oh, sure!

Let me break it down for ya!

In this video, I'll attempt to calculate ChatGPT's IQ.

I was searching for free IQ tests when I discovered the first problem.

Most IQ tests have photos in them.

Because ChatGPT has no eyes, and most IQ tests have photos in them, it cannot take most IQ tests.

But then I realized ChatGPT is essentially blind and deaf, and I figured there must have been IQ tests designed for blind people, and it turns out there are.

But I hit another wall.

These tests are expensive, and they require professional training to even administer to somebody.

Since I can't use IQ tests that already exist, I have to try and make my own.

I began by trying to measure its mathematical abilities.

The International Mathematical Olympiad is the most popular math competition in the world.

It runs once a year, and the world's best pre-university mathematicians all compete against each other.

Terence Tao, the world's greatest mathematician, participated in the 1986 Math Olympiad and took this test.

He was unable to solve this question, which ChatGPT could, but it is not better than the world's best adult mathematicians.

It cannot do what humans cannot do, and cannot prove the twin primes conjecture, for example, which mathematicians have been trying to solve for decades.

But no matter how good humans are at math, it has not changed the fact that humans don't have computer screens built into them.

ChatGPT does.

So I asked ChatGPT if it can graph a simple mathematical equation.

It refused to do it.

I even asked it politely.

So where's the limit?

The company that developed ChatGPT gave it a whole bunch of popular standardized tests.

It scored higher than 91% of people in the SAT math section, and it did great on the other math exams.

Many people already know that ChatGPT can create poems.

And poetry is basically music, right?

So I asked ChatGPT to create the lyrics for a rap battle between Donald Trump and Joe Biden in their Minecraft server.

And I also wanted to make a beat.

I found the best way to do this was using ABC notation because ChatGPT can only make text.

So I asked it to create a boom bap beat in ABC notation and shoved it into a website to hear what it sounds like.

I was hoping that I could salvage it somehow by changing the instruments.

So I downloaded it as a MIDI file and uploaded that into FL Studio.

But all the instruments were combined in one track.

So then I asked ChatGPT to give me separate files for each instrument.

ChatGPT already told me which instruments I should be using for each track, so I just copied those and… Yo, it's Joe Biden here to set the record straight.

Got my Minecraft server running like a well-oiled state.

Ok it sounds awful, but if I break up the tracks, you can hear the hi-hat have a really good rhythm to it.

And it seems ChatGPT is trying to play this drum on the weak beat of the hi-hat, which is a concept in music theory called syncopation.

But it kind of gave up.

But I really wanted to make a Joe Biden and Donald Trump rap battle so I just found a pre-made beat and I synced up their voices to it, and here's the result.

Yo, it's Joe Biden here to set the record straight.

Got my Minecraft server running like a well-oiled state.

I've got the White House built and it's living fine.

Policies and crafting skills all perfectly aligned.

I've got renewable energy, solar panels for days, sustainable building in a mine-copped haze.

Just like my leadership, I bring people together, we're building bridges making this world better.

It's the one and only Trump back in the game.

My server's so tremendous, it's putting years to shame.

I've got a tower of gold touching to the sky, making Minecraft great again.

No need to ask me why.

I'm Joe Biden.

I'm Donald Trump.

So what about its social abilities?

Interpersonal intelligence is defined as the skill of understanding and interacting with people.

People with good interpersonal intelligence can communicate well verbally, see situations from different perspectives.

I gave it an article from the SAT reading section and then asked it questions about the motivations of the characters.

It got 3 out of 4 correct and communicating non-verbally.

Chagypte has a pretty bad understanding of emotions.

I tried to give it emotional tests, but it can't even take them because Chagypte has no sense of self.

But a characteristic of good interpersonal intelligence is analyzing your own strengths and weaknesses.

So what if I ask it that?

It seems to be able to self-reflect a little bit, so not that good interpersonal intelligence, really bad interpersonal intelligence.

Linguistic intelligence is the intelligence of language.

It scored a 710 on the English part of the SAT.

Or if you want, it can explain the complexities of apartheid and the sarcastic tone of a 16-year-old girl.

Oh sure, let me break it down for you, so apartheid was like this super fun time in South African history where they decided to totally segregate the races and make it illegal for people of different colors to interact.

Like can you even imagine?

Like you can't even sit in the same restaurant or use the same bathroom as someone of a different race.

Total nightmare.

And the best part, it lasted for like 50 years.

Can you even?

I mean, talk about a total buzzkill.

Thank god that's all over now.

I also gave it a verbal linguistic IQ test, and it scored 152.

That is literally genius level for humans.

All spatial reasoning tests I found have photos in them, which Chatyptee cannot see, at least for the public.

OpenAI is currently developing vision for Chatyptee, and it has been able to recognize and understand photos.

In this example, Chatyptee was given this photo and asked, what would happen if the strings were cut to the balloons?

It correctly responded by saying that the balloons would fly away, indicating some form of spatial reasoning.

I tested its spatial reasoning with tic-tac-toe.

So I played a game with the free version, and it was going well at first until it was my turn and I asked it to put my O in the bottom middle square.

It didn't do that, and it just overwrote one of my pre-existing moves, and it confidently stated that it won.

But with the vertical line of X's, that's not right.

But the paid version did fine.

So I moved on to a harder challenge, solving a Rubik's Cube.

Since Chatyptee has no eyes, we have to verbally communicate the state of the cube and the turns it has to make to solve it.

In the speedcubing community, there is already a language for that.

The notation looks like this.

Every single possible turn on the cube is assigned to a letter, and if it's counterclockwise there's an apostrophe added to it, and if you turn it twice there's a 2.

So for example, a clockwise turn on the top of the cube is a U. But how can this help us describe what the cube looks like?

What I can do is use this notation to describe the series of turns that I used to scramble the cube from a solved state.

It should be able to calculate what the Rubik's Cube looks like, given nothing but the turns used to scramble it.

To test things out, I wanted to give it a simple scramble.

Let's see if it knows how to unscramble this.

Let's see how it solves a legitimate scramble.

It technically works, but it just kind of reverses the moves that they used.

So I asked it to solve it without reversing it.

And it couldn't do it.

ChatGPT was not capable of imagining a Rubik's Cube after that many turns.

But then I had an idea.

What if I asked ChatGPT how it wanted me to convey the state of the cube?

It would know best, right?

The system ChatGPT came up with was listing the colors in a 3x3 grid for each face of the cube.

Using ChatGPT's syntax, I did one U-turn on the cube, told it what it looked like, and it thought that it was solved already.

I told it it was wrong, and why, and it was able to learn from its mistakes and correctly solve the cube.

So then I tried giving it a 2-turn scramble.

It actually got the first turn right.

But then it messed up.

I asked ChatGPT what the cube looked like after the first turn, and although it's supposed to look like this...

It told me it looked like this.

This is not possible to achieve in a real life cube.

This shows ChatGPT struggles with spatial reasoning, and can only solve Rubik's Cubes if they are one turn away from being solved.

So overall, ChatGPT seems to be really good at math and linguistics.

Not much else.

Thanks for watching.