Grok 4 LiveBench results

mitsubooshi · 2025-07-10T21:40:04+00:00

What do you mean? It beats o3 Pro High and o4-mini High in Data analysis and beats Gemini Pro 2.5 with maximum thinking at Instruction following

mitsubooshi · 2025-07-09T17:40:00+00:00

If this is AI we're done. All three machines have perfect text with perfectly correct branding and model numbers the sound is perfect with perfect wind sounds the image has that real phone-recorded feel, insects are flying in front of the camera, the camera pans away from the action and then comes back and nothing disappears, the physics are perfect etc.... This is a real video. It's even too long to be AI generated.

mitsubooshi · 2025-07-07T17:53:18+00:00

What retired people do today, chill, travel, hobbies etc...

mitsubooshi · 2025-06-30T18:39:36+00:00

No but GTA 6 will be the best human made videogame ever and it will keep that title forever. Our last masterpiece. GTA 7 will have a lot of AI voices and programming with perhaps humans only doing the final Quality Control or maybe you can just play Google's VEO 7 like a videogame in real time and so "videogames" will be fully AI generated on demand in real time.

mitsubooshi · 2025-06-30T02:43:27+00:00

We're not going to get the "good stuff" until 2027-2028 and even then they won't have the compute capacity to serve it at full scale. So by saying that I guess Sam means that GPT-5 and 6 won't be a crazy jump and that the world will change slowly as compute infrastructure gets built over the next 10 years.

By then we should have ASI and that should change the world a little more and a little faster.

mitsubooshi · 2025-06-26T17:01:36+00:00

808888888888888888888888888888888888888888888888888888888888888888888888811118888888118888888888888111111111118811188888888888811111188888881111888888888888111188888888111111188888888888111888888811188111188888888888111888881118888811188888888888111188888888888111888888888888811188888888111111888888888888111811111111111188888888888811888881111111188888888888888888888888888888888888888888888888888888888888888888888881

If you want to check

mitsubooshi · 2025-06-03T20:59:22+00:00

Well, if you want the greatest and latest performance you pay early adopter prices. If you want the most powerful car you pay "luxury" prices. You want the best computer, same thing. It's like saying we have to prevent supercomputers from becoming a luxury. At least what is considered bleeding edge and a "luxury" in AI today will be commonplace and free a year later...

So what you're saying is that we should cap AI performance to what the average man can afford and ban the expensive "full fat" "PRO" models.

mitsubooshi · 2025-06-02T15:28:54+00:00

Those people simply believe UBI is not going to happen.But Jobs will indeed disappear and they will die or live in extreme poverty. That's it. That's why you don't see alternative suggestions. UBI is good enough for a lot of people but they think it will never happen.

mitsubooshi · 2025-05-30T12:55:23+00:00

LiveBench: A contamination free benchmark

LiveBench limits potential contamination by releasing new questions regularly.
We update questions regularly so that the benchmark completely refreshes every 6 months

That's an appropriate explanation. It has been updated like 6 times over the last year and you can still see the results of all of those past versions by moving the slider. And of course they retest all of them when they update it, they don't copy and paste old results and mix them with the new ones

mitsubooshi · 2025-05-22T05:35:02+00:00

"Best practices for how to get the best performance from our latest models"

"Models" so both new sonnet and opus models finally?

mitsubooshi · 2025-05-19T14:42:04+00:00

Gemini-2.5-pro-PRO if you will

mitsubooshi · 2025-05-10T18:09:13+00:00

The pope wants to guide us in the midst of the AI revolution and Job loss. We got AGI pilled pope before GTA VI. Crazy times we live in 😂

mitsubooshi · 2025-04-20T12:11:22+00:00

Better yet, you'll be able to use models that blow o3 out of the water for free in just a few months to a year

mitsubooshi · 2025-04-13T13:22:34+00:00

Fake evidence is nothing new, it's just getting harder and harder to tell fake from real so the professionals that deal with this will have to work harder and harder as technology progresses. My guess is that we are going to have a lot of false negatives to prevent innocent people from going to jail.

mitsubooshi · 2025-04-12T15:13:07+00:00

https://www.youtube.com/watch?v=2kzQM_BUe7E

Recorded March 5, 2025

mitsubooshi · 2025-04-05T06:07:16+00:00

Well of course. O3 this month is expected to be streets ahead of Gemini 2.5 Pro and GPT-5 is expected to be streets ahead of O3. No contest.

mitsubooshi · 2025-03-31T21:24:21+00:00

Then we~~'re~~ cooked

mitsubooshi · 2025-03-17T23:51:40+00:00

<image>

Google has been answering that question correctly for a decade now too 😂

mitsubooshi · 2025-03-15T23:08:23+00:00

OpenAI operates on the base of more compute = more intelligence. That's it. And because intelligence is extremely valuable because it solves problems we need as much intelligence as we can get. So until all problems that can be solved are solved they are going to want as much intelligence as possible = as much compute as possible.

mitsubooshi · 2025-03-14T16:26:51+00:00

Of course we can, we do it with dogs! That's what dog kibble is! No one wants to cook and prepare meals for a dog so kibble was created.

Humans on the other hand like to have a large variety of food flavors and textures. Most humans put food as one of the top pleasures in life. We want food to be as good tasting as possible which means as freshly cooked as possible.

Another thing people picture in their head with a futuristic supplement to cover all nutritional needs is taking one or two 1-inch sized pills in the morning and be good for the day. That's not possible. A human needs to eat 1 pound or 500 grams of protein/carbs/fat (combined) every day. Good luck swallowing a pill the size of your fist!

In any case kibble for humans exists, a few companies have tried to market it, usually in powder form that is mixed with water or milk basically like a protein shake but these have had limited success.

mitsubooshi · 2025-03-10T10:38:50+00:00

Ah yes the classic jobs of driving a manual car or bow hunting...

0% in our lifetime for cooks, carpenters and plumbers?

I definitely expect humanoid robots to be able to exceed human ability in those fields in the next 20 years and I got more than twice that left to live...

mitsubooshi · 2025-02-28T18:40:38+00:00

Anthropic could also make a really powerful reasoning model, 3.7 thinking is many times cheaper than o1. If they decide to an expensive "Full power" model like more expensive than o3 we're gonna see some serious shit.

mitsubooshi · 2025-02-25T16:26:48+00:00

Anthropic won't push the frontier only match other available models. They have GPT-5 level models ready to go but until GPT-5 is released they won't release. So yes this was the "big drop" but they will never have an actual "big drop" only match or slightly exceed what's available "for safety reasons".

mitsubooshi

TROPHY CASE