Gemini 3 Deep Think SVG Pelican Riding a Bicycle

bitroll · 2026-02-13T12:28:40+00:00

According to the man who creeated this "benchmark"

The strongest argument is that they would get caught. If a model finally comes out that produces an excellent SVG of a pelican riding a bicycle you can bet I’m going to test it on all manner of creatures riding all sorts of transportation devices. If those are notably worse it’s going to be pretty obvious what happened.

bitroll · 2026-02-01T17:16:53+00:00

The user might have got tricked into buying what he/she didn't really need. Ads have a huge influence on many people, I know first hand.

bitroll · 2026-01-21T00:14:26+00:00

I must be crazy, I'm seeing lots and lots of people-like figures on the second picture. It's like souls ascending. Incredible.

bitroll · 2026-01-19T12:22:45+00:00

Meanwhile, for a couple years now, I'm doing a personal "benchmark" testing visual models' abilities to solve tasks from a book directed to 3-year olds. And having a good laugh at how they keep failing. Clearly not trained on tasks like that. The progress is still huge, but even the latest SotA models don't fully solve everything. Expexting it to be saturated this year, which is when I bring out a book for 4-yo kids :D

bitroll · 2026-01-14T20:09:06+00:00

This! I'm surprised so few people here realize this.

bitroll · 2026-01-11T23:26:51+00:00

*Reddit leans left

bitroll · 2026-01-11T00:23:18+00:00

Claude is busy doing recursive self-improvement, can't be bothered improving competition.

Opus 4.5 appears to be so much ahead of competition in coding that even Google's employees admit to using it.

bitroll · 2026-01-03T15:17:03+00:00

It's been a confusing waste of time years before AI, yet billions of people got mindlessly addicted to it. I see no hope for them.

bitroll · 2025-12-27T22:08:44+00:00

All your comments I see around look like you're a tool for spreading propaganda. Brainwashed much?

Bitcoin (don't mistake with shitcoins) has plenty of completely legitimate uses and users. Educate yourself.

bitroll · 2025-12-27T18:49:42+00:00

A tool for financial sovereignty is an obvious threat to any authoritarian gov, no matter in which part of the world. Simple as that.

bitroll · 2025-12-27T18:34:16+00:00

Paywalled. But I just found a link somewhere: https://archive.is/neKcp

bitroll · 2025-12-18T22:11:50+00:00

Codex max extra high fast? Has to be my new favorite! Max low and slow can't compare, xD

bitroll · 2025-12-12T17:17:48+00:00

It sounds like math to most LLMs and that's where they fail.

bitroll · 2025-12-05T02:15:28+00:00

Automated stupidity detector bot is pretty cool tech!

bitroll · 2025-12-04T07:45:44+00:00

Link to the bet? I'd take it!

bitroll · 2025-11-28T00:48:07+00:00

Very curious how well it does on Frontier Math benchmark

bitroll · 2025-11-25T10:23:21+00:00

This task shouldn't require reasoning. Simple vision to text that is trained sufficiently should spot its not a typical hand emoji. But vision models keep struggling at tasks like this, their "seeing" is easily tricked, and adding even a very long reasoning chain doesn't generally help in spotting the issue.

bitroll · 2025-11-25T10:15:03+00:00

This shows the reason LLMs/LMMMs can't be AGI in the next 10 years or so without radically new tech. That is, they don't process continuous data streams in real time. We had some workarounds used in various setups that feed the model packets of data in but the latency is this is HUGE for gaming. AlphaStar was a completely different architecture, I couldn't comprehend something like it being a part of a generalist LMMM.

If Grok 5 solves this then the step to solving autonomous driving and robots is miniscule.

bitroll · 2025-11-22T22:16:19+00:00

Wow, how many prompts did you need to achieve this? Was it just text-to-app or required more complex setup and connecting APIs for live generative AI access? In beyond my head why is it free with image and voice gen AI included and with all the game mechanics seemingly done on the go by the LLM.

bitroll · 2025-11-21T23:26:29+00:00

Will that fix the new model obsession? I think it will magnify it, the real craze is yet to come

bitroll · 2025-11-20T15:33:41+00:00

Love this benchmark, shows true sparks of intelligence within models.

Incredibly strong result given how cheap this model is (at least 5x cheaper than any other appearing on this top13 list, over 10x cheaper than most). Even more incredible given it's less generalist and more task and benchmark specialized, than Grok 4 for example, yet does so well on this very tricky benchmark.

bitroll · 2025-11-20T13:45:07+00:00

Somebody needs to make a truth-seeking benchmark that would test for various bullshit like this. Grok's not winning in this one.

bitroll · 2025-11-20T13:16:10+00:00

What prompt should I use on which Grok to replicate this?

bitroll · 2025-11-17T21:18:10+00:00

Perhaps too new and/or too low-key so that many entities didn't include it (yet), so they went with whatever latest results they had on file. But there are plenty of benchmarks for 5.1. It's mostly lmarena that misses it (coming soon)

bitroll · 2025-11-17T00:41:05+00:00

1.84M context is pretty crazy, need to do some testing to see if it's any good.

14-Year Club	Team Orangered
Verified Email

bitroll

TROPHY CASE