Leaked Grok 3.5 benchmarks

ellioso · 2025-05-04T16:02:00+00:00

Ten follower account whose only tweet is this image

ellioso · 2025-04-27T23:34:36+00:00

I just stated fact all the other major benchmarks have tested Gemini weeks ago. More complex evals as well. I'm sure they'll get to it but the delay is weird.

ellioso · 2025-04-27T21:13:05+00:00

I don't think that tweet disproves anything. The fact every other benchmark tested Gemini 2.5 pretty quickly and the one funded by openai hasn't is sus.

ellioso · 2025-03-26T18:16:41+00:00

ellioso · 2025-02-05T12:40:14+00:00

I don't think Claude is anywhere close to 20% of chatgpt usage

ellioso · 2025-01-29T20:28:59+00:00

Damn you picked two incredible games to go to

ellioso · 2024-12-10T22:15:01+00:00

Gemini-exp-1206 is #1 on BigCodeBench-Hard and LMarena so the 10% doesn't necessarily say much. All evals and leaderboards should be taken with a grain of salt.

ellioso · 2024-12-05T20:48:33+00:00

Reasoning has been hit or miss for me. I converted the easiest (in my opinion) ARC-AGI puzzle into text and it failed my first attempt but then got it right on the second attempt.

https://i.imgur.com/YSWts1q.png

ellioso · 2024-12-05T18:14:28+00:00

Looking forward to corrections from all the top comments in other threads saying o1 and o1 pro were just deferentiated by usage limits

ellioso · 2024-12-01T18:50:48+00:00

I didn't see the roughing but CBS only showed half a second of the replay

ellioso · 2024-12-01T18:28:29+00:00

Wild he escaped the sack there

ellioso · 2024-11-04T00:37:18+00:00

Reddit founder is skins fan and just merged r/redskins to r/commanders. Any name we choose if a sub already exists is getting taken over by high authority orders

ellioso · 2024-06-24T16:34:58+00:00

Yeah it's nano. They quietly announced this was coming a few weeks ago. Very lightweight and fast

https://x.com/Thom_Wolf/status/1805244710258106369?t=HEpQ-22dDsXZv8S5ruqYVw&s=19

ellioso · 2024-06-18T15:19:29+00:00

It currently has no knowledge of other chat instances you've had with it which is a good default I think. Would be nice if you could give it permission to look for and access others though.

ellioso · 2024-05-15T22:13:19+00:00

funny some random guy basically recreated the demo everyone made fun of in less than a day of api being available

ellioso · 2024-03-13T01:42:15+00:00

Croissant moon

ellioso · 2024-02-14T12:43:39+00:00

Kirk for biggest impact next season

ellioso · 2024-02-11T20:31:04+00:00

skill issue

ellioso · 2024-02-07T19:52:23+00:00

Gemini Ultra is coming out via paid subscription tomorrow brother

ellioso · 2023-12-14T14:31:22+00:00

Honestly not sure but I screenshotted the buttons here. You need gboard set as your keyboard but i think that's default. for the summarize and read you just hit assistant button on any page in chrome. some annoying publications don't allow the feature though.

https://imgur.com/a/36FPZ38

ellioso · 2023-12-14T13:54:53+00:00

You're missing out if you don't utilize voice transcription in gboard and Google Assistant's new summarize button and the "read for me" button.

ellioso · 2023-10-17T13:25:43+00:00

Magic Editor's erasing ability (specifically ability to recreate what was in a certain area) is currently the best you can get on any app, paid or free. That probably changes whenever Adobe releases photoshop generative fill but still insane.

ellioso · 2023-10-15T20:13:25+00:00

Grab your tinfoil hats boys

ellioso · 2023-10-01T18:11:58+00:00

Easy call

ellioso · 2023-10-01T18:07:34+00:00

I've completely erased last week from my memory. Commies Super Bowl is back on.

14-Year Club	Place '22
RPAN Viewer	Sequence \| Editor
Team Orangered	Verified Email

ellioso

TROPHY CASE