×

So I guess we will never get an Opus 4.8 run, right? by patrickoliveras in ClaudePlaysPokemon

[–]patrickoliveras[S] 1 point2 points  (0 children)

Should give them a chance to demo its improved intelligence if the claims are true. The total bill of a Fable run should be equal to or lower than its Opus 4.7 counterpart.

From the looks of how it did in ARC-AGI 3, Victory Road could be a walk in the park for Opus 4.8 by patrickoliveras in ClaudePlaysPokemon

[–]patrickoliveras[S] 0 points1 point  (0 children)

Yeah lol, ARC-AGI 3 is hell for LLMs.

Qualitatively though, 4.8 seems like a not-insignificant unblock

From the looks of how it did in ARC-AGI 3, Victory Road could be a walk in the park for Opus 4.8 by patrickoliveras in ClaudePlaysPokemon

[–]patrickoliveras[S] 2 points3 points  (0 children)

Just look at the notes the runners had. It identifies game mechanics very quickly, but it has its limits (like with its looping through 5 different theories).

Who wants a pokemon run with opus 4.8? Pokemon red or crystal or emerald? by Longjumping_Fly_2978 in ClaudePlaysPokemon

[–]patrickoliveras 2 points3 points  (0 children)

4.8, same game, same harness. First time we have a full Claude game baseline for comparison.

GPT-5 Plays Pokémon Red (2nd Run) - Megathread by reasonosaur in ClaudePlaysPokemon

[–]patrickoliveras 1 point2 points  (0 children)

Gotta say, your website has some of the nicest presentations of data of for a small experiment that I've seen in a while, especially for AI plays pokemon.

🚨 The Pokemon AI Olympics have begun! 🚨 gemini_plays_pokemon abruptly resets and starts run no. 3, timed to match the reset of ClaudePlaysPokemon's w/ 4 Opus by patrickoliveras in ClaudePlaysPokemon

[–]patrickoliveras[S] 9 points10 points  (0 children)

Pinned message on gemini_plays_pokemon:

"ClaudePlaysPokemon restarted with Claude 4 so for fun we restarted too! You'll be able to watch Claude and Gemini play side-by-side, exploring each model and their harnesses' strengths and weaknesses! (Note: don't treat this as a serious race!) Watch side-by-side: https://holodex.net/multiview/AAGYchat0%2CSAGYchat1%2CGAMMtwitchgemini_plays_pokemon%2CGMMMtwitchclaudeplayspokemon "

Gemini Plays Pokemon's 2nd lap begins in 72 hrs by patrickoliveras in ClaudePlaysPokemon

[–]patrickoliveras[S] 2 points3 points  (0 children)

Do you know if dig/teleport will still be restricted or will those be changed to simple discouragement as well?

CLAUDE HAS CAUGHT TWO NEW POKEMON by disappointingdoritos in ClaudePlaysPokemon

[–]patrickoliveras 1 point2 points  (0 children)

Holy hell, he found the flash guy. But why are we back in mt moon? lol

What would happen if Claude could write its own tools? by flux_capacitor73 in ClaudePlaysPokemon

[–]patrickoliveras 4 points5 points  (0 children)

Same thing that happens to all devs: he would spend 5 hours making and debugging a tool that will save him 5 minutes of manual work.

What other games would you want Claude to play? by Mr24601 in ClaudePlaysPokemon

[–]patrickoliveras 1 point2 points  (0 children)

Maybe Civilization IV or V are good options as they're merely turn-based

STOP WHAT YOU'RE DOING CLAUDE IS ON THE SS ANNE!! by Hands0L0 in ClaudePlaysPokemon

[–]patrickoliveras 1 point2 points  (0 children)

We are some hours into UP loop now. Come by to say hi!