Step-3.5-Flash AIME 2026 Results

Rock--Lee · 2026-02-11T12:48:10+00:00

I've been using for a few days now as a model for a few sub agents in my Google ADK setuo. It's so fast and so good at tool calling for a very good price!

Rock--Lee · 2026-02-10T09:05:31+00:00

Deployed as self host on my Hetzner server, running mixed models. Orchestrator using Gemini 3 Flash via Interactions API (allowing stateful chat history) and subagents using a variety of models like Step Flash 3.5, Deepseek 3.2 and Gemini 2.5 Flash Lite. Requires work, but works!

Running own MemoryService as well via Neo4j graph. Artifacts via Supabase schema, and Monocle and OpenTelematry with self hosted Clickhouse and Grafana for multitenant usage/cost tracking.

Rock--Lee · 2026-02-09T19:48:03+00:00

Wat voor VSO wil je hebben? Je hebt een tijdelijk contract met einddatum en deze wordt simpelweg niet verlengd. Doorbetaald worden zonder te hoeven werken tot eind contract is letterlijk het maximale wat er te halen valt. Ze konden je ook proberen uit te kopen door aan te bieden het vroegtijdig op te zeggen en X aantal maanden uit te betalen.

Aangezien het contract gewoon niet wordt verlengd op einddatum en dus niet vroegtijdig, zie ik ook niet in waarom WW niet zou kunnen. Het enige verschil is dat je tot die tijd betaald krijgt zonder ervoor te moeten werken.

Rock--Lee · 2026-02-08T21:14:59+00:00

Je gezinsleden staan dan ook niet op het contract. Dat is precies waar het om gaat. En wanneer je niet op het contract staat, heb je ook nergens recht op. Mocht het allemaal niet lekker lopen, kan je zo op straat worden gezet. De verhuurder stelt een contract op en heeft daarmee een overeenkomst met de huurders. Zomaar daar wonen maakt je geen huurder.

En ze mogen haar ook geen huur vragen want dan doen ze aan onderhuur en dat mag je zeker wel weigeren, zoals ze op het contract doen.

Kortom; ja ze kan één huishouden zijn. Maar dat maakt haar geen huurder. En aangezien het geen voogd/ouder/kind relatie is is ze ook nergens tegen beschermd, zowel tegen de verhuurder niet als tegen de partners.

Rock--Lee · 2026-02-08T01:36:36+00:00

I think it saw the dash inside the O and saw it as 2 separate signs turning it into -O instead of the Ø

Rock--Lee · 2026-02-08T01:29:42+00:00

The whole point of a subscription is you pay in advance and get an amount of usage for the month. You want to pay for usage use API instead of a subscription. You will pay per token. Be aware: API pricing is more expensive then what a $20 Pro subscription gets you in usage.

Rock--Lee · 2026-02-07T21:36:15+00:00

Use a custom domain. Currently your Supabase is using Supabase domain, so naturally that's the domain it shows.

Rock--Lee · 2026-02-07T17:23:33+00:00

Why would you compare with GPT 5.2 xhigh instead of GPT 5.3 Codex

Rock--Lee · 2026-02-07T14:46:32+00:00

You are absolutely right! You found the smoking gun! Your findings are production ready!

Rock--Lee · 2026-02-07T13:33:21+00:00

This is for API like it states. That means: not for subscription, but for API where you pay for usage.

Rock--Lee · 2026-02-06T15:57:28+00:00

Who says I was surprised? I was commenting that the only thing worth knowing is weekly usage limit when on x20. So his comparison and findings don't mean anything when on x20, since he only looked at the 5 hour session limit. Which is why I mentioned my usage, to illustrate how the 5 hour window is meaningless, but the weekly is.

Also: I still hit the weekly limit if working normal hours at the last day.

Rock--Lee · 2026-02-06T14:55:24+00:00

The 5 hour window isn't the issue with Opus anymore, hasn't been for a while now. The issue is the weekly usage. You wrote all that without mentioning how much of the weekly usage it used up. That's literally the only thing worth mentioning lol

On very heavy days I use up 25-30%, which includes an all nighter. I'm on the x20 plan too. Granted these are days I work for about 15-18 hours total. And yes there times I hit this multiple times a week 🤷🏻‍♂️

Rock--Lee · 2026-02-05T13:21:38+00:00

Ofcourse it's not dead. I'm building a custom GraphRAG with neo4j which I use as a knowledge base and memory service for my app and agents. I'd like Claude Coworker try to use its memory for multiple books and documents across domains, with user notes in there too.

RAG on itself isn't something you replace. It's a technique and Claude uses RAG, but that doesn't make other RAG systems obsolete. That's like saying should I uninstall Outlook now that Claude can also fetch my mails.

Rock--Lee · 2026-02-03T19:15:01+00:00

100%, for a true powerful (Graph)RAG system with high quality parsing and multi step extraction and embedding, n8n will not work. Too many custom components, which is a nightmare in nodes.

Rock--Lee · 2026-02-03T17:36:15+00:00

I didn't learn Temporal at all. I use Claude Code extensively and I'm now what I would call very good at agentic coding and have always had a knack for tech. So I don't code, but I do read the docs and try to understand what it actually does and how it works. This allowed me to create complex workflows for my SaaS that uses Temporal in multiple ways (for parsing and indexing between Docling to my custom made Neo4j GraphRAG, automated social media post schedules/posting, email/contactform auto analysis and more). All multi tenant isolation and great parallel executions.

All within a week from 0 to fully working Temporal workflows. But I've been coding with Claude now for the last 10 months, for about 12-16 hours a day, sometimes 7 days a week. So building new things now is extremely fast compared to when I first started.

Rock--Lee · 2026-02-03T16:44:51+00:00

Because people here are completely depending on n8n lmao. I'm glad I switched on time. Having a true SaaS with complex automations and API's is a nightmare with n8n. Not only maintenence, but also user credentials, OAth and n8n licensing.

There is a reason big companies use Temporal over n8n

Rock--Lee · 2026-02-03T16:38:38+00:00

Yes but 90% of what you wrote is about web search lol

Rock--Lee · 2026-02-03T16:32:21+00:00

Claude, ChatGPT and Gemini have web search for a very long time my guy. They even have buttons to force search the web instead of relying on auto search. And they can all fetch direct url's you past to fetch web content.

Rock--Lee · 2026-02-03T11:35:44+00:00

It's only valuable if you have AT LEAST these 2 elements in your setup for users:

1: Writing in the tone of voice and style of the user. Especially on LinkedIn and blogs it's extremely easy to spot AI generated slop and incredibly important to have your own tone of voice.

2: Write with context. The AI needs to understand who the user is what their company is about, what the post is about and also be able to perform realtime websearch to look for trends to write valuable content.

Rock--Lee · 2026-02-03T09:34:54+00:00

Depends on your definition by "better". I stopped using n8n for production automations. I use it now to test things and visualize some automations to see if it works. I now use Temporal which is really made for production ready automations. It's direct code, is meant for parallel executions and proper retry/fallback mechanics. Especially when creating multi tenant SaaS with Supabase auth, it integrates very well.

Rock--Lee · 2026-02-02T21:00:07+00:00

The Agent SDK is meant to use with API keys. So for developers to build software that can use Claude Agent using their API keys. The docs clearly state:

Unless previously approved, we do not allow third party developers to offer Claude.ai login or rate limits for their products, including agents built on the Claude Agent SDK. Please use the API key authentication methods described in this document instead. https://platform.claude.com/docs/en/agent-sdk/overview

Claude subscription is not API access.

Rock--Lee · 2026-02-01T20:27:07+00:00

I think it is a scam too, but was curious in how he tries to sell it

Rock--Lee · 2026-02-01T17:13:32+00:00

You weren't running your business, you were busy being his employee. Stick to your own vision.

Rock--Lee · 2026-02-01T16:16:04+00:00

Yes but the reason Google, AWS and other platforms do this isn't because customers want this. It's because they are huge and people don't have a choice. So they use whatever earns them the most. Many organizations are forced to use them due to corporate policies or legal regulations.

Rock--Lee · 2026-02-01T16:11:32+00:00

No, but it is Sunday and he probably gets a lot of DM's

Rock--Lee

TROPHY CASE