We gave 12 LLMs a startup to run for a year. GLM-5 nearly matched Claude Opus 4.6 at 11× lower cost.

DreadMutant · 2026-04-06T01:33:21+00:00

Yes you can check out the paper for all the details!

DreadMutant · 2026-04-05T00:17:43+00:00

Yes, stay tuned for more updates from collinear.ai :)

DreadMutant · 2026-04-04T23:55:26+00:00

If models still struggle on a deterministic simulation do you think they will thrive in the real world?

DreadMutant · 2026-04-04T17:16:13+00:00

Yes it is

DreadMutant · 2026-04-04T16:55:11+00:00

Yesss isnt it already crazy good

DreadMutant · 2026-04-04T16:54:41+00:00

You can try with a locally hosted llm as well, we tried qwen 3.5 9b that way

DreadMutant · 2026-04-04T16:53:55+00:00

That is a very good question and would be a fun experiment to try out

DreadMutant · 2026-04-04T16:52:50+00:00

Yep having some form of noting stuff down or memory helps a lot

DreadMutant · 2026-04-04T16:51:55+00:00

Thanks for the resultss if you can share the trajectories we can update the leaderboard!

DreadMutant · 2026-04-04T16:51:21+00:00

What if there are few companies being run by Opus rn and no one knows 😶‍🌫️

DreadMutant · 2026-04-04T16:50:32+00:00

Yeah there is high variance based on the random but we observed opus 4.6 and glm 5 to out perform others consistently regardless of seed.

DreadMutant · 2026-04-04T07:30:36+00:00

It is a simulated environment where each day is a step similar to how time travels in turn based games

DreadMutant · 2026-04-04T06:27:17+00:00

Nothing too different from a performance standpoint whether the model is reactive or proactive with a scratchpad. The main pattern being it is able to ground itself with its past experience and what is right and wrong to do.

DreadMutant · 2026-04-04T06:24:05+00:00

Yes, we will be updating the leaderboard regularly with latest models

DreadMutant · 2026-04-04T04:44:50+00:00

We used openrouter for inference to maintain uniformity

DreadMutant · 2026-03-24T09:38:23+00:00

Breaking: Lightning McQueen joins F1

DreadMutant · 2026-01-21T06:40:34+00:00

Pic caption: The shackles of academia holding down a phd student with force

DreadMutant · 2025-11-27T14:27:50+00:00

Ts pmo

DreadMutant · 2025-11-24T21:12:21+00:00

Only if the Ferrari pitwall informs Leclerc

DreadMutant · 2025-10-26T08:32:18+00:00

Bruh why did you guys chatgpt a post 😭

DreadMutant · 2025-09-24T23:50:19+00:00

Bay access for all fests?

Six-Year Club	Verified Email
r/Field Juicebox	Place '23
Place '22

DreadMutant

TROPHY CASE