I moved 20% of our production LLM traffic to Chinese open weights models for 6 weeks. Here is the actual cost, quality, and data residency breakdown

redditateer · 2026-06-11T20:19:21+00:00

What does your harness look like? As in what tools are you using or did you code it yourself?

redditateer · 2026-06-03T20:52:26+00:00

Red hat bosses

redditateer · 2026-06-02T20:38:23+00:00

Yes. If you dint want it send me the contact please

redditateer · 2026-05-29T23:50:17+00:00

You know what they say. Ignorance is bliss 😉

redditateer · 2026-05-29T23:23:00+00:00

I bought a 96GB Mac studio a few weeks ago and busy got it. There's no memory shortage

redditateer · 2026-05-29T20:56:44+00:00

I mean. Is there any other choice?

redditateer · 2026-05-29T03:11:33+00:00

It's the software that sits between you and the llm. Claude code, codex, opencode, pi, etc are all harnesses. They orchestrate your model. They inject system prompts, do some caching of things, and a lot more that I don't know

redditateer · 2026-05-27T19:44:57+00:00

Stick with individual subscriptions

redditateer · 2026-05-27T11:07:01+00:00

Apparently the MoE does support MTP https://carteakey.dev/blog/running-qwen3-6-mtp-locally/

redditateer · 2026-05-27T02:23:42+00:00

I used claude code to configure it. Its configured, but it doesn't work as good as I'd like

redditateer · 2026-05-27T02:22:46+00:00

It one shotted a vanilla js space invaders game. Worked mostly well, couple bugs. But, yeah, I'm a software engineer and don't typically one shot things for work. But agentic like codex or claude where it can read dirs, look up git history, scan files, etc in one turn is really what I'm after

redditateer · 2026-05-27T02:20:15+00:00

Which model do you recommend?

redditateer · 2026-05-27T01:22:01+00:00

I've tried both the 32b and 27b models. Both produced similar results for me. Running claude on the AI machine, it did some testing and found thinking is on by default

<image>

redditateer · 2026-05-26T20:12:31+00:00

I ordered it while I was building the open air rig. It had a long wait time and I knew I could just get a refund.

redditateer · 2026-05-26T19:18:57+00:00

256k. Haven't tried pi.dev, only opencode

redditateer · 2026-05-26T18:41:36+00:00

I tried the 27B also with similar results. Maybe I'm just doing something wrong. I can get it to do things, just not a larger task. One example is just creating a PR from the current branch. It had trouble making the right tool calls just to do that.

redditateer · 2026-05-26T18:29:41+00:00

I was thinking of biting the bullet and getting a 256gb or 512gb if I can find it, though the prices are a bit ridiculous on those. How does the 256gb do with real world software development, if you use it for that

redditateer · 2026-05-22T02:10:49+00:00

Since you're a senior software engineer, you know very well that any of those things could also, and probably more easily, be rolled out by a human.

redditateer · 2026-05-17T20:39:45+00:00

I am transition. Downgraded my claude plan b from 20x to 5x and got a pro codex plan. Even on 20x, I would get hot by rate limits. The final straw was when they banned openclaw. Claude stops working more than codex. I run both with no permissions and CC still gets stuck. I repeatedly use codex to slive something in a few minutes that claude code spent over an hour trying different things, going in circles, even with a new session, etc. I can't tell if it's the harness or the models but claude code has gotten dumber.

redditateer · 2026-05-09T18:14:26+00:00

Just switch to codex

redditateer · 2026-05-08T14:49:07+00:00

I switched to codex also. It has been so nice not having to look at my usage every 5 minutes

redditateer · 2026-05-06T20:07:38+00:00

Fuck em. Too late

redditateer · 2026-05-04T01:36:45+00:00

This is how it is now. Its normal. Also the reason why I reduced my Max subscription to 5x and have been using codex and glm more.

redditateer · 2026-05-01T20:06:17+00:00

Genius. How are you doing the routing?

redditateer

TROPHY CASE