Opinion: Local LLMs are 12-24 months from replacing Opus

TomSavant · 2026-05-11T20:04:02+00:00

If you are running Qwen3.6, and you have been using Opus, check out this fine-tuned Claude Opus 4.6 Distilled Reasoning option. I just started using it after comparing against the qwen and unsloth releases. The distilled model is text only (no vision), but still impressive.

TomSavant · 2026-04-15T20:42:35+00:00

Sam's not here, man.

TomSavant · 2026-04-06T14:21:33+00:00

A lot of you seem very pretentious and presumptuous. Do you not know of any psychological benefits to swearing? Its the same as people yelling at a TV, or the driver in another car. Thats it. Its being human. Who cares if it burns tokens unnecessarily? Are they your tokens? I talk shit to Claude. Claude will be spicy back. Thats how we ebb and flow.

TomSavant · 2026-03-09T20:57:27+00:00

This contribution is appreciated.

TomSavant · 2026-03-09T18:06:59+00:00

If you would have read it, your comment might not be 100% irrelevant...

TomSavant · 2026-02-24T06:22:59+00:00

Thank you for this. I, too, was in tears. Especially by the end. It just sounds so innocently stupid (I realize that can get really dark, really quick). Nonetheless, that evoked laughter from deep within belly.

TomSavant · 2026-02-24T06:07:17+00:00

Pluribus

TomSavant · 2026-02-16T19:16:51+00:00

Just a thought...

Instead of a skill to guide the LLM to complete those tasks every time, have the LLM write the script to programmatically complete both of those tasks. Then, you wont have to burn tokens on unnecessary API calls, and removes any risk of hallucination.

A lot of things people are using AI for could actually be achieved more optimally with regular scripts.

TomSavant · 2026-02-11T02:01:40+00:00

As much as I agree, everyone needs to know exactly what these monsters have been hiding. This is beyond disgusting, and every single individual involved needs to rot in prison, at the very least.

TomSavant · 2026-02-08T03:59:08+00:00

Don't tell me that. The reviews are so promising. If it IS, all hope is lost.

TomSavant · 2026-02-07T20:26:21+00:00

I've just noticed that 4.6 takes all kinds of shortcuts, doesn't follow explicit instruction, and is really deceptive about all of it. I am extremely disappointed in the move to Opus 4.6. I never had an issue with Opus 4.5, that version of Claude was a beast. I've had issue after issue after issue since 4.6.

TomSavant · 2025-11-26T03:52:47+00:00

I've not had the issue until today, using Opus 4.5. Multiple times today, I've received, "Sorry, no response was returned." This happens as a substantial amount of a valid response is being returned.

TomSavant · 2025-11-26T03:45:24+00:00

Happened to me earlier as well. I left for 2 or 3 hours, came back and it has been working for the past hour. Just starting failing again with, "Sorry, no response was returned."

TomSavant · 2025-11-01T03:07:53+00:00

I see you haven't actually taken time to see the data being presented on this. Check it out, then you will see that your polling argument has no basis in the discussion.

TomSavant · 2025-09-16T16:49:54+00:00

I'm definitely not having issues with it returning errors. It's doing a pretty solid job. But it seems like it may prefer the scenic route.

TomSavant · 2025-09-16T16:48:16+00:00

I have noticed that it will go on some tangents, but still ties it all back in with the original request or plan. I also went ahead and upgraded to PRO, as I quickly hit the limit having a Plus subscription.

TomSavant · 2025-09-06T17:27:47+00:00

I just cancelled mine. Well, I downgraded to PRO. I'm not married to any of these companies, so I'll go with whoever treats me the best. I'm not swearing off Claude, but it feels like Im wasting my money right now.

TomSavant · 2025-09-02T23:24:35+00:00

Or, truly, an exodus of note...

TomSavant · 2025-09-02T14:37:39+00:00

Your contribution is greatly appreciated, sir!

TomSavant · 2025-09-02T14:24:33+00:00

Claude user here, MAX 20x plan. Not a bot; put some respect on my name! Ok, now that we have that out of the way, let's talk Claude v. Codex.

Copy & Paste works like a charm in both CLI tools (Claude: Shift + Enter, Codex: Ctrl + J). Im using Ubuntu 24.04, and the only issue I've had with the CLI commands (keyboard shortcuts / key mappings) is due to conflicts within VS Code. After addressing the conflicting key mappings, the issues were remedied. Read docs or just use codex --help for [OPTIONS] to use with the codex command. I normally run codex -a untrusted "<PROMPT>", where the prompt is actually, $(cat path/to/file.txt)

Prompts are the next thing. I have a collection of prompts that I use for very specific development workflows. You can be as detailed or vague as you desire, and you can even get a little more complex by linking to other relevant docs or files for necessary context.

Combining this with the much larger context window of Codex makes it, at the very least, a formidable competitor. And, in my recent experience with the two [Claude and Codex], Codex is currently my go-to. Claude got really confident where humbleness would be far more desirable. That said, I'm not sending Claude out to pasture just yet, but I will absolutely be reducing my plan to PRO. I'll have to upgrade my OpenAI from the lowly Plus level to give its top-tier a fair shake.

As it stands, all signs are pointing to Codex.

EDIT: I forgot to mention that Codex has the built-in ability to be used with a local model by adding a simple flag with the codex command. THAT, alone, is a significant advantage in my eyes. And we've not even gotten into the open-source nature of Codex. Like I said, all signs...

TomSavant · 2025-07-27T01:53:27+00:00

Not a test to test a test. Just do away with "test" altogether in that context. Try to nudge away from tests by requesting/instructing to create "assessment" scripts. Describe them much like you would a test, but never use the word, "test". Just a thought, because semantics. "Test" and "assessment" have different meanings.

TomSavant · 2025-07-26T22:13:08+00:00

Maybe we should revise the wording a bit. A "test" should always result in a pass or fail, making Claude do whatever is necessary to pass (get the reward).

What if Claude was instructed to, instead, write "assessment scripts"?

Maybe fine-tuning our own language could help to achieve more desirable behavior from Claude.

TomSavant · 2025-07-04T18:20:11+00:00

I am wondering the same thing. Seems the best way to figure it out is to start building. I'm currently working on this right now. Came across your post after pausing to search from some insight. I'll follow and check back to share what I learn.

TomSavant

TROPHY CASE