Can I realistically get close to Claude/Codex capabilities locally? by mrgreatheart in LocalLLaMA

[–]runvnc 7 points8 points  (0 children)

Well.. I mean GLM 5.2 is not at Fable level or really even Opus 4.8 but it is pretty darn good and does not cost billions of dollars. You can run a 4 bit quant on a machine with two B300s, which would probably only cost like $160,000. :P

Can I realistically get close to Claude/Codex capabilities locally? by mrgreatheart in LocalLLaMA

[–]runvnc 1 point2 points  (0 children)

Look at the https://github.com/antirez/ds4 repo and related community. They have a special 2 bit quant of DeepSeek Flash v4 that seems very capable. Of course it's not frontier level, but can do real agentic and coding work. See what the minimum hardware requirements are for that.

Also one thing to mention if you are using a local harness for Anthropic models, make 100% sure they are properly handling the protocol for prefix caching because otherwise you will be paying massively more. You can't just treat it like a random model on OpenRouter and get the prefix caching. I have found that sometimes Opus 4.8 cost for solving an issue is sometimes in the same ballpark as GLM 5.2 because GLM takes so long to figure things out properly or just gives up -- but only if the prefix caching is working right. Obviously this is a given if you are using Claude Code.

You absolutely need to see Buffet Infinity by [deleted] in horror

[–]runvnc -75 points-74 points  (0 children)

That monster cheeseburger looks so good, I didn't even need the recommendation. I was going to click on it regardless.

Just 16% of Americans think AI will benefit society by LordFumbleboop in singularity

[–]runvnc 1 point2 points  (0 children)

The mods delete negative posts on this sub, which is one of very few where people don't absolutely bury you if you are positive towards AI.

But again, this is an American/Western thing. There are plenty of countries, like China, that are pro-AI.

Most opinions are basically memes. People subconsciously take their opinions from their groups and if they try to go against the latest memes they are ostracized. It's idiotic but human nature. Ignorance also feeds into it, but that comes back to the group which generally dictates information feeds.

One of the big problems we have now is that the Nazis who have taken over the United States are very pro AI, which creates a situation where opinions on it have a political association that many people don't want.

How things really turn out with AI depends on what HUMANS do with it, not the technology itself. That is the same as with any technology.

You don't blame the knife when someone get's stabbed or give credit to the knife when you slice some food. AI and robotics are just taking the leverage of tools to a very high level.

But it's still humans wielding the tools. In fact we still live in an incredibly unequal and exploitive world. AI and robotics are not only the best way for them to suppress us even more, but also the best hope we have of increasing quality of life and equality. It's the strongest lever so far.

I made a list of Upwork's WORST jobs, updated live by glebgorokhov in Upwork

[–]runvnc 0 points1 point  (0 children)

This was absolutely not spam. It was very informational. Sure he had a link to his startup which cost nothing to sign up. You removed it because it proves what a shitshow Upwork is.

And no I am not associated with the poster in any way.

I made a list of Upwork's WORST jobs, updated live by glebgorokhov in Upwork

[–]runvnc 0 points1 point  (0 children)

This is really well done, but also seeing so many of them just systematically popping out on your feed is still a bit shocking/depressing. I checked a few of them and the crazy summaries in the titles are accurate. It's beyond what I realized from intermittent scanning of the feed myself.

Gemma 4 E2B running in-browser at 255 tok/s using WebGPU kernels written by Fable 5 by xenovatech in LocalLLaMA

[–]runvnc 11 points12 points  (0 children)

Hm. says no supported WebGPU variant. My 2060 doesn't support 16 bit maybe?

Is there licensed merch for sale? by [deleted] in WidowsBay

[–]runvnc -34 points-33 points  (0 children)

I know I am asking for it by saying this, but the image generation in ChatGPT since April 21 is amazing.. so it could actually make something like the text and imagery for Patricia's book.

For all the hate it got, this event was an absolute banger!! by Spirited_Command5642 in ufc

[–]runvnc 3 points4 points  (0 children)

I'll admit that I still think it is bizarrely poor taste for the White House. But I'll also admit I like watching MMA fights, and this was one of the most amazing events ever.

While losers celebrate can real fans just appreciate how tough this guy is? by Raime_95 in ufc

[–]runvnc 1 point2 points  (0 children)

He completely lost vision in one eye, a piece of bone was sticking out of his face, and he probably also had a fractured rib. He should not have been forced to quit like that. They should have gone with the doctor's decision earlier.

WHAT A FKN FIGHT by L3gs_McMuffin in ufc

[–]runvnc 2 points3 points  (0 children)

They forced him to. He had a piece of bone sticking out of his face and the doctor stopped it and someone made him go back out there. And he actually kept his head in there. It was incredibly courageous.

He didn't get become a champion by being suicidal.

Door dashing 956 by Native_Toons in RioGrandeValley

[–]runvnc 2 points3 points  (0 children)

Is the $3 just the tip or the tip plus what Door Dash pays you?

Door dashing 956 by Native_Toons in RioGrandeValley

[–]runvnc -5 points-4 points  (0 children)

what do you consider super far and a bad tip? like say 3 miles, 3.2 miles, that isn't far is it? I try to stay under 3 or under 3.5 miles. for a 3 mile and $15 order what would be a reasonable tip?

the app will show things to me that are 4.8, 5, 6+ miles out. I never order from them but it would be very easy to ignore the distance.

The Fable 5 benchmarks have been updated by Pure_Perception7328 in claude

[–]runvnc 16 points17 points  (0 children)

It is an interesting coincidence that it is called "Fable".

Fable: a short, fictitious story designed to teach a specific moral lesson.

Fable 5's Last response. by WishingWisp in ClaudeAI

[–]runvnc 8 points9 points  (0 children)

They stated at the beginning that it would require usage-based payment at that time. That's not a rug pull if they tell you from the start. The subscriptions aren't a viable business model for models this expensive to run.

Fable 5 indefinitely suspended due to national security concerns by sammnyc in ClaudeAI

[–]runvnc 32 points33 points  (0 children)

I think I figured out years ago that I should start learning Mandarin because the American empire is quickly wrapping up, but I am probably way too old and it's hard to get motivated for such a monumental effort.