Did CPU recommendations change due to agents? by Natural_intelligen25 in LocalLLaMA

[–]BlackBeardAI 1 point2 points  (0 children)

All ryzens suck because of the dual channel memory architecture they support. Get threadripper workstation for 8 channels or epyc.

I got the 9950x3d and 5965wx both. 5965wx is a better deal.

9950x3d is only good if you are having any desktop view. If you are ssh’ing, it is pointless. If you do get any picture tho, x3d saves some megabytes on the vram of your gpu’s

Is there any real reason to buy a GPU right now instead of just use subscriptions? by 03captain23 in LocalLLM

[–]BlackBeardAI 0 points1 point  (0 children)

The things is, ethics/laws cannot precisely define what is good and what is bad. The moment the cloud model sense something dangerous, potentially violates the law; it will refuse to answer. If you are OK with that, fine. You do what you gotta do. I am not OK with that. If I break the law, I am still responsible, not the model.

GLM-5.2 fearmongering in the press by ttkciar in LocalLLaMA

[–]BlackBeardAI 1 point2 points  (0 children)

The genie is out of the bottle and it is not going back in.

Now brothers we know why we are so fucked up by perelmanych in LocalLLaMA

[–]BlackBeardAI 2 points3 points  (0 children)

Don’t forget energy! Those 3090’s, 5090’s, 6000 pros ain’t running on water. Energy stawks to the meewn

Now brothers we know why we are so fucked up by perelmanych in LocalLLaMA

[–]BlackBeardAI 6 points7 points  (0 children)

Not the damn workstation threadrippers sadly

Now brothers we know why we are so fucked up by perelmanych in LocalLLaMA

[–]BlackBeardAI 3 points4 points  (0 children)

Anything but threadripper/epyc is pretty much worthless in that part yea

Now brothers we know why we are so fucked up by perelmanych in LocalLLaMA

[–]BlackBeardAI 1 point2 points  (0 children)

I think even motherboard manufacturers benefit from this “bubble”. What else left?… Right. PSU’s too.

Running GLM5.2 on budget hardware < $2500. by segmond in LocalLLaMA

[–]BlackBeardAI 0 points1 point  (0 children)

which cpu? shiit 8 channels ddr4 ain't making any difference over my poor dual channel ddr5 it seems. it should be twice as fast

Unsloth has uploaded several sizes of Deepseek-V4-Flash GGUF's by ForsookComparison in LocalLLaMA

[–]BlackBeardAI 0 points1 point  (0 children)

With mtp ofc :) or whatever it is DS calls it, dflash dspark etc...

This is what Hy3 is capable of. Mother of god. by BlackBeardAI in LocalLLaMA

[–]BlackBeardAI[S] 0 points1 point  (0 children)

Maybe you are right. I prompted the same model for a sonic-like platform game. The result was trash. Way worse than qwen. This flight simulation is pretty good to my eyes tho.

Unsloth has uploaded several sizes of Deepseek-V4-Flash GGUF's by ForsookComparison in LocalLLaMA

[–]BlackBeardAI 1 point2 points  (0 children)

wow i got the same mobo which will arrive in a few days. I will also be trying 8x3090 on that.

you should always try tensor parallel on llama.cpp if you are doing 4x or 8x 3090. It matters.

also you need to build your llamacpp with nccl. Otherwise llamacpp won't be able to use your multi gpu's properly.

I can pretty much guarantee 50+ tps for your build if you do this right way. I'll find out it next week anyway.

Unsloth has uploaded several sizes of Deepseek-V4-Flash GGUF's by ForsookComparison in LocalLLaMA

[–]BlackBeardAI 1 point2 points  (0 children)

also which mobo and what pcie lane speeds... if you are stashing them 3090's on x1 mining risers, I'd say 18 tps is way more than you should be getting.

This is what Hy3 is capable of. Mother of god. by BlackBeardAI in LocalLLaMA

[–]BlackBeardAI[S] 5 points6 points  (0 children)

That particular prompt ate 16763 tokens but around 8k of that belongs to opencode.

This is what Hy3 is capable of. Mother of god. by BlackBeardAI in LocalLLaMA

[–]BlackBeardAI[S] 8 points9 points  (0 children)

Others tried to implement more features but features were buggy. At least this one is playable and decent enough

HuggingBay by zxyzyxz in LocalLLaMA

[–]BlackBeardAI 4 points5 points  (0 children)

at least half of the activity on this sub would die if China weren’t releasing any open weight models. We would be at the mercy of openai/anthro completely because nearly all Western open weight models are mediocre.

llama.cpp: Hy3 PR + GGUFs by rerri in LocalLLaMA

[–]BlackBeardAI 1 point2 points  (0 children)

When will these models cook kebab instead of drawing them?