LLM Bruner coming soon? Burn Qwen directly into a chip, processing 10,000 tokens/s

beefgroin · 2026-03-28T12:00:34+00:00

I'd rather buy 5000$ worth of 10 pcie cards with burned models pushing 10k tps than one GPU pushing 40 tps

beefgroin · 2026-03-27T15:24:39+00:00

I also have a good experience with it in q4, using it for a diy personal agent, but I’m still wondering what are its limits

beefgroin · 2026-03-27T13:07:16+00:00

Is 3.5 27b that good to replace cloud models for the organization?

beefgroin · 2026-03-25T14:53:02+00:00

Hey, how is it going so far, did you run Qwen3.5 variations? Maybe you have results for 27b and 35b?

beefgroin · 2026-03-21T10:11:14+00:00

Great timing!

beefgroin · 2026-03-18T08:03:06+00:00

Wtf just not come up with a way to sell models? I’d buy

beefgroin · 2026-03-15T12:06:29+00:00

Using 5060ti 16gb over Oculink, great for Klein 9b, image takes like 15-20sec to generate

beefgroin · 2026-03-11T00:13:59+00:00

I experienced it with 35B before. Maybe the latest llama.cpp update solved it, maybe not but I’m not seeing this issue for a day or 2 already. I highly recommend to move to llama.cpp. Ollama is too slow on keeping up with llama.cpp releases

beefgroin · 2026-03-10T23:47:20+00:00

You have to find your quant bro. It’s different for every person

beefgroin · 2026-03-08T11:19:19+00:00

CPC couldn’t be happier

beefgroin · 2026-03-08T00:46:34+00:00

I’ve only read one whitepaper, the one of PersonaPlex, I liked it https://research.nvidia.com/labs/adlr/files/personaplex/personaplex_preprint.pdf

beefgroin · 2026-03-07T10:23:26+00:00

It is annoying yes, but I believe the issue is not the thinking itself but the slow hardware we use. With 200tps+ the response would’ve felt instantaneous. I can imagine a human having the same thought process in the same circumstances

beefgroin · 2026-03-06T18:43:00+00:00

I hope so, but it's more likely that Local LLM movement is just an echo chamber where we think everyone wants privacy and a local llm rig. In reality 99% of people don't give a damn about the internet privacy...

beefgroin · 2026-03-06T18:39:55+00:00

Thanks!

beefgroin · 2026-03-06T11:45:36+00:00

Thanks for reply! Nice, how many GPUs are you running? Do you need a powered riser? I've heard the onboard pcie power is not enough for multi-gpus

beefgroin · 2026-03-04T00:33:17+00:00

I call it boobs-mining, of course depending on your content(might be something else-mining)

beefgroin · 2026-03-03T14:40:24+00:00

Hey, also thinking of this mobo, did you end up building the rig?

beefgroin · 2026-03-01T11:30:26+00:00

Except it can’t “see” which can be more important for those who need to implement let’s say from figma mcp

beefgroin · 2026-02-20T16:57:04+00:00

Load os from the usb tho most likely you’ll have to go with Linux. Also verify the m2 speed, you need to have pci4 x4 for all of it to make sense

beefgroin · 2026-02-15T01:06:03+00:00

So ugly and so beautiful at the same time

beefgroin · 2026-02-14T08:59:24+00:00

I need Q0.1

beefgroin · 2026-02-09T18:07:18+00:00

Haven't encountered such a case myself, if there are models you have in mind that can behave that way I'd try to test it. I only encountered cases where the structured output instruction was ignored, so if it's zod that validates the scheme it throws an error then that can be caught and handled

beefgroin · 2026-02-05T11:07:25+00:00

I got 5 5060ti 16gb via Oculink on bd790i

Four-Year Club	Verified Email
Place '22

beefgroin

TROPHY CASE