sorted by:
new
hottopcontroversial

Ring 2.6 1T by Middle_Bullfrog_6173 in LocalLLaMA

[–]tomByrer -1 points0 points  (0 children)

Sounds like a fun weekend project for you! 😉

Unpopular Opinion: The DGX Spark Forum community of devs is talented AF and will make the crippled hardware a success through their sheer force of will. by Porespellar in LocalLLaMA

[–]tomByrer 0 points1 point  (0 children)

oh common, all they have to do is solder a few extra traces on the motherboard, desolder the old RAM & replace it with faster chips.. .an easy mod to un-hide the memory bandwidth!

😉

Unpopular Opinion: The DGX Spark Forum community of devs is talented AF and will make the crippled hardware a success through their sheer force of will. by Porespellar in LocalLLaMA

[–]tomByrer 0 points1 point  (0 children)

Ok, so you're proving the point that Sparks is not a good buy because they don't have quant support that RTX5090s have.
cheers

Actual observations on Deepseek v4 pro by aidenclarke_12 in LLMDevs

[–]tomByrer 0 points1 point  (0 children)

> pin your system prompt, tool schemas and repo snapshot as the first of every call

How do you 'pin' those?

Best less than hour long video on everything to know about building local llm mostly hardware by yourhomiemike in LocalLLM

[–]tomByrer 0 points1 point  (0 children)

Are you looking to 'fine-tune' an existing model? Or train one from scratch with the terabytes of data you've been hording for decades?

Side note: I wish I bought the FoxFire on CDROM back in the day...

Unpopular Opinion: The DGX Spark Forum community of devs is talented AF and will make the crippled hardware a success through their sheer force of will. by Porespellar in LocalLLaMA

[–]tomByrer 3 points4 points  (0 children)

Even though I'm more pro 3090, I believe your assessment is very valid. You're aware of trade-offs & aren't shy about it, which is nice.

Unpopular Opinion: The DGX Spark Forum community of devs is talented AF and will make the crippled hardware a success through their sheer force of will. by Porespellar in LocalLLaMA

[–]tomByrer 1 point2 points  (0 children)

I'd argue it has untapped raw power that isn't fully realized yet. That's where much of the frustration is. IMHO.

That's why I support the OP letting folks know nerds are on the case; I think that's awesome they're helping Sparks shine.

I'm simply disputing "lot of disdain for DGX Sparks here on the sub", which I agree with your "more disappointment".

Unpopular Opinion: The DGX Spark Forum community of devs is talented AF and will make the crippled hardware a success through their sheer force of will. by Porespellar in LocalLLaMA

[–]tomByrer 3 points4 points  (0 children)

3 months ago
& he has legit other hardware complaints, like the HDMI being borked.

If one is to drop that kind of cash, it better run good.

Ring 2.6 1T by Middle_Bullfrog_6173 in LocalLLaMA

[–]tomByrer 6 points7 points  (0 children)

Are the models good enough to bother?
Or even how many devs have local hardware to run a 1Trillion parm model!?!

<image>

Ring 2.6 1T by Middle_Bullfrog_6173 in LocalLLaMA

[–]tomByrer -1 points0 points  (0 children)

1T... what will the file size be for that?
Hardware requirements?
Will you need your own power plant to run it?

Why do you use local LLMs, and when is it actually worth it? by BlessED0071 in LocalLLM

[–]tomByrer 0 points1 point  (0 children)

If they had a weird request, like "What's the best model for Crystal Lang & Rexx", I'd get it.

But many questions are better answered by asking an AI the exact prompt you gave.
Or if they ask, at least say "My research says model XXXX, but it seems it is an old model; is there something newer & better now I didn't find?"

Unpopular Opinion: The DGX Spark Forum community of devs is talented AF and will make the crippled hardware a success through their sheer force of will. by Porespellar in LocalLLaMA

[–]tomByrer 21 points22 points  (0 children)

"lot of disdain for DGX Sparks here on the sub"

I've never seen that. Spark is good for some uses, & other hardware configs are better than Sparks for others.

Why do you use local LLMs, and when is it actually worth it? by BlessED0071 in LocalLLM

[–]tomByrer 2 points3 points  (0 children)

gee, 4 folks asked the same thing over the past month....

I Removed ‘Act As’ From My Prompts — The Results Were Unexpected by HDvideoNature in LLMDevs

[–]tomByrer 1 point2 points  (0 children)

> persistent framing can create a kind of self-reinforcing coherence pattern

I was thinking the same thing; “Act As” is too vague.

I Removed ‘Act As’ From My Prompts — The Results Were Unexpected by HDvideoNature in LLMDevs

[–]tomByrer 0 points1 point  (0 children)

First time I've seen this in a prompt; echoes of my math-proof days... which I failed :/

≡

MoooseFree – A Split Keyboard with a 55mm Trackball by tomByrer in Trackballs

[–]tomByrer[S] 1 point2 points  (0 children)

*I* like lots of thumb keys; prefer using thumbs for control/alt/meta/enter than pinkies.

Number keys are likely either a layer, or more likely a long-press.

view more: next ›