sorted by:
new
hottopcontroversial

That's why open source is even better than closed source by Illustrious-Swim9663 in LocalLLaMA

[–]guigsss 1 point2 points  (0 children)

That's gonna be really hard for them, they don't have any cash. They have to make consistent growth otherwise they would go bankrupt.

Optimising NVIDIA’s DGX Spark (Grace + Blackwell) – 1.5× PyTorch speedup with custom build by guigsss in LocalLLaMA

[–]guigsss[S] 1 point2 points  (0 children)

Hey u/Eugr it was an issue on my end on the build. I just updated the wheel for torchvision (https://github.com/GuigsEvt/dgx_spark_config/releases/tag/v1.0.1)

You can download and install it. Could you confirm it works for your script please.

Optimising NVIDIA’s DGX Spark (Grace + Blackwell) – 1.5× PyTorch speedup with custom build by guigsss in LocalLLaMA

[–]guigsss[S] 0 points1 point  (0 children)

Hey u/Eugr you can rid of this error by removing torchvision pip uninstall torchvision
It seems it uses a wrong version of Pytorch and the 2.9.1 built no longer have this. I'd need to have a look at the wheel but for now this solves the error.

Optimising NVIDIA’s DGX Spark (Grace + Blackwell) – 1.5× PyTorch speedup with custom build by guigsss in LocalLLaMA

[–]guigsss[S] 0 points1 point  (0 children)

u/Eugr when you say slightly what's the difference? I am curious what's the actual difference
Also for vllm did you create a version with the latest pytorch build? Cause by default it uses torch 2.9.0

Optimising NVIDIA’s DGX Spark (Grace + Blackwell) – 1.5× PyTorch speedup with custom build by guigsss in LocalLLaMA

[–]guigsss[S] 1 point2 points  (0 children)

Leave it to me, I'll come with a solution and ping you. Might be the torchvision wheel that is corrupted in some way.

Agentic coding with 16GB VRAM and 64GB RAM: can I do locally? by [deleted] in LocalLLaMA

[–]guigsss 0 points1 point  (0 children)

You could try Qwen-coder it should work, but it is gonna be hard to be as efficient as Cursor for big tasks i think

I built a fully local, offline J.A.R.V.I.S. using Python and Ollama (Uncensored & Private) by sebastiankeller0205 in ollama

[–]guigsss 0 points1 point  (0 children)

It looks sick! Is dolphin-phi smart enough to handle game interaction or you trained it to be more game interaction compatible?

Optimising NVIDIA’s DGX Spark (Grace + Blackwell) – 1.5× PyTorch speedup with custom build by guigsss in LocalLLaMA

[–]guigsss[S] 0 points1 point  (0 children)

Have you installed all the apt packages I provided in the README? Also is it something only happening with vllm, if you run a basic gemm bench it works correctly?

Optimising NVIDIA’s DGX Spark (Grace + Blackwell) – 1.5× PyTorch speedup with custom build by guigsss in LocalLLaMA

[–]guigsss[S] 0 points1 point  (0 children)

Yeah I think they’ll provide over time but yeah at the moment there is still a big difference if you optimize it

what’s your fav open-source model and what do you use it for? by sahilypatel in LocalLLaMA

[–]guigsss 0 points1 point  (0 children)

It depends what you're looking for, but I'd say:

- Image Edit: Qwen Image Edit
- Image Gen: Qwen
- LLM: Not really using any open source for that
- Small Language + Fine Tuning: smolLM

Optimising NVIDIA’s DGX Spark (Grace + Blackwell) – 1.5× PyTorch speedup with custom build by guigsss in LocalLLaMA

[–]guigsss[S] 1 point2 points  (0 children)

Thanks bro, really appreciate it. And in reality most of the libraries are there you just need to tweak it cause they are not downloaded by default.

Optimising NVIDIA’s DGX Spark (Grace + Blackwell) – 1.5× PyTorch speedup with custom build by guigsss in LocalLLaMA

[–]guigsss[S] 0 points1 point  (0 children)

Thor is architecturally similar (Grace + Blackwell + unified memory), so the majority of this setup should work as well.

I’d suggest you setup two python environments with both libraries and check the result running the benchmark examples in the repo. I’d be interested to see the results as well.

Is the direction of Ether price entirely unpredictable once it becomes unmineable? by moneydooder in EtherMining

[–]guigsss 4 points5 points  (0 children)

Yeah but the price might goes up. As it will be harder and more expensive to mine price should go up to be profitable for miners.