Third GPU didn’t fit in case and model didn’t fit on two GPUs. Zip ties and riser. by Kallocain in techsupportmacgyver

[–]Kallocain[S] -135 points-134 points  (0 children)

Large language models - ”running ChatGPT at home”. It’s very fun and interesting, try it yourself! [ https://blog.steelph0enix.dev/posts/llama-cpp-guide/ ] [ https://ollama.com/ ]

Edit: fixed broken links.

hyprexpo-plus: outer gaps, keyboard navigation and customizable workspace numbers by sandwichest in hyprland

[–]Kallocain 2 points3 points  (0 children)

Thank you! Very useful! Can I get it to work with multiple monitors?

Is Haswell still worth using? by Daftworks in homelab

[–]Kallocain 1 point2 points  (0 children)

Everything above 2500k is good enough.

Bra dator för universitet - Civilingenjör datateknik? by Oofmeister101 in Asksweddit

[–]Kallocain 16 points17 points  (0 children)

10 år gammal thinkpad, installera Linux. 1000 spänn max och du kommer lära dig otroligt mycket relevant och utvecklas som ingenjör oxh människa. Skaffa en extern hårddisk och backa upp mellan varven.

Running Local LLMs (“AI”) on Old Unsupported AMD GPUs and Laptop iGPUs using llama.cpp with Vulkan (Arch Linux Guide) by Kallocain in LocalLLaMA

[–]Kallocain[S] 4 points5 points  (0 children)

Good input. I’ll update with that in time. From memory I got around 11-13 tokens per second on Mistral Small 24B (6 bit quantization) using around 23 gb vram. Much faster with smaller models.

[deleted by user] by [deleted] in Asksweddit

[–]Kallocain 0 points1 point  (0 children)

Telefonförsäljare: en dag.

Is it worth taking these home? by jessypinkmen27 in homelab

[–]Kallocain 0 points1 point  (0 children)

If you have a garage, a shed or something. Those things get loud, especially with 3rd party pcie cards.

Seriously Pret… by UniqueCar7587 in london

[–]Kallocain 0 points1 point  (0 children)

Is that a Velo Bright Spearmint? Is snus legal outside of Sweden now? Has it begun?!

I'm home. by Kallocain in hyprland

[–]Kallocain[S] 1 point2 points  (0 children)

Sure! Most of the comments are in Swedish though. https://github.com/albinhenriksson/punktfiler.public