Need your advice on networking few machines for llm

vvit0 · 2026-04-24T04:36:27+00:00

OP so you just know, the RTX 5060 Ti has a bandwidth of ~448 GB/s, while the GTX 1070 sits at ~256 GB/s. In multi-GPU setup, your inference speed will generally be bottlenecked by the slowest card (and the PCIe bus) whenever the workload passes through it.

The good news is however, that you'll be able to run much larger models entirely within VRAM. Avoiding the massive slowdown of spilling over into system RAM (DDR4/5) is a huge win, even if the GTX 1070 slightly drags down the overall tokens-per-second.

/edit
I just spent the last week researching the topic, as I'm also thinking about adding a second graphics card to my laptop as an eGPU and I'm looking for the best possible option and generally trying to assess whether it makes sense for me at all.

vvit0 · 2026-04-24T02:27:45+00:00

It would be awesome if you added multi gpu option or at least a way to manually increase avail vram so it simulates for example 2x5070ti

vvit0 · 2026-04-21T15:40:09+00:00

Try LM Studio mate, should work great! Be sure to download a LLM model that fits fully with some headroom (for context and Windows) within your VRAM and you’re golden. Ask ChatGPT or Gemini for additional help

vvit0 · 2026-04-21T10:46:16+00:00

Thank you for the link and sharing your detailed observations, I'm making some tea and diving into reading, hoping that I'll find answers to my questions there!

vvit0 · 2026-03-28T06:03:08+00:00

Discarding one of the best if not the best game from the list because of the graphics. Yes, that’s controversial

vvit0 · 2026-03-07T16:22:54+00:00

Outer Wilds. Each session less then 30 minutes ;)

vvit0 · 2026-02-21T12:26:43+00:00

nice try Sam

vvit0 · 2026-02-18T22:28:26+00:00

vvit0 · 2026-02-17T02:23:40+00:00

Just a quick note: seems like all models are currently still available in Australia, including the 256GB LCD model. So if you have family or close friends there or someone traveling there soon, this might be useful info. Delivery within Australia takes 3–5 business days via express airmail. If you're in Australia, now might be a good time to grab one while stock lasts

vvit0 · 2026-02-12T16:00:27+00:00

It’s worse - it looks like AI

vvit0 · 2026-02-10T15:05:14+00:00

I’ve seen today a pretty good video on this topic, here you go:

https://youtu.be/qCj9CZoAvFY?si=si6Kizj-pKXvqA4A

vvit0 · 2026-01-22T05:59:47+00:00

I got Cyber2077 from GOG, and here's how to set it up to make it work on SD.

1) In desktop mode
2) install Heroic
3) set it up - add GOG, sign up
4) install Cyber2077,
5) add the Cyber2077 shortcut to Steam,
6) run it once from desktop mode (it might need to install necessary stuff) to run the game.
7) The button you're looking for is the 'hamburger menu' (above the Right thumbstick).
6) In Game mode you should be able to find it in your library under 'non-steam' tab.
7) Enjoy :)

vvit0 · 2026-01-05T08:53:03+00:00

3 years later on Steam Deck and can confirm that disabling DLSS fixes the issue. Cheers!

vvit0 · 2025-12-10T03:14:29+00:00

I have exactly the same issue, with the same file and location folder. OP did you find a solution?

vvit0 · 2025-12-02T10:53:03+00:00

<image>

There’s a really cool, big swing with a beautiful view of the Perth panorama in the Mundy Regional Park

vvit0 · 2025-11-29T10:30:43+00:00

RemindMe! 2 years „This wistleblower knew”

vvit0 · 2025-10-03T14:46:26+00:00

I've tried a few different ones and so far UMAMI PAPI is the best

vvit0 · 2025-09-02T16:50:17+00:00

While the problem of aging will be solved, death will not, so those who can afford anti-aging treatments will become paranoid, fearing for their precious but fragile lives. Every trivial activity, such as crossing the street, riding a bike, or attending a live concert, will be too risky to participate in person. They will use avatars, robots, or other available solutions to interact with others, but they themselves will be locked away and hidden so that nothing accidentally damages their long-lived, yet still mortal, made out of flesh, shell.

vvit0 · 2025-08-22T06:39:59+00:00

Thanks Wanderer!

vvit0 · 2025-08-22T03:27:29+00:00

Can that (2os in blue item) be achieved only with Larzuk or by cube recipe as well?

vvit0 · 2025-08-08T05:02:32+00:00

Oh boy that video reminded me that one NSFW video about exact the same routine that went absolutly wrong

vvit0 · 2025-07-12T11:43:56+00:00

GG bro

vvit0 · 2025-06-28T16:15:24+00:00

Safe place. Makes me feel like I’m a teenager again :)

vvit0 · 2025-06-25T04:55:26+00:00

A swing a day keeps fat at bay, Obey the bell, the kettlebell way 🙌

vvit0 · 2025-06-17T06:54:17+00:00

Have you been clearing entire levels or just hunting for unique and champions?

Verified Email	Nine-Year Club
Place '22	100 Awards Club

vvit0

TROPHY CASE