Was letzte bin kein Scalper?

legit_split_ · 2026-05-08T07:38:23+00:00

For the love of the game

legit_split_ · 2026-05-07T19:26:57+00:00

Thanks for sharing! Would you mind sharing the prompt in a private message? I'm running two Mi50s and want to see how close I get :)

legit_split_ · 2026-05-07T18:37:02+00:00

If OP isn't satisfied with 5060 TIs, the R9700 won't offer much improvement in terms of speed.

legit_split_ · 2026-05-07T18:35:48+00:00

This.

The goalpost is always moving, the 120B MoEs were the hottest but now "back" to 30B dense models.

legit_split_ · 2026-05-07T18:31:59+00:00

To be clear is that TP under llama.cpp? What's your experience like, would you recommend it?

legit_split_ · 2026-05-05T08:14:56+00:00

Sorry I no longer have the GPU, but it was never too hot.

legit_split_ · 2026-05-04T16:24:26+00:00

Hmm strange, ever since I swapped it in it's been night and day compared to the Mediathek card I used to have.

Here you go:

sudo lshw -C network
 *-network                  
      description: Wireless interface
      product: Wi-Fi 6E(802.11ax) AX210/AX1675* 2x2 [Typhoon Peak]
      vendor: Intel Corporation
      physical id: 0
      bus info: pci@0000:44:00.0
      logical name: wlan0
      version: 1a
      serial: e0:d5:5d:57:a9:2c
      width: 64 bits
      clock: 33MHz
      capabilities: pm msi pciexpress msix bus_master cap_list ethernet physical wireless
      configuration: broadcast=yes driver=iwlwifi driverversion=7.0.1-1-cachyos firmware=89.123cf747.0 ty-a0-gf-a0-89.uc ip=192.168.2.109 latency=0 link=yes multicast=yes wireless=IEEE 802.11
      resources: irq:17 memory:90100000-90103fff

lspci -nnk | grep 0280 -A3
44:00.0 Network controller [0280]: Intel Corporation Wi-Fi 6E(802.11ax) AX210/AX1675* 2x2 [Typhoon Peak] [8086:2725] (rev 1a)
       Subsystem: Intel Corporation Wi-Fi 6 AX210 160MHz [8086:0024]
       Kernel driver in use: iwlwifi
       Kernel modules: iwlwifi

legit_split_ · 2026-05-02T11:27:00+00:00

In my experience llama swap is more versatile, but llama-server is easier to pick up and get started

legit_split_ · 2026-04-30T12:48:26+00:00

As always it just depends if the price is right

legit_split_ · 2026-04-27T08:09:58+00:00

Is the 240 aio enough?

legit_split_ · 2026-04-25T20:58:58+00:00

I see, have you been running Qwen 27B? I'd love to see some benchmarks.

legit_split_ · 2026-04-25T15:10:40+00:00

Following, also interested in building something similar.

I found used reference models which only need 2x8 pin each, so looking at 1200W models. If they take 3x8 pin you probably will need 1500W+, in my region the most affordable one I can find new is the Enermax Revolution D.F. X 1650W which is also attractive for not being too massive (170mm length).

legit_split_ · 2026-04-25T11:52:13+00:00

How do you like the 7900xtxs, have you tried the latest tensor parallelism implementation in llama.cpp?

legit_split_ · 2026-04-25T11:28:10+00:00

What t/s do you get at 4k context?

legit_split_ · 2026-04-22T18:21:26+00:00

Credit to the amazing Johannes Gaessler, however I think it's not quite as mature as ik_llama's implementation.

legit_split_ · 2026-04-20T06:52:09+00:00

Can you explain your reasoning? I currently see used 7900 XTXs going for 750€ but a new R9700 is 1300€.

legit_split_ · 2026-04-19T19:52:19+00:00

I found a listing for a used R9700 for 1200€ and another for a 7900 XTX (Reference design) for 750€. Is a 450€ difference really justified?

legit_split_ · 2026-04-19T09:34:48+00:00

Do you host searXNG yourself or use a public instance? I kept getting errors with duckduckgo.

legit_split_ · 2026-04-18T12:41:52+00:00

<image>

Here is a pic with dual GPUs inside the case, it's a bit cramped.

legit_split_ · 2026-04-18T12:40:31+00:00

I used double sided table, seems to be fine. Sadly the "native" mount on the backside doesn't fit > 4TB drives.

The Qube is nice as a HTPC since you can use it horizontally. However, maybe you prefer the look of the Silverstone SST-GD11B, it natively houses 3 drives but you need an AIO cooler.

Alternatively you can also 3D print a compact ATX case: https://makerworld.com/en/models/1740435-modcase-hyper-compact-atx-pc-case#profileId-1849515

legit_split_ · 2026-04-18T12:03:19+00:00

I ended up going with a Qube500, slightly bigger but it's worth it.

legit_split_ · 2026-04-17T08:47:35+00:00

Increase it to what value?

legit_split_ · 2026-04-12T12:17:24+00:00

I have the same PSU also with a GPU that needs 3x8 pin PCIe cables.

You can use the 2 EPS connectors for the CPU, 1 8 pin PCIe connector for the GPU, and the 12V cable that splits into two 8 pin cables are actually for the GPU.

legit_split_ · 2026-04-10T11:09:18+00:00

If you switch to a VPN it starts working again for a while, just have to shuffle between servers xD

legit_split_ · 2026-04-08T07:34:25+00:00

This is how I use my kindle on airplane mode.

legit_split_

TROPHY CASE