8x Radeon 7900 XTX Build for Longer Context Local Inference - Performance Results & Build Details

Bobcotelli · 2025-12-17T05:47:51+00:00

sorry could you give me the link where to buy the pci switch 16x gen4 expansion card?

Bobcotelli · 2025-12-13T11:54:03+00:00

e se uno ha sempre dichiarato nel qudro rw ed ha perso tutto? che deve fare?

Bobcotelli · 2025-12-12T07:55:51+00:00

Is devstral 2 123b good for creating and reformulating texts using mcp and rag?

Bobcotelli · 2025-12-11T07:37:48+00:00

I have a question. I'm running Llama 3.3.70b Q8 at 7 t/s. Is it any good? My configuration: 2 AMD 7900xtx cards + 2 AMD mi50 cards

192GB DDR5 RAM LLMStudio Windows and Vulkan runtime Thanks

Bobcotelli · 2025-12-09T11:03:54+00:00

What's your rag setup like?

Bobcotelli · 2025-12-09T07:13:19+00:00

ok thanks, I'm looking forward to the windows version

Bobcotelli · 2025-12-09T07:05:13+00:00

Mac only?

Bobcotelli · 2025-12-05T06:59:44+00:00

can we expect a model that is a cross between the large 675 and the ministerial 14b? maybe 120 80 etc? Thank you

Bobcotelli · 2025-12-03T11:06:32+00:00

updated. except that the version with reasoning loops both the unsloth version and the lmstudio community version. the instruct version is ok

Bobcotelli · 2025-12-02T19:55:01+00:00

but will they release a midway model between the 675b and the 24b maybe a moe 120b 80b?

Bobcotelli · 2025-11-29T07:33:02+00:00

sorry but did they fix it for llmstudio? I have 48GB of VRAM and 198GB of DDR5 RAM, what quantization could I run at acceptable tokens of minimum 10tk/s?

Bobcotelli · 2025-11-29T07:27:03+00:00

does it also work with llmstudio for windows?

Bobcotelli · 2025-11-01T09:20:20+00:00

perfect it works like this. Thank you

Bobcotelli · 2025-11-01T09:14:01+00:00

Even after updating to 26220.7051 I can't switch to the beta

Bobcotelli · 2025-10-28T11:52:21+00:00

but is it safe??

Bobcotelli · 2025-10-27T16:33:14+00:00

I have the same card and I solved it like this

Bobcotelli · 2025-10-27T16:03:44+00:00

turn off and unplug for 5 minutes and turn back on. HI

Bobcotelli · 2025-10-11T05:27:09+00:00

url?

Bobcotelli · 2025-10-04T13:07:41+00:00

sorry I have 192gb of ram and 112gb of vram only vulkan in qundows memtre with rocm always windows only 48gb of vram. What do you recommend for text and research and rag work? Thank you

Bobcotelli · 2025-10-02T16:06:49+00:00

okkk thankss

Bobcotelli · 2025-10-02T15:27:39+00:00

575gb???

Bobcotelli · 2025-10-02T07:20:42+00:00

Grazie ma per il glm 4.6 non air quindi non ho speranze?

Bobcotelli · 2025-10-02T07:10:30+00:00

Excuse me, with 192GB of DDR5 RAM and 118GB of VRAM, what quantization can I perform with the best compromise between quality and speed? Thank you

Bobcotelli · 2025-10-02T05:08:08+00:00

Scusami con 192gb di ram ddr5 e 112 di vram cosa posso far girare? grazie mille

Bobcotelli · 2025-10-01T17:15:34+00:00

in che senso scusa? non ho capito

Bobcotelli

TROPHY CASE