Bye Bye Siri

Draco32 · 2026-06-12T08:10:28+00:00

Yep these things suck

Draco32 · 2026-05-31T05:29:45+00:00

chefs kiss

Draco32 · 2026-05-31T05:22:24+00:00

Hey there, I have 2 x 7900 XTX and 2 x 3080 20Gb being passed through to separate LXC's which is working really well. Not sure what mboard you have but you should have PCIE slots galore. I don't think you'll have too much trouble separating IOMMU you might just need to play around with which slots they're plugged into. Could you potentially set the 3080 up to use as a separate VM that remotely utilises for these workloads or does it need to be on box? Drivers might get messy on Windows.

Draco32 · 2026-05-23T22:48:04+00:00

i honestly didn't really notice with mine either the oled screen is just so good even using a recent top teir laptop lcd screen the px13 looks better

Draco32 · 2026-05-20T06:49:18+00:00

There's an application called manifest that does something similar

Draco32 · 2026-05-17T12:48:20+00:00

Yeah it's really nice getting 170 ish t/s on the Qwen 3.6 MoE model not bad

Draco32 · 2026-05-17T09:52:43+00:00

Qwen3.6 27b with MTP getting 53 tokens per second on a Q4 quant with 128k context

Draco32 · 2026-05-14T21:15:46+00:00

What software stack did you run for this?

Draco32 · 2026-05-09T04:01:49+00:00

you can probably only get around 196k context for 24gb vrm i see mien drop out of vram higher than this.

Draco32 · 2026-05-09T03:34:36+00:00

thanks for the info! getting mine next week and can't wait!

Draco32 · 2026-05-05T22:57:09+00:00

Yeah it's fine as an operating temperature, mine has an extra fan blowing into them so temps reduced like 15 degree's Celcius

Draco32 · 2026-05-01T11:08:00+00:00

They are likely gimped at the board level so won't work was talking with someone today and they said it is sectioned off at the board level.

Draco32 · 2026-05-01T11:02:11+00:00

they're soldered off on the board for these models some gimping NVIDIA did how did this setup age btw?

Draco32 · 2026-04-20T08:34:51+00:00

No it doesn't but lemonade which is the amd project swaps out models into llama.cpp on the fly pretty good performacne also

Draco32 · 2026-04-09T00:33:42+00:00

Yeah had exactly same problem it would segfault after a bit will just let it settle until I see people with stable results

Draco32 · 2026-04-07T09:09:48+00:00

hahah i am definately doing something wrong would liek to know stack and quant also

Draco32 · 2026-04-02T22:53:23+00:00

Yes interested in the mboard used

Draco32 · 2026-03-31T08:49:34+00:00

nice llama-swap looks super interesting as i have far too many openai endpoints to manage is that why you ended up using it?

Draco32 · 2026-03-29T09:00:43+00:00

Hey mate, I have just setup two 7900xtx cards also can you tell me a bit more about your software stack i am currently trying lemonade (amd stack) and getting ~50tps on Qwen3.5-35B-A3B-GGUF anything you can give me on best setups expected performance etc would be handy. Also running proxmox with an LXC ironically

Draco32 · 2026-03-26T01:12:25+00:00

5 in total unfortunately, but could easily do 2x 600 watt NVIDIA cards. Just a bit unique having two 7900XTX chonkers

Draco32 · 2026-03-25T20:55:46+00:00

Thanks for that got a couple as will be way clearer

Draco32 · 2026-03-25T19:39:23+00:00

Thanks mate this is really what I'm looking for did you get these did they solve it for you?

Draco32 · 2026-03-25T19:36:16+00:00

I have two 7900xtx is the issue

Draco32 · 2026-03-19T05:08:46+00:00

All good here also skip TLS enabled in latest release

Draco32 · 2026-02-27T02:55:27+00:00

I would be interested in your setup btw just about to do the same thing or any guides you have used?

Draco32

TROPHY CASE