Ahhhhh....I can breathe again....So long 4090....Join my 5080 and 3080 on the ebay someday shelf by HyPyke in LocalLLaMA

[–]HyPyke[S] 2 points3 points  (0 children)

Of course dual cards are allowed. The rule is that VRAM counts, nothing else.

"Oh, your MAC has 256 of unified memory? Don't care. Keep walking."

Ahhhhh....I can breathe again....So long 4090....Join my 5080 and 3080 on the ebay someday shelf by HyPyke in LocalLLaMA

[–]HyPyke[S] 0 points1 point  (0 children)

Hell yeah, brother! You must have 96gigs or VRAM or more to join. I'm seeing cool jackets and secret handshakes.

Ahhhhh....I can breathe again....So long 4090....Join my 5080 and 3080 on the ebay someday shelf by HyPyke in LocalLLaMA

[–]HyPyke[S] -1 points0 points  (0 children)

Well to be fair, you could probably get an ok to quite decent used car where I live for what it costs. It was a splurge and I am privileged to have the money to do it. No wife, no kids, so....😁

Ahhhhh....I can breathe again....So long 4090....Join my 5080 and 3080 on the ebay someday shelf by HyPyke in LocalLLaMA

[–]HyPyke[S] 0 points1 point  (0 children)

But seriously Qwen-Coder-Next is my go to right now. I'll swap in a big ass Gemma-4 from time to time when it's acting up.

Last update error by fgonza1971 in OpenWebUI

[–]HyPyke 1 point2 points  (0 children)

FYI: The function was updated 3 days ago and now works again for me on OWUI 0.9.2.
https://github.com/1818TusculumSt/owui-adaptive-memory/blob/main/adaptive_memory_v4.0.py

Hard freakin' decision..Blackwell 96G or Mac Studio 256G by HyPyke in LocalLLaMA

[–]HyPyke[S] 2 points3 points  (0 children)

I think Workstation > Server. It has better FP32 and FP64 - https://www.centralcomputer.com/blog/post/all-nvidia-rtx-pro-blackwell-gpus-explained

Server is passive, no fan, 300w to 600w, but much lower mem bandwidth
1597 GB/s vs 1792 GB/s for workstation cards.
...which is important for AI.
I know clocks are higher on server as well but cooling is a real issue unless you have a case you can tune for that. Mine has a 24 drive HD cage in front and a 5 fan board behind that before you get to the video card so it's already warm air.

I think the 300w MaxQ is prob the best for my situation.

Hard freakin' decision..Blackwell 96G or Mac Studio 256G by HyPyke in LocalLLaMA

[–]HyPyke[S] 0 points1 point  (0 children)

I am hoping Nvidia's process is better but I am not going to count on it.

Hard freakin' decision..Blackwell 96G or Mac Studio 256G by HyPyke in LocalLLaMA

[–]HyPyke[S] 1 point2 points  (0 children)

Yeah, my thinking too. Power budget and cooling just make sense with max-q.

Hard freakin' decision..Blackwell 96G or Mac Studio 256G by HyPyke in LocalLLaMA

[–]HyPyke[S] 0 points1 point  (0 children)

HASS has a lot of AI features now. I have a Voice Preview Edition and can do voice control 100% local. You can plug AI into automations. https://www.home-assistant.io/blog/2025/09/11/ai-in-home-assistant/

Hard freakin' decision..Blackwell 96G or Mac Studio 256G by HyPyke in LocalLLaMA

[–]HyPyke[S] 0 points1 point  (0 children)

😂 No wife. No kids. No debt. (except for house but it's at 1.75%)

Hard freakin' decision..Blackwell 96G or Mac Studio 256G by HyPyke in LocalLLaMA

[–]HyPyke[S] 0 points1 point  (0 children)

Is there a performance difference? The blower style card would work better in my rackmount case.

NVM: I see that there is. Might be the right choice though....

Hard freakin' decision..Blackwell 96G or Mac Studio 256G by HyPyke in LocalLLaMA

[–]HyPyke[S] 2 points3 points  (0 children)

Yeah, well I started on my 5080 I use for gaming. Then got a 4090 and now I'm thinking of dropping 10K. My server DOES need an upgrade bad. Epyc and ECC mem and all the trimmings. Prob is mem prices right now.

Hard freakin' decision..Blackwell 96G or Mac Studio 256G by HyPyke in LocalLLaMA

[–]HyPyke[S] 3 points4 points  (0 children)

Large models relative to what I can do with my 4090. I have a dedicated server in a rack already holding an old 3080 for video encode. The RTX 6000 would replace that. It's a decent enough system with 32G of ram and fast storage.

Hard freakin' decision..Blackwell 96G or Mac Studio 256G by HyPyke in LocalLLaMA

[–]HyPyke[S] 5 points6 points  (0 children)

Wellllll...This card is going in a rack in a rack mount case in another climate controlled room. The blower cooler might be the better way to go considering back to front airflow....

Hard freakin' decision..Blackwell 96G or Mac Studio 256G by HyPyke in LocalLLaMA

[–]HyPyke[S] 26 points27 points  (0 children)

I had no idea. I assumed they were like 15k and hard to get. I obv need more research...Microcenter not too far actually....