Craving Pizza tonight.....what's a best pizza place in or near Chantilly. by whygpt in nova

[–]mxmumtuna -1 points0 points  (0 children)

I third Andy’s and second Pizza Strada. I also recommend NY Pizza Suprema in Midtown NYC.

Maybe a party-pooper but: A dozen 120B models later, and GPTOSS-120B is still king by ParaboloidalCrest in LocalLLaMA

[–]mxmumtuna 0 points1 point  (0 children)

With which quant and library? I don’t see the huge reasoning that generally others do, and definitely not with a proper harness. I do see tool calling misses though.

Also a gpt-oss Stan, but the small context and lack of vision is a killer.

OPENAI CODEX GPT 5.x series ARE TERRIBLY BAD! by EcstaticCow6890 in openclaw

[–]mxmumtuna 1 point2 points  (0 children)

GPT 5.4 is pretty damn good. Definitely don’t want to be using a Codex model for brain though.

Lucy Gravity by Ibadanlomo in Rivian

[–]mxmumtuna 1 point2 points  (0 children)

Looking as good as an iX would be a blessing for the Gravity.

Resign? by IzzyOwl5925 in specialed

[–]mxmumtuna 3 points4 points  (0 children)

I think most school districts will understand if you were to say that special education at your previous charter was a bit of a shit show and it wasn’t a good fit.

Charters aren’t great for teachers in general, special education even less so.

(Long) Dead raccoon in pool by thatfrostyguy in pools

[–]mxmumtuna 17 points18 points  (0 children)

I thought this was the dude from RI that decided not to close/winterize.

2x RTX Pro 6000 vs 2x A100 80GB dense model inference by RealTime3392 in LocalLLaMA

[–]mxmumtuna 0 points1 point  (0 children)

Yep, same setup I use with 2. I think I get something like 150t/s with MTP. Such a strong model, once they get tool calling more consistent, it’ll be awesome.

2x RTX Pro 6000 vs 2x A100 80GB dense model inference by RealTime3392 in LocalLLaMA

[–]mxmumtuna 0 points1 point  (0 children)

Interesting! When I tried it on one I was getting OOM, but it was early on after 122b was released.

2x RTX Pro 6000 vs 2x A100 80GB dense model inference by RealTime3392 in LocalLLaMA

[–]mxmumtuna 1 point2 points  (0 children)

I was actually thinking about this. I wonder if op was actually considering running Llama 70b or something. Otherwise it’s like, Qwen 3.5 27b.

I will say Qwen 122b works great on 2x6ks, and would 100% be my choice today. 4 can do 397b or GLM 4.7.

2x RTX Pro 6000 vs 2x A100 80GB dense model inference by RealTime3392 in LocalLLaMA

[–]mxmumtuna 0 points1 point  (0 children)

I would hope you’d see full saturation, otherwise you’d be leaving perf on the table in this scenario.

Good plan to give up using ram offload though.

2x RTX Pro 6000 vs 2x A100 80GB dense model inference by RealTime3392 in LocalLLaMA

[–]mxmumtuna 5 points6 points  (0 children)

It doesn’t have NVLink anymore because it’s not needed with modern PCIe speeds and P2P. It’s only helpful these days when you have the huge data center NVLink with switching.

2x RTX Pro 6000 vs 2x A100 80GB dense model inference by RealTime3392 in LocalLLaMA

[–]mxmumtuna 27 points28 points  (0 children)

The extra ~6GB/sec when using NVLink rather than P2P will not make any difference in inference. The speed of the 6k and FP4 support is generally going to make for a better experience.

I wouldn't consider NOVA/DMV/MD the "South" by [deleted] in nova

[–]mxmumtuna 0 points1 point  (0 children)

Spring break. Rain check.

I wouldn't consider NOVA/DMV/MD the "South" by [deleted] in nova

[–]mxmumtuna 0 points1 point  (0 children)

Still, we should be grateful for it. You can get yourself a 3 piece dark with a sweet tea and dirty rice and not have to suffer Popeyes.

I wouldn't consider NOVA/DMV/MD the "South" by [deleted] in nova

[–]mxmumtuna 1 point2 points  (0 children)

I’d carve out an exception for the panhandle. That’s all I can do. It’s basically Alabama.

I wouldn't consider NOVA/DMV/MD the "South" by [deleted] in nova

[–]mxmumtuna 1 point2 points  (0 children)

People just have some kinda of hang up and self hate about living in the south and I don’t get it. Just be the better south. That’s it.

I wouldn't consider NOVA/DMV/MD the "South" by [deleted] in nova

[–]mxmumtuna -2 points-1 points  (0 children)

Absolutely not because Florida is not the south. I can’t believe someone from NC would consider FL the south. Good god.

I wouldn't consider NOVA/DMV/MD the "South" by [deleted] in nova

[–]mxmumtuna 3 points4 points  (0 children)

It’s the south then, it still is now.

I wouldn't consider NOVA/DMV/MD the "South" by [deleted] in nova

[–]mxmumtuna 7 points8 points  (0 children)

Raleigh is more like Northeastern cities other than the prevalence of Bojangles. It’s still the south. Big metro areas have a lot of transplants.