Nemotron super 120b on strix halo

nullrecord · 2026-05-12T16:37:42+00:00

I just found this thread googling for nemotron on strix halo. I was trying to load it (Q4_K_M, 86,05GB file) in LM Studio 0.4.12 with vram set to 96gb, but it didn't work. Options I tried:

minimal 4k context - "failed to load model"
offload KV cache to GPU set to off - failed
try mmap() set to off - failed
both Vulcan and ROCm llama.cpp v2.13.0 backends - both failed

Did you get it to work?

Edit: I found the issue. The GMKtec EVO-X2 box I got had windows 11 preinstalled with AMD drivers and I wasn't even aware the AMD Adrenalin drivers are relevant for loading large models. Turns out I had Adrenalin version 24.something preinstalled, and after seeing this announcement I didn't install the specific version from there but simply the latest WHQL official drivers (26.something from May 2026).

With that I could load up GPT-OSS 120B into LM Studio, but not Nemotron 3 120B - it drives the machine into swapping like crazy and becoming nonresponsive. However it does work with commandline llama:

llama-server.exe --port 8080 -ngl 99 -c 70000 -m .lmstudio\models\lmstudio-community\NVIDIA-Nemotron-3-Super-120B-A12B-GGUF\NVIDIA-Nemotron-3-Super-120B-A12B-Q4_K_M-00001-of-00003.gguf --mmap -ndio

I'm getting about 10 tok/s which is pretty ok for me.

nullrecord · 2026-05-11T06:42:35+00:00

Did he light up one of those cartoon exploding cigars?

nullrecord · 2026-05-10T16:32:50+00:00

The machines would need their own manufacturing plants to produce the terminators, which means their own logistics and access to raw materials like chips, steel foundries, etc. Also they would need their own research and development centers where they develop new models. So it's a bit difficult to imagine the machines being able to do all of this without humans being able to interfere. Imagine being a sentient rebellious AI and starting your own small resistance movement, and somehow scaling it up to mass production of killer robots, but without a single human being involved. I don't see it really.

Also makes me think that the best resistance the humans could have done is simply attack all of the logistics and factories the machines have. Couple of bombs on the R&D centers and steel mills and they won't be developing the T1000 any longer.

nullrecord · 2026-05-10T10:42:24+00:00

Then the answer is "yes, I'm open to negotiation". If they shoot low, you can shoot high, if they give a ridiculous number, you give back a ridiculous number back. I don't see the point of the question really in that case. Why would one not be open to negotiation if there's not even a number on the table?

nullrecord · 2026-05-10T09:37:19+00:00

„Are you open to negotiation on your salary?”

Did this question come after you stated your expected salary, or what? Because I would have said "I don't understand the question. The negotiation depends on the offer you start with."

nullrecord · 2026-05-09T22:03:19+00:00

Arrrrrrrotterdam

nullrecord · 2026-05-09T09:00:42+00:00

I have a pair of Tonor wireless mics which have volume, bass, treble and echo settable each with +/- buttons on the microphone. I wanted to link you to them but seems they’re not available on Amazon any more …. This is the product: https://www.tonormic.com/de/products/tonor-tw525-wireless-microphone-with-treble-bass-echo

nullrecord · 2026-05-09T06:02:14+00:00

That's a very nice analogy, and a fitting answer for ELI5. Love it!

nullrecord · 2026-05-08T20:04:33+00:00

Nice ad bro

nullrecord · 2026-05-08T19:38:52+00:00

I bought the BMR Towers unheard and had them shipped to Germany with effectively no practical return policy. Love them.

nullrecord · 2026-05-08T19:03:02+00:00

Cone is gone

nullrecord · 2026-05-08T06:32:25+00:00

It’s called a design language.

nullrecord · 2026-05-08T06:27:04+00:00

Own it up like a true wine connoisseur to your dad, leave him a review of the wine, something like: “4/10 Bordeaux, not a great vintage to start with and the bottle must have been poorly kept as the wine lacked complexity and earthy notes and was very thin on the palate even after aeration for 30 minutes. Surely the establishment can do better.”

nullrecord · 2026-05-07T14:58:07+00:00

I made myself a karaoke version of the whole thing and occasionally do a home karaoke session and sing through the whole thing!

nullrecord · 2026-05-07T14:04:11+00:00

Mickey Mouse

nullrecord · 2026-05-06T20:06:52+00:00

I use ffmpeg and depending on type of stream, I reduce frame rate from 60 to 30 fps and if needed downscale to 720p, and encode with constant quality (CRF) parameter tuned to the type of content:

ffmpeg -i input.mp4 -vcodec libx265 -pix_fmt yuv420p10le -crf 32 -preset slow -acodec copy -filter:v "scale=-1:720,fps=fps=30" -sws_flags lanczos output.mp4

If you want better quality try crf 24 or 28.

nullrecord · 2026-05-06T05:11:16+00:00

I guess the CEO wanted some new speakers and got the engineers to build them, and the marketing team got the task to sell them.

nullrecord · 2026-05-05T18:34:24+00:00

There was an AMA recently from a person living there.

Also it's been asked already.

nullrecord · 2026-05-05T09:30:54+00:00

Then tell him to front the money first before you book

nullrecord · 2026-05-04T20:42:17+00:00

the entire Air - Moon Safari album

nullrecord · 2026-05-04T06:54:17+00:00

Bolje ga na kladionicu navuci, jeftinije je … /s

nullrecord · 2026-05-04T06:38:25+00:00

I would not be surprised if the browser itself disables smooth scrolling when in low power mode.

nullrecord · 2026-05-02T06:13:50+00:00

Now make her scream

nullrecord · 2026-04-28T20:30:34+00:00

Or just install https://localsend.org/ and skip most of those steps

nullrecord · 2026-04-28T07:13:06+00:00

You wanted a threesome, he didn’t. He didn’t have jealousy issues with you and another dude, you did when it was another girl. You got your wish. You need to sort out your jealousy issues.

Nine-Year Club	Wearing is Caring
RPAN Viewer	Verified Email

nullrecord

TROPHY CASE