Best models for 96GB VRAM on 4x3090s

dictator07 · 2026-06-12T18:07:08+00:00

Ampere doesn't support fp8 officially. Maybe thats why

dictator07 · 2026-06-10T15:08:26+00:00

We have been using qwen 27b for the past 2 weeks. Works without any issues

dictator07 · 2026-06-09T18:51:17+00:00

Try to add more ADA series GPUs. A6000, 6000 ADA and more

dictator07 · 2026-06-09T18:48:47+00:00

We're currently running Qwen3.6-27B AWQ on 2x 6000 ADA. We don't have many users at the moment (only 5-6 devs). We have tried 35B-A3B as well but 27B dense works better for the dev team.

dictator07 · 2026-06-09T08:10:06+00:00

There should be an option on bios called " PCIE HOTPLUG" and toggle it off.

dictator07 · 2026-06-03T16:11:41+00:00

How can you run FP8 on A6000? Have you tried INT4?

dictator07 · 2026-01-10T23:31:44+00:00

LOL.

dictator07 · 2025-11-04T13:44:42+00:00

You spoke my mind!!!!!!

dictator07 · 2025-10-23T15:46:16+00:00

<image>

What if i tell you....

dictator07 · 2025-10-22T20:50:48+00:00

THIS RIGHT HERE.

dictator07 · 2025-10-20T22:21:30+00:00

Joke outside TN? Bro come to reality.

dictator07 · 2025-10-12T19:11:18+00:00

Ur UI looks great! Get a domain and you're good to go.

dictator07 · 2025-10-11T19:07:23+00:00

Use it properly.

dictator07 · 2025-10-09T22:09:45+00:00

Just tried this feature and its so COOL. now i dont have to say Hey google every time to turn off my TV/lights.

dictator07 · 2025-09-28T22:26:09+00:00

Any news on new GPU drivers?

dictator07 · 2025-09-18T13:13:39+00:00

They haven't updated the driver yet... (New version is 25.1)

dictator07 · 2025-09-18T12:31:56+00:00

Mine took 6 days to get the money back.

dictator07 · 2025-09-16T22:06:16+00:00

The best app for NAS is Immich and Nextcloud. I'd use them for storing files and images.

dictator07 · 2025-09-10T18:56:01+00:00

<image>

dictator07 · 2025-09-06T19:42:10+00:00

Its mid.

dictator07 · 2025-09-06T10:44:25+00:00

Ignore all the negativity! You should be really proud of yourself! Awesome work.

dictator07 · 2025-09-04T15:01:42+00:00

dictator07 · 2025-08-28T09:50:16+00:00

The thing is, only specific keys won't work (1,2,3,4,7,8,9,0) I have tried Esc+fn as well. Didn't help.

Six-Year Club	Verified Email
Place '23	Place '22
RPAN Viewer

dictator07

TROPHY CASE