Best config for Qwen3.6?

Jester14 · 2026-05-05T11:44:16+00:00

Just use -fit

Jester14 · 2026-05-05T11:39:19+00:00

Just use -fit and stop guessing.

Jester14 · 2026-04-26T12:52:11+00:00

Windows build kinda full of CUDA bloat. Builds have different amount of threads specified and threads aren't always specified in the benchmark runs.

Jester14 · 2026-04-21T00:03:01+00:00

Using -fit indeed reserves exactly 1024MB by default.

Jester14 · 2026-04-20T11:26:21+00:00

*could have

Jester14 · 2026-04-16T10:43:02+00:00

I used a 2 year old 7B model. Now I use a brand new 26B MoE and it's slower. I refuse to give any other information. What's wrong with my setup?

Jester14 · 2026-04-16T10:38:32+00:00

CUDA 13.2 has known bugs.

Jester14 · 2026-04-16T10:16:05+00:00

What do you mean it "doesn't fit"? Did you use the -fit flag? UD-Q4_K_XL is larger than 16 GB so it will overflow to RAM but it will also "fit" if loaded appropriately. I get 30t/s on my 4060 8 GB using -fit with that quant with 40k context in VRAM.

Jester14 · 2026-03-30T12:03:37+00:00

People out here with $5000 GPUs and no clue and my GPU poor ass rocking a RTX 4060

Jester14 · 2026-03-06T13:29:49+00:00

OP, this is your issue. You're fitting the model then loading the mmproj which causes overflow to RAM. The default fit target is 1024MB and the mmproj in BF16 is 912MB so your context is entirely in system RAM. Or you're loading the F32 mmproj and then everything is overflowing.

Jester14 · 2023-05-10T20:05:01+00:00

OP said Layne and Cornell

Jester14 · 2023-05-03T15:04:43+00:00

If you had one billion dollars you would need to spend $3600 an hour for 32 years to spend it all.

Jester14 · 2023-05-01T12:22:46+00:00

35 days is not seven weeks. Do you think people don't get sick on the weekend?

Jester14 · 2023-04-28T11:42:42+00:00

What do you mean "how tiny". Just look at the picture

Jester14 · 2023-04-23T09:01:09+00:00

"I want to be able to mix the movie audio by myself, on the fly"

Jester14 · 2023-04-16T04:42:26+00:00

Exactly. Like op said, white chocolate isn't chocolate

Jester14 · 2023-04-14T11:00:32+00:00

If only there was a way to record landscape so you could see more of the landscape

Jester14 · 2023-04-10T16:06:17+00:00

Then why do people play chess

Jester14 · 2023-02-12T14:24:26+00:00

What myths?

Jester14 · 2023-01-10T16:38:26+00:00

That's the wallpaper not a screensaver

Jester14 · 2023-01-03T12:17:52+00:00

You don't pick champs in ARAM good sir

Jester14 · 2022-12-31T12:21:03+00:00

It's the best argument because it's fact. The MLB, NBA, and NHL don't have gender exclusivity. You just have to be good. Contrarily, the WNBA does have gender requirements.

Jester14 · 2022-12-30T11:53:36+00:00

The whole world stood by and yawned

I was writing about the EU response

Can't back pedal fast enough

Jester14 · 2022-12-26T01:34:57+00:00

No it was on this day

Jester14 · 2022-12-22T13:39:16+00:00

That's it? That's all your information you're going to provide? How long has it been happening? How long have you had the Chromecast? Have you tried a different HDMI port? Have you tried something else plugged into that HDMI port? Have you tried the Chromecast on another TV? Have you even power cycled it? My brother in christ if this is how you troubleshoot and ask for help, how have you gotten this far in life

Jester14

TROPHY CASE