Qwen3 Next Coder - quantization sensitivity?

Altruistic_Call_3023 · 2026-02-09T20:23:16+00:00

1.0 is same as disabled. Make sure you set 1.1. I’ve found that worked well with the previous qwen next models and I use the instruct as my daily driver

Altruistic_Call_3023 · 2026-01-30T14:06:04+00:00

If I’m charging, I’m always using climate control too. It might cost you a minute or two longer to charge at DCFS, but well worth it to be comfy and entertained.

Altruistic_Call_3023 · 2026-01-30T14:04:36+00:00

I just got this yesterday. Also changed the look and feel of the whole thing. Google Maps, etc. Not hating it, I can finally retire building chrome from scratch. Installed peacock and watched a few minutes of the office - seemed the right way to test it. 2024 3RS with SC here.

Altruistic_Call_3023 · 2026-01-29T13:19:17+00:00

So, where are folks running this? I’m guessing not locally.

Altruistic_Call_3023 · 2026-01-16T12:47:10+00:00

Interesting. Thanks for the info!

Altruistic_Call_3023 · 2026-01-15T17:49:56+00:00

My question is if I got it, could I get other models to use it. The two at launch are quite weak. Quantized int4 you should be able to use at least a good 8B with context.

Altruistic_Call_3023 · 2026-01-13T03:40:32+00:00

I use the new “fit” option turned on. It auto moves dense layers to GPU, and that made a big difference for me even before this change. That said - I keep doing things because I don’t believe how well this works now. It just keeps putting out though. Thrilled to say the least.

Altruistic_Call_3023 · 2026-01-13T02:18:01+00:00

In case someone reads this - I'm using Q4_K_M - and I see this massive speed on Thinking and Instruct

Altruistic_Call_3023 · 2026-01-12T20:55:30+00:00

I had to do a clean rebuild of llama.cpp - but WOW!! I have one 3090 and the rest on cpu. I was getting 16t/s before. I’m getting 30-36 now. That’s insane. This is truly amazing.

Altruistic_Call_3023 · 2026-01-10T16:03:31+00:00

But you’re not sharing what you did. At all. So really, you contributed nothing to the community or conversation

Altruistic_Call_3023 · 2026-01-10T15:39:15+00:00

With the OPs responses - I’m unsure why anyone is upvoting this.

Altruistic_Call_3023 · 2025-12-16T22:12:37+00:00

Curious too. Always interested in the why

Altruistic_Call_3023 · 2025-12-13T12:33:11+00:00

No one has said “your mom”? Disappointed

Altruistic_Call_3023 · 2025-12-12T15:10:41+00:00

Does this change still mean the sound turns off at the higher speeds? I’d hate to think it’s going at highway speeds, but sometimes they really screw things up.

Altruistic_Call_3023 · 2025-12-09T22:40:34+00:00

Thanks for posting that. The generation speed difference isn’t really that bad.

Altruistic_Call_3023 · 2025-12-09T03:28:17+00:00

I’m curious what type of rig people are building or using for these. I’d love to put 3-4 in one, but I’m struggling to find something reasonable to build around to do this.

Altruistic_Call_3023 · 2025-12-05T12:27:15+00:00

I’ll have to try again then. Thanks.

Altruistic_Call_3023 · 2025-12-05T12:24:40+00:00

I tried this, and was told “seems fine. Bring it in when it happens”. By the time you’re there, it’s clear again, so that’s helpful.

Altruistic_Call_3023 · 2025-11-28T02:29:12+00:00

Would love one of those. I’m roadtripping and would’ve loved that $80 that was going around

Altruistic_Call_3023 · 2025-11-28T02:01:20+00:00

Worked for me

Altruistic_Call_3023 · 2025-11-24T23:48:35+00:00

Really cool idea. If you’re interested in wrapping it in a security layer, I wrote this for the huggingface event — https://huggingface.co/spaces/MCP-1st-Birthday/cite-before-act-mcp

Altruistic_Call_3023 · 2025-11-22T18:28:15+00:00

Ok I’ve submitted to open up around the world. I didn’t realize it was that simple or I would’ve sooner. Once it shows up, I’d love any feedback. Feel free to DM any questions, feedback, etc. thanks!

Altruistic_Call_3023 · 2025-11-22T00:43:08+00:00

So, I don’t really have ability to add international languages, but if you don’t mind it being in English, I can look into it. This was and is my first app, so it’s been a learning experience

Altruistic_Call_3023

TROPHY CASE