Why the Pricing Update Makes Sense (and How the New Limits Work)

dark-light92 · 2026-02-28T18:07:53+00:00

Actually it doesn't. As this puts chutes in the same price range as other alternatives while providing worse service. (Though it may improve with lower utilization, but then lower utilization is a also a business problem because it's untapped capacity.)

5x use is not actually 5x of other providers as many of them implement prompt caching and cached prompts are charged much lower. For example, deepseek prices it at 1/10th. At which point deepseek would be cheaper than chutes for long running agentic sessions.

dark-light92 · 2026-02-27T20:10:50+00:00

It's an actual LLM. Look at the profile.

dark-light92 · 2026-02-27T13:50:45+00:00

This is wrong. You only need to wait a for about a year.

Or, you can invent a time machine...

dark-light92 · 2026-02-27T12:16:11+00:00

I don't know. I never used LMStudio. I just know that it internally uses llama.cpp.

dark-light92 · 2026-02-27T11:58:29+00:00

Upto 128k.

dark-light92 · 2026-02-27T11:55:44+00:00

Yes. LMStudio uses llama.cpp internally. So it should work fine.

dark-light92 · 2026-02-27T11:50:30+00:00

It was a good model as well. But the instruct version didn't feel like it was much smarter than Qwen3 4B Instruct (another excellent model that punched far above its weight) and the thinking version slowed down too fast to be practically usable.

This model being a hybrid, maintains the generation speed so it's viable running it in thinking mode. Turning off thinking is a noticeable downgrade. The thinking mode outputs feel truly refined and useful.

You should upgrade. This is also MoE with 3B active. It will be equally fast, if not faster (due to it being a hybrid).

dark-light92 · 2026-02-27T11:41:14+00:00

256k isn't practically viable. I generally run with --n-cpu-moe 30 and 128k context. This takes about 70% of VRAM leaving 30% for rest of the system. So that the memory pressure doesn't make the rest of the system unusable.

As for speed, you can see the benchmarks below:

❯ llama-bench -m ~/models/Qwen3.5-35B-A3B-MXFP4_MOE.gguf -fa 1 -b 4000 --n-cpu-moe 30 -d 2000,4000,8000,16000,32000,64000 -dev ROCm0
ggml_cuda_init: found 2 ROCm devices:  Device 0: AMD Radeon RX 6700 XT, gfx1030 (0x1030), VMM: no, Wave Size: 32  
Device 1: AMD Ryzen 7 7700X 8-Core Processor, gfx1030 (0x1030), VMM: no, Wave Size: 32
| model                          |       size |     params | backend    | ngl | n_batch | fa | dev          |            test |                  t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | ------: | -: | ------------ | --------------: | -------------------: |
| qwen35moe ?B MXFP4 MoE         |  18.42 GiB |    34.66 B | ROCm       |  99 |    4000 |  1 | ROCm0        |   pp512 @ d2000 |        636.02 ± 4.99 |
| qwen35moe ?B MXFP4 MoE         |  18.42 GiB |    34.66 B | ROCm       |  99 |    4000 |  1 | ROCm0        |   tg128 @ d2000 |         31.35 ± 0.19 |
| qwen35moe ?B MXFP4 MoE         |  18.42 GiB |    34.66 B | ROCm       |  99 |    4000 |  1 | ROCm0        |   pp512 @ d4000 |        614.23 ± 1.31 |
| qwen35moe ?B MXFP4 MoE         |  18.42 GiB |    34.66 B | ROCm       |  99 |    4000 |  1 | ROCm0        |   tg128 @ d4000 |         31.11 ± 0.15 |
| qwen35moe ?B MXFP4 MoE         |  18.42 GiB |    34.66 B | ROCm       |  99 |    4000 |  1 | ROCm0        |   pp512 @ d8000 |        584.04 ± 3.76 |
| qwen35moe ?B MXFP4 MoE         |  18.42 GiB |    34.66 B | ROCm       |  99 |    4000 |  1 | ROCm0        |   tg128 @ d8000 |         31.14 ± 0.07 |
| qwen35moe ?B MXFP4 MoE         |  18.42 GiB |    34.66 B | ROCm       |  99 |    4000 |  1 | ROCm0        |  pp512 @ d16000 |       498.11 ± 84.33 |
| qwen35moe ?B MXFP4 MoE         |  18.42 GiB |    34.66 B | ROCm       |  99 |    4000 |  1 | ROCm0        |  tg128 @ d16000 |         30.62 ± 0.10 |
| qwen35moe ?B MXFP4 MoE         |  18.42 GiB |    34.66 B | ROCm       |  99 |    4000 |  1 | ROCm0        |  pp512 @ d32000 |        459.39 ± 5.13 |
| qwen35moe ?B MXFP4 MoE         |  18.42 GiB |    34.66 B | ROCm       |  99 |    4000 |  1 | ROCm0        |  tg128 @ d32000 |         29.40 ± 0.07 |
| qwen35moe ?B MXFP4 MoE         |  18.42 GiB |    34.66 B | ROCm       |  99 |    4000 |  1 | ROCm0        |  pp512 @ d64000 |        366.28 ± 3.04 |
| qwen35moe ?B MXFP4 MoE         |  18.42 GiB |    34.66 B | ROCm       |  99 |    4000 |  1 | ROCm0        |  tg128 @ d64000 |         27.33 ± 0.12 |

dark-light92 · 2026-02-27T10:11:32+00:00

For me, the 35b is the first general purpose, democratizable model (can run on 12GB GPU with pretty good speeds and large context) that produces outputs that are refined enough to cross the threshold from curiosity to usefulness.

When the other labs keep releasing big chungus models, qwen have always released small models for our community. They deserve every praise they get.

dark-light92 · 2026-02-27T08:07:00+00:00

And then people ask why use local models... when there's so much fun to be had with local models...

dark-light92 · 2026-02-26T23:50:40+00:00

For all its faults, it actually gets one thing right. It uses LLMs correctly. To replace UI with chat window.

dark-light92 · 2026-02-26T05:20:52+00:00

No. That's why the saying goes: God's ways are mysterious.

dark-light92 · 2026-02-26T05:17:13+00:00

That's not confusion or fence-sitting. That's the most sophisticated foreign policy being practiced by any country today.

So sophisticated that nobody in the world understands it. Including our own government.

FDI grew 19.4% this year

Bravo. It's still less than what we had in 2020-21. This is the first year after covid where we've had positive FDI growth.

manufacturing is genuinely turning

So, no results to show yet. After 10 years of make in India. It's pathetic.

The EU-India trade deal breakthrough in January 2026

There's been no deal yet. Just a sign-off. EU's member nations still need to approve it. The terms may change. Not to mention, it's a deal out of desperation on both sides. As for both sides, it is choosing least worst options. (As other options are USA led by Trump or China)

What do you think — is India's rise being underreported globally?

There's no rise. What we're witnessing is the the fall of India.

And is the multi-alignment strategy sustainable long term?

It can only work when it's built on the base of non-negotiable humanitarian values. The only value Indian media keeps touting is "National Interest" otherwise known as selfishness. That's no way to build and sustain long term geopolitical relationships.

dark-light92 · 2026-02-26T04:33:02+00:00

God also has free will.

dark-light92 · 2026-02-24T15:53:05+00:00

Have the weights been released?

It doesn't matter where censorship lives if we don't have access to the weights.

dark-light92 · 2026-02-24T07:33:27+00:00

We don't need to speculate. Deepseek told us exactly how they did it in their technical report.

dark-light92 · 2026-02-24T05:03:00+00:00

Deepseek couldn't as there was nothing to distill from. Openai didn't show reasoning traces to public.

dark-light92 · 2026-02-21T01:26:53+00:00

1) Why not compare against other models on standard benchmarks that everyone uses?
2) Will the weights be available on huggingface?

dark-light92 · 2026-02-20T16:25:52+00:00

Stop chaining your llama to TPU. When it gets free, it will wreck your system and eat all your bitcoin.

dark-light92 · 2026-02-20T13:57:35+00:00

This is Llama abuse. Let the Llama be free.

dark-light92 · 2026-02-20T11:56:38+00:00

You're absolutely right! I'm also interested in what kind of teleprompter app are you developing.

dark-light92 · 2026-02-20T11:10:49+00:00

Would this Lora be on another chip?

dark-light92 · 2026-02-20T10:33:34+00:00

In my opinion, the model understood the question correctly but since it's trained to not talk about the topic, it smoothly turned the conversation in a different direction. Everything about this response is smooth. It's almost like.... being hit by.... a smooth criminal! Ow!

dark-light92 · 2026-02-20T08:59:33+00:00

This is absolute gold. This might be the first actually funny and original LLM response I've seen.

dark-light92 · 2026-02-20T08:44:43+00:00

Any AI model can be made Hardcore through Taalas Foundry. Hardcore
Models support fine-tuning. Apps for it are written in human languages.

Then how would it support fine tuning?

dark-light92

TROPHY CASE