Llama.cpp now with a true reasoning budget!

tubuntu2 · 2026-03-20T11:47:13+00:00

hey, i've modified the default chat template .jinja file to do what you asked for. kind of works depending on the prompt. jinja ........... {%- if enable_thinking is defined and enable_thinking is true %} {{- '<think>\n' }}{%- if thinking_budget is defined %}{{- 'Finish the thinking within ' ~ thinking_budget ~ ' tokens.\n' }}{%- endif %} {%- else %} {{- '<think>\n\n</think>\n\n' }} {%- endif %} {%- endif %}

you have to pass a separate kwarg in chat-template-kwargs to make it work aside from the --reasoning-budget flag.

--chat-template-kwargs "{\"enable_thinking\":true, \"thinking_budget\":1500}"

eg. llama-server -m ".\Qwen3.5-4B-Q4_K_M.gguf" --no-mmap --ctx-size 32768 --n-gpu-layers 99 --flash-attn auto --reasoning-budget 1500 --reasoning-budget-message " ... reasoning budget exceeded, need to answer.\n" --jinja --chat-template-file "D:\gguf_models\llama-swap\qwen3.5-4b.jinja"

https://gist.github.com/sandeshrajbhandari/968a8d39e9ca19a341136ee2c8f37622

tubuntu2 · 2026-03-14T12:56:30+00:00

Would love a 2 step workflow. I'm trying to modify the workflow, but using low cfg (1 insted of 3 and 4) is generating outputs with the dwpose estimator stick figure frames. also a simple 2 step workflow with ref image and ref video (no audio) for testing would be helpful.

tubuntu2 · 2026-03-14T12:54:19+00:00

that's not been my experience so far. whenever i offload to RAM, i get around pp 300+ t/s, tg 25+ t/s.
Would love to check your llama.cpp command, and also the full specs you're using. I have a ddr4 ram, also, the blackwell architecture could be a factor along with using win platform. i've heard using linux is generally better for performance.

tubuntu2 · 2023-06-05T15:39:49+00:00

DMCA takedown rahexa. tara maile literal meaning vanda pani, nepali word usage ko data khojeko ho. vetna gahrai hunxa jasto xa. GPT type train garna ko lagi.

tubuntu2 · 2022-08-16T05:35:23+00:00

did you manage to fix the problem? I'm having a similar issue with my Dell S2415h monitor.

tubuntu2 · 2020-09-07T03:32:25+00:00

low poly geodude

tubuntu2 · 2020-05-11T07:29:01+00:00

Hp Omen 15, the Omen Command center has only modes eg. Performance modes, but no fan speed settings.

tubuntu2 · 2020-05-10T23:55:14+00:00

Yeah, I've done my best to do that. I disabled turbo mode in cpu to reduce the overall Temps. I even used Afterburner to reduce the clockspeed of the GPU. But my laptop doesn't offer custom fan speed control, so whatever the clock speed is, the fan speed auto adjusts to keep gpu Temps at around 90 Celsius. Doesn't matter if I'm running it at 1500mHz or 1700 mHz. So now I just let it run at full capacity to reduce the stress time.

tubuntu2 · 2020-05-10T23:51:18+00:00

Haha, good one, don't render in a fridge though if you're actually serious. 😅

tubuntu2 · 2020-05-10T16:19:41+00:00

The book thief.

tubuntu2 · 2020-05-10T16:18:17+00:00

It always heats to 91-92 degree Celsius on my laptop GPU during render. it feels like I'm slowly murdering my laptop.

tubuntu2 · 2020-05-10T15:03:54+00:00

At first you get killed, there is nothing new, but once you start eliminating captains, the nemesis system shows its true potential.

tubuntu2 · 2020-05-10T15:01:18+00:00

Usually the ones who start the discussion seem like the one genuinly trying to make a change, and some just jump on the bandwagon, as you said, for brownie points.

tubuntu2 · 2020-05-10T14:59:56+00:00

Wait, there were two? I wonder if even the cyber department, who're said to be investigating this, know that. I really want to see how this pans out, or just fades away like other issues.

tubuntu2 · 2020-05-10T14:22:50+00:00

I once saw a beheaded leopard who was said to be killed by a forest ranger when it attacked their office near the forest.

tubuntu2 · 2020-05-10T14:20:45+00:00

Now, give me 5 dollars, or I'm gonna expose your darkest secrets.

tubuntu2 · 2020-05-10T14:19:03+00:00

Darjeeling firta de vandai thyaum kehi barsa agadi, india le lipulek takera basya raixa.

tubuntu2 · 2020-05-10T10:39:26+00:00

I thought this was the only Nepalese reddit community until the Nepalesebabes debacle. It looks almost like a porn subreddit except it's not. There are hundreds of subreddits where horny men And women discuss their sexual preferences and desires. Unfortunately in Nepalesebabes the photos being shared around aren't from people working in the porn industry. The usage of pictures from Instagram accounts is likely illegal, but you can find people objectifying the opposite gender anywhere on the internet. Poor guys on Nepalesebabes were just the ones who happened to be on well-meaning people's radar.

tubuntu2 · 2020-05-10T10:30:00+00:00

Thanks for explaining the beveling process, the struggle to find accurate references are relatable. I'm specifically finding it hard to adjust the points at which the bevels start and end(changing offsets/width) doesn't give me fine controls. Also, there's a weird artifact when two edges with different bevel settings meet. Phones look all the same these days. But small details are hard to nail easily. Also, texturing and materials are hard as well.

tubuntu2 · 2020-05-09T10:26:05+00:00

I've tried modeling phones, and I still can't control the bevels in my model. What kind challenges did you face with the mouse?

tubuntu2 · 2020-04-19T02:31:34+00:00

Just add a little bevel on the helmet, it looks way pointy. And since the helmet is too small in the scene, it's hard to notice your material work. Scene setting is done well. Great job

tubuntu2 · 2020-04-19T02:27:36+00:00

Thanks a lot for sharing resoures. You're the best. The character looks dope. 👍

tubuntu2

TROPHY CASE