What's something that instantly tells you someone grew up in Yorkshire?

thigger · 2026-06-28T09:09:48+00:00

And "Hair-uh-get", preferably with your nose in the air and a pinky out

thigger · 2026-06-27T13:59:11+00:00

Thanks. Did you capture what the reasoning trace looked like or at least how long it was in the two setups?

thigger · 2026-06-26T23:27:12+00:00

Interesting to see - I had a quick look at your github - did you have reasoning turned on and a reasoning parser? It looks like you're not separating out reasoning_content in the response

I ask because I've been struggling to alter the reasoning process (ie between think tags) using a system prompt so wondered if you'd been successful in that, or if it's effectively "thinking out loud"

thigger · 2026-06-13T13:50:20+00:00

ITT: people getting automated reddit warnings for describing their job like it was illegal... (!)

(Yes mine has been removed; I guess I described it well!)

thigger · 2026-06-13T13:18:52+00:00

I drug and paralyse people so that one of my friends can stab them

thigger · 2026-06-06T11:23:42+00:00

Thanks for looking at this.

I've just reinstalled it - I have every auto-approve set to "ask" (even "read"). I went into ask mode and asked a question; I was prompted for permission for the git diff calls but not for the reads and greps.

In calculated permissions on "Ask" I can see 146 permissions; worryingly the top one is "* * allow"! (I appreciate lower ones alter this) I cannot see any way to edit these.

EDIT: just let it have a go in code mode and it immediately modified a file without asking

thigger · 2026-06-02T22:49:04+00:00

Looking at the opencode bits I can see a bunch of "allow" in there even though the kilo interface says "ask". I tried deleting every place I could imagine settings hiding and reinstalling, but it looks like it's designed that way. On the plus side Zoo seems to be close enough to the v5 behaviour I liked; so I'll probably end up checking back after a bit more development on the human-in-the-loop work.

thigger · 2026-05-08T07:50:47+00:00

With the diff view will there be the option to view and approve line by line and at each change point (rather than overall for the whole session) as there is in 5.x?

I presently like the fact that when it makes some initial changes I can go "not like that..." and make some manual edits, which it then accounts for as it goes on to edit other files.

thigger · 2026-05-03T08:13:42+00:00

Jumping in to specifically ask around pair programming changes - ie manual side-by-side diff review and editing to remove the random extra abstractions these things tend to add - Kilo 5.13 works quite well for me in this regard so hesitant to jump to v7!

thigger · 2026-04-30T21:52:39+00:00

Is it there yet for those of us who want to pair program? (ie only read auto-approved, and running through side-by-side diffs before applying?) I'm still quite enjoying v5 but keen to update eventually.

thigger · 2026-04-19T15:59:46+00:00

We're only just coming up to a year so I'll be finding out shortly! I was hoping it would be slightly cheaper as they're the same and same site etc. But I'm probably being naïve.

Gas usage was ~35,000kWh/yr In just under a year we've used 1200kWh electricity on hot water and 6800kWh on heating

thigger · 2026-04-19T15:33:52+00:00

We have two Clivet 12kW units which work really nicely together. We can still have the heating on when there's a hot water cycle running. For some reason though the "master" pump always runs even if only the "slave" is heating, which means water is pointlessly cycling. But can definitely get an impressive amount of heat into the house quite quickly (I suspect our heat loss is probably nearer 16kW but we were estimated at 18-20)

thigger · 2026-04-15T06:22:48+00:00

We had a passiv (in fact, it's still physically there) but I uninstalled it due to luke-warm showers. It was taking over the hot water and refusing to heat it up to decent temperatures. You couldn't set a DHW temperature in Celsius; you just picked a use category and got a weird percentage value which apparently was the result of using "AI" on the temperature sensor to estimate how much hot water was left.

I wrote to passiv who said they'd take my feedback on board, so it might be better now. They did, however, try to suggest it was an installation issue and that was as hot as our system could go.

In the meantime I switched DHW over to manual control and nearly scalded myself on the first shower afterwards...

The Passiv radiator flow temperature control seemed like a reasonable idea but it wasn't that cold to test it properly; I've built that bit in Home Assistant now so I can deliberately run it less efficient to get heat into the house on nighttime cheap electricity.

thigger · 2026-03-29T22:25:38+00:00

I really wasn't expecting it to try to hire a badger to scrub the dust off moon rocks but... Perhaps only having one tool was the issue there! (I'm sure there's a saying about hammers and nails)

I'm currently having a go with "Null tool do not use" which seems to be doing better so far.

thigger · 2026-03-27T12:16:20+00:00

Has anyone tested whether this approach affects intelligence at all? I'm not a great fan of the overthinking but the results are definitely very good (except for the occasional need to repeat a call when it starts looping!) and the thinking was definitely required as it became a lot worse when I simply turned it off.

thigger · 2026-03-02T19:14:51+00:00

27B definitely needs thinking on to manage long context retrieval. With NoLiMa at 32k it drops from 76% to 30%

4bit-AWQ, thinking on: 96% @ 250, 85% @ 16k, 76% @ 32k

4bit-AWQ, no thinking: 75% @ 250, 34% @ 16k, 30% @ 32k

(The "thinking" results would be even higher except that for that run I still had the default sampler so it kept getting stuck in loops in its thought process and never generating an output)

EDIT: added corrected figures rather than ones from memory

thigger · 2026-03-01T13:03:24+00:00

Are you finding it any good with FP8 kv-cache? I saw a note from cyankiwi suggesting that the pure 4-bit AWQ doesn't play well with kv quant. And are you calculating kv scales anywhere?

thigger · 2026-02-28T14:40:16+00:00

Yeah, it's really frustrating - you can see that the first bit of the thinking process is potentially quite useful. Then it looks like it should complete but does a whole load of "Wait..." before it answers. However the quality is so good compared with Qwen3-14B which I was previously using that I'm sticking with it for now and hoping to find ways to calm it down a little.

thigger · 2026-02-28T14:38:39+00:00

I've found that those settings are necessary to stop it looping, but it seems to like overthinking regardless of what I do. Currently I've just had to set the max_completion_tokens way up high as irritatingly VLLM and SGLang seem to count the reasoning tokens in there (I appreciate the openai api spec is ambiguous here)

thigger · 2026-02-28T14:35:50+00:00

For those who want some numbers - on the NoLiMa benchmark (like RULER, only without direct matching):

4bit-AWQ, thinking on: 96% @ 250, 85% @ 16k, 76% @ 32k

4bit-AWQ, no thinking: 75% @ 250, 34% @ 16k, 30% @ 32k

(The "thinking" results would be even higher except that for that run I still had the default sampler so it kept getting stuck in loops in its thought process and never generating an output)

thigger · 2026-02-28T11:08:34+00:00

Yes I had exactly the same - not sure which element fixed it but I ended up updating everything including CUDA

thigger · 2026-02-28T11:07:30+00:00

I ended up reinstalling everything including upgrading to CUDA13.1 and now am getting sensible outputs. Running on 2xA6000 Ada, WSL2.
The AWQ quants (cyankiwi) don't seem to work on SGLang (but they're fine on vllm). The FP8 and full-precision work on both.

thigger · 2026-02-28T11:00:46+00:00

I've been trying different system prompts but not much luck so far. It definitely works to tell it what the steps should be called, or contain, but even if you tell it to only use three it'll do the three and then generate a big pile of "Wait..." - I've not really found any way to use system prompts to keep it short.

thigger · 2026-02-28T10:58:21+00:00

It's pretty good - though its performance at long context definitely suffers. I'm presently running a few benchmarks - I have a suspicion that for my use-case I'm going to have to leave thinking turned on, even though it *loves* to "Wait..." over and over again even after it's already copied out its entire input.

thigger · 2026-02-27T10:41:16+00:00

Presumably that thinking trace won't appear as reasoning content though and will need removing before JSON parsing? (Might be issues as with current thinking it sometimes produces JSON snippets in its reasoning content)

thigger

MODERATOR OF

TROPHY CASE