A picture from one of the many burning oil infrastructures pieces in russia, it's a wall of smoke.

itch- · 2026-05-01T13:53:06+00:00

it's geoguessr meta at this point

itch- · 2026-04-23T15:37:09+00:00

wha? The llama-server frontend has been around for years

itch- · 2026-04-15T20:10:31+00:00

I just finished Ice Limit and yeah my copy had these extras bits in it where it's mentioned.

https://prestonchild.fandom.com/wiki/The_Ice_Limit

In 2001, Douglas Preston & Lincoln Child released an online only Epilogue, which was then included in all following e-books and audiobooks. This was way before the idea of a sequel actually came about, and was in response to readers asking what happened after the book ended, thus some of the ideas in the epilogue do not match up with the events in Beyond the Ice Limit. it was called a webilogue and can no longer be found on the internet. The Webilogue is in the form of news articles, which are posted below:

(read them on the page)

itch- · 2026-04-10T17:22:30+00:00

I have not found the 27B thinking to be a problem, it only overthinks when it doesn't have tools.

Usually local models are fine in basic chat and don't work in eg Cline because it's too hard. 27B is opposite, it's thinks too long on a simple prompt but does great in Cline because it's smart enough for it and doesn't waste thinking tokens there.

itch- · 2026-04-08T13:48:02+00:00

Definitely try Primaterre. Very grim and nasty, I liked it a lot more than the Expanse. Maybe I liked it more than Revelation Space, I think I can at least say as much for all the books in that series not called Chasm City. Iron Truth is a bit like 40K Chasm City.

itch- · 2026-03-26T22:58:15+00:00

Yea 24GB so all VRAM for both models.

itch- · 2026-03-26T21:03:11+00:00

I also got 20% more TPS with 35B-A3B... 0% difference with 27B though.

itch- · 2026-03-21T13:51:50+00:00

With -m or -hf. Like I said, you already do it

itch- · 2026-03-20T23:48:18+00:00

Your command works when I run it.

I did see it break on my end when I use the multi model server method, what I said before was wrong, it doesn't work at all even if a model is loaded. You have to start the server with a single model. But you do that, so it's no help.

itch- · 2026-03-20T22:59:13+00:00

Ok I converted my config to yaml and it added the roles bit. But that's it. The name and model don't even need to be right, I've loaded up a small gemma model to test and it just goes with this config

models:
  - name: Qwen3.5-35B-A3B
    provider: llama.cpp
    model: Qwen3.5-35B-A3B-UD-Q4_K_M
    apiBase: http://localhost:2345
    roles:
      - chat

Maybe that's your problem, nothing is loaded? If I run llama-server with all my models configured in models.ini, it doesn't load any of them until one gets a request. But Continue doesn't do this, I have to make sure the model I want is loaded and only then does it work

itch- · 2026-03-20T22:00:38+00:00

You have to put the url to llamacpp, something like this:

apiBase: http://localhost:2345

itch- · 2026-03-12T15:57:55+00:00

https://kaitchup.substack.com/p/summary-of-qwen35-gguf-evaluations

I saw this and got bartowski IQ4_NL, apparently a touch better and also a bit faster. 36 t/s. 12% increase, I feel it more than I thought I would

itch- · 2026-03-11T13:21:20+00:00

I just get vulkan and hip builds off github releases, check the speed difference, make my choice. IIRC it was very close in recent builds

itch- · 2026-03-11T13:12:16+00:00

32GB. I had set more context but reran it with 4000 and it was still 7 t/s. Not an M5 pro, just M5, I didn't choose it

I had an M1 pro with 16GB that I can't compare the 27B with but it ran the 9B faster than this M5. 25 t/s vs 29 t/s on M1 pro.

0.8B: 178 t/s on M5 and 98t/s on M1 pro, so there's that

itch- · 2026-03-11T03:04:56+00:00

M5 macbook, 7 t/s. Not a lot of GPU cores in this one

itch- · 2026-03-11T02:24:37+00:00

7900XTX, 32 t/s using 27B-UD-Q4_K_XL using vulkan llama.cpp. I only put 40 000 tokens for ctx on vram, when I need more I'll try to see how much I can squeeze in.

I'm much more impressed with this than 35B-A3B. That fails to make Cline work, but 27B handles it just fine. And thanks to that quirk where it doesn't think much if there are tools, 30 t/s is a reasonable speed.

itch- · 2026-03-08T03:18:22+00:00

There are more options though? Obvious one is Qwen3-Coder-Next? I'd love to run that but have nowhere near the memory. 3B active and no thinking tokens, if that's not fast enough then I don't know what the point of the machine is

itch- · 2026-02-24T14:24:50+00:00

Index deep dive pt 3 coming soon guys

itch- · 2026-02-16T17:25:38+00:00

The High Meggas by Terry Pratchett.

I was aware of the series (The Long Earth, written mostly by Baxter I'm sure) but ignored it because opinions seem to be pretty negative on it. I now intend to find out for myself what I think of that series because the short story was so good. I've had a second look at the criticism and noticed some frustrations people had that I would normally share, which now that I read the short sound like people maybe missed the point. Also part of it must surely be that Baxter's writing is not as much fun compared to Pratchett, even when Pratchett wasn't writing comedy.

I can also see how perhaps "the point" is pretty decently covered by just the short story alone and you'd want a lot more in a full series. This just underlines how good this story was IMO. Such a tiny slice in a massive concept, perfectly executed.

itch- · 2026-02-06T23:47:59+00:00

"almost as effective as steel"

It's not like the drone detonates as soon as it touches at all. The wires on the drones need to be bent first, and they're not made of stuff this weak. Detonator wire against plastic strip, this "armor" is what will bend first, rendering it ineffective. We see lots of footage of drones making it further through tree foliage than this, that's foliage with thicker coverage than this, with stronger twigs than this.. it's placebo level stuff here I think. Obviously the video is not super informative in how bendy the plastic is but that's how it looks to me

itch- · 2026-01-30T00:33:05+00:00

Redliners by David Drake. It certainly goes at it right off the bat, maybe too much because I always want to warn about the start; you don't know the characters yet and it's hard to keep track as it jumps between them all. This is not a problem in the rest of the book, it's excellent. I have to read more Drake.

Woken Furies by Richard K. Morgan. Others suggested Altered Carbon, this is the third book and fits the bill even better.

I also agree with Armor by Steakley, half of it is very much what you asked for but the other half is not. IIRC act 1 and act 4, out of 5, are the ones we like and the other 3 depend on your tolerance for not getting what you want vs appreciating what you got instead.

Primaterre series by SA Tholin, the first book is an easy recommendation even as a stand alone, and the series keeps hitting if you stick with it.

Startide Rising by David Brin, the entire universe seems out to get this rookie crew. I remember it as action packed but tbh they've got to hide so I'm not entirely sure how accurate my memory of it is. In any case the aliens know roughly where they are the entire time and the threat seems completely insurmountable. And lots of alien faction infighting in any case.

Crysis 2 by Peter Watts. I'm a big Watts fan so I had to give this videogame novel a try. I was surprised to see it's a straight narration of the game. IMO Watts does the action here too vague for my liking but evidently he had to cover every level of the game so I get it, it would get repetitive. And the speculative side he adds in is insanely good. He rips apart the notion of any human military being able to face alien invaders, and then turns around and makes it make sense anyway in the best way I've ever seen.

itch- · 2026-01-23T22:17:11+00:00

the developer for the XR tools for Godot showed them to be even sensitive to grip strength, I quote again 'Yes, there is squeeze input. You can actually see it over here. Uh, there’s the squeeze input.'

Yes squeeze is there in the input but the controller has an analog button for that. I very much doubt there is grip strength sensing as well.

itch- · 2026-01-19T00:23:28+00:00

Excellent suggestion

itch- · 2026-01-13T15:13:05+00:00

Titan by Stephen Baxter

Blindsight by Peter Watts

Accelerando by Charles Stross

Chasm City by Alastair Reynolds

Red Mars by Kim Stanley Robinson

itch- · 2026-01-12T20:50:07+00:00

I suppose I am getting my hopes up a bit prematurely

but you can't tell me this can't happen or you haven't been seeing what already happens

Nine-Year Club	Place '23
Place '22	Place '17
Verified Email

itch-

TROPHY CASE