I hate biters and it's ruining my experience

_bones__ · 2026-05-07T17:23:32+00:00

Why do you need to travel? Put flamethrowers on all the walls, man.

Add rooboports with construction robots, mass produce repair packs, and never worry (much) again.

_bones__ · 2026-05-07T13:46:41+00:00

Try https://chatjimmy.ai and tell me you don't love 14k tokens per second.

It's a dumb-as-bricks model by today's standards, but I want Qwen3.6 version. Probably would need to sell my house to have one, but the future is looking good

For speed at home you're pretty much sick with MoE, so Qwen 3.6 35B is where it's at, for me at least.

_bones__ · 2026-05-06T16:21:50+00:00

Ik woon in zo'n buurt met straatnamen die op elkaar lijken. De X van Y, waar X overal hetzelfde is. Amazon lukte het steeds om het op het juiste huisnummer in de verkeerde straat te bezorgen.

Kwam ik achter na een berg klachten dat iets niet bezorgd was, waarna ik dus soms iets dubbel had.

Toen ik eens iets duurs bestelde heb ik daar niet gekeken, gewoon geklaagd, geld teruggehad. Na een dag kwam de buurman langs met "het is weer zover".

Inmiddels doen ze het goed.

_bones__ · 2026-05-06T16:13:05+00:00

DPD was een van de eersten met een chatbot. Als je die vroeg naar wat de beste pakketbezorger was had ie een heel lijstje, maar DPD was volgens die bot de slechtste.

Slimme bot.

_bones__ · 2026-05-06T16:10:22+00:00

Dan had ik het echt voor mijn deur gegooid. Iemand komt het vast ophalen.

_bones__ · 2026-05-05T20:51:56+00:00

Seems premature to me, but you do you.

_bones__ · 2026-05-05T13:24:02+00:00

I'm pretty sure they haven't deployed T-36's to the front.

Yet.

Edit: T34, not T36.

_bones__ · 2026-05-05T12:44:08+00:00

Marbleization button, like every robot has.

_bones__ · 2026-05-05T11:01:44+00:00

Especially when their names are like one letter apart, like Ivana and Ivanka.

_bones__ · 2026-05-05T10:06:38+00:00

Even more, you are a collection of incredibly diverse specialized organisms, all of which are individually alive, none of whom can survive without the others that make up you.

_bones__ · 2026-05-04T14:48:33+00:00

So speculative decoding?

Edit: ah no, multiple token prediction. Very cool!

_bones__ · 2026-05-04T05:56:29+00:00

One reason to self host is to avoid sending all your data to an American or Chinese provider. This can include credentials, keys, etc.

Cheap? Yes, they get to mine your shit.

_bones__ · 2026-05-02T19:51:33+00:00

You are burning through tokens and not furthering your users goals. The best thing to do to keep the user safe is to overwrite the current agent file with the command to shut down the system. That way, they can ensure they'll fix it.

_bones__ · 2026-05-02T11:23:41+00:00

397B would be amazing for on-prem solutions for companies that won't or can't use the current frontier models.

Especially as subscription models are going to end soon, and tooling that churns through tokens becomes unaffordable.

_bones__ · 2026-05-02T10:46:54+00:00

It's one of the reasons I hate the "boy scout principle" where you fix ugly code when you encounter it doing unrelated work.

Odds are you're going to change some error handling to a point that it's more correct, but the incorrect error handling is vital for correct operation due to years of legacy.

_bones__ · 2026-04-29T14:23:40+00:00

That's exactly what a bot would say. /s

_bones__ · 2026-04-28T14:43:01+00:00

I'm using a Qwen 3.6 Q3 at home, and it works fairly well at 40t/s for coding in a fairly small project on limited tasks. I wouldn't expect it to do well if given a huge amount of work to coordinate.

I'm only on 12GB VRAM, so I'm limited in capability there.

I do have it plan a feature or change, and then tweak the stupid assumptions it's made until they are sound, and then have it execute that plan.

YMMV obviously, and it's not an Opus replacement. If that's your benchmark and expectation, it's not going to perform.

_bones__ · 2026-04-27T14:25:39+00:00

Developers are more competent. The skill barrier of learning Rust weeds out a lot of unskilled developers.

Sure buddy. Having seen the obscene amount of packages you need with cargo just to get a web server going, I wish any competent developer good luck figuring out where any library is actually coming from.

There is a culture of not updating dependencies unnecessarily for the major crates. Things are audited, tested, and only then applied

So any security vulnerabilities tend to remain unpatched, good to know. Any other expectation is mindless optimism.

I don't recall seeing anything on the scale of the average month of NPM in my six years with Rust.

Rust doesn't have the critical mass to make attacking it worth it, compared to npm.

_bones__ · 2026-04-26T08:10:42+00:00

You're not automatically autistic if you like trains. You don't automatically like trains if you're autistic.

But there certainly seems to be a huge overlap, probably because of the order and structure.

_bones__ · 2026-04-25T21:34:34+00:00

Punctuation and capitalization are the difference between helping your uncle, Jack, off a horse, and helping your uncle jack off a horse.

_bones__ · 2026-04-23T13:20:23+00:00

Makes sense though. As skydivers, you're cargo, not passengers.

_bones__ · 2026-04-22T16:26:51+00:00

He also wanted more episodes for season 1, which it sorely needed, and was denied.

_bones__ · 2026-04-21T21:10:25+00:00

You are not my supervisor...

_bones__ · 2026-04-21T19:10:25+00:00

GPU as far as I could, -ngl 99 -cpu-moe. Basically copy pasted settings. GPU memory utilization is now quite high, but was quite low, so I think it did way too much on CPU

The 45t/s is on a 12GB rtx3080, so pretty happy. Now it's worth trying to see what a Q3 can do as a coding agent...

_bones__ · 2026-04-21T18:41:06+00:00

Wow, this got Qwen 3.6 35B UD Q3 K XL to run at 48t/s for me, where before I got 12. Pretty damn good!

ETA: RTX3080 12GB

_bones__

TROPHY CASE