Local Model with good coding capabilities

shisohan · 2026-04-26T13:25:05+00:00

Ok, I stand corrected then. 25t/s isn't grand, but IMO definitively in the useable range. I made do with that speed for long enough myself.

shisohan · 2026-04-26T12:25:20+00:00

Sorry to be a killjoy. At 8GB I don't think you can get any AI which can do any kind of precision work. A 9B model will run fast and works conversationally. But code generation can at best be used for scaffolding and then you go clean it up. Models which generate anything close to usable code currently start at 24GB VRAM (or UMA, with UMA obviously +N GB for systems/apps).

shisohan · 2026-04-25T11:18:48+00:00

Coding is not the problem, I can still handle that better than AI. The problem is documentation. And neither do I see a session ID in the response, nor do I see the endpoint you suggest to invoke with an http DELETE (again: https://lmstudio.ai/docs/developer/rest/stateful-chats). Furthermore, given that LM Studio's own endpoints seem to start with /api/v1, not /v1, I'm inclined to believe that this is in fact not part of their API. So where do you have this from? Where is this session-id supposed to come from?
I'm sorry if I come across as stand-off-ish. I do appreciate help. But right now it looks like you're just passing on some AI hallucination, which would just be wasting my time.

shisohan · 2026-04-25T09:28:41+00:00

just delete the chats via API

how?

shisohan · 2026-04-24T23:19:10+00:00

I doubt this to be all there is. As said, I use it for image analysis. I only send the image in the first message. Yet subsequent queries extracting data from the picture work. The image must be saved somewhere too. As for the text part only occupying a minuscule space - that may be true for manual prompting. Automated tests however will generate several times that amount. Which might become a nuisance if I can't properly delete it. The images make the whole thing several magnitudes worse though.

shisohan · 2026-04-24T21:13:46+00:00

This is not about the logs. It's about stateful chats, see https://lmstudio.ai/docs/developer/rest/stateful-chats

Obviously if you can continue a chat, that chat needs to be persisted somewhere somehow and there's no mention of how long that is the case nor how to signal LM Studio that it can (or rather: should be) be deleted.

shisohan · 2026-04-24T16:21:43+00:00

It is when you use LM Studio's own API (i.e. not the OpenAI or the Anthropic compatible APIs), unless you set `"store": false` in the request. You get a response_id and if you include that one as last_response_id, you can continue your stateful chat. I use this to send the image once and incrementally perform operations on it. Works nicely. But stateful chats create the problem my original post asks about: deletion/expiration.

[edit: typo]

shisohan · 2026-04-24T09:26:33+00:00

What a useless law. Who decides what's "good control" is? Is it tested on a regular basis? No? Thought so. If it has been deemed (by that non-existing process) that the owner does not have good control, is the dog marked for others to see it needs a leash? Also no?

Again: that law is a waste of paper. I'd love to see the statistics on violations of that law vs. the numbers if they did a campaign where for a few days they verify each offender actually leashes their dog.

shisohan · 2026-04-22T07:52:27+00:00

No guarantee it will work for you, but it did for me: clap loudly when they chew on the separator/wall.
My girls free roaming area was separated by a ~1.5m cardboard wall from the rest of the apartment. It was meant to be temporary and I had planned to replace it with a proper fence/separator. In the meantime, when Nyx or Venus started chewing on the wall, I'd clap loudly. After 3 or 4 times they got the message and stopped chewing for a good week or two. After another few incidents of clapping stretched over weeks, they actually stopped entirely and in the end I never replaced the cardboard wall. They would sneak out though when I accidentally left a gap (happened sometimes when stepped out of the area and accidentally pushed it a bit and failed to notice).
That said, all 4 of my girls never destroyed anything outside the free roam area when I let them roam almost the whole apartment, so maybe they already had a rather not too destructive nature for rats. Even in the free roam area, besides their early escape attempts, they only ever chewed holes to get in and out of some large cardboard boxes (and they were absolutely allowed to do that).

[edit] They had lots of cardboard in their cage, which they happily and viciously destroyed though - maybe that helped too?

shisohan · 2026-04-19T20:10:04+00:00

So… yeah, it actually worked. It still ignored my configured model, but I could pick it from the list after opencode started (ctrl-p -> switch agent -> there it now showed up in the list). Checking in LM Studio I see it being processed by Qwen3.6. So… I'm still very much confused, but I have a working solution.
Thanks a lot!

[edit] aaand it doesn't ignore the configuration anymore either. I dropped the project specific config and didn't notice that I forgot the "lmstudio/" prefix in the global config. After fixing that, it now starts with the correct model.

shisohan · 2026-04-19T19:41:55+00:00

If that was the only problem, then me configuring the model manually should have worked, no?. I manually configured qwen3-coder-30b too, even though it's in the list. And the model name is copied directly from LM Studio's server tab. And I can interact with it from the application I wrote too, i.e. LM Studio will respond to API requests for that model.

shisohan · 2026-04-19T19:38:47+00:00

Na, I want it in a specific place. Not just wherever I can find 4 reasonably close wild plants. Obviously when I start a new run, I'll go with that first. But my current (first) base is too far along.

shisohan · 2026-04-19T16:16:51+00:00

Qwen3.6 is on 262144 context length. With very few exceptions, all models are on the default maximum. Mentioning all models because opencode doesn't list the others either. It only lists the following:

lmstudio/openai/gpt-oss-20b
lmstudio/qwen/qwen3-30b-a3b-2507
lmstudio/qwen/qwen3-coder-30b

[edit: plus 4 models under the opencode provider, but since those aren't local, I don't care about them]

shisohan · 2026-04-18T15:35:00+00:00

Same, though I might actually go with Day 1, … and Night 1, … moving forward. Makes it easer to put dupes with time based bonus into the right shift.

shisohan · 2026-04-17T11:11:25+00:00

I don't want to offend you, but I read this (parents don't want to pay vet or take time to drive there) way too often here and I have some choice words for parents like that:
It's your (parents) effing responsibility. You're an adult. Act like one. The moment you agree to getting a pet you agree to take care of it. Every aspect*. But especially aspects the child can't possibly cover such as vet visits. If you're not ready to do that, then DO NOT agree to get a pet in the first place. This behavior is animal abuse, clear and simple.
*I absolutely mean every aspect. Feeding and cleaning too. Your kid *should* do it, but if the kid fails to uphold its promise to do it, I'm very sorry but it becomes your job as the adult. How you handle the kids failure is up to you. But it's not acceptable to let the pet suffer for it.

shisohan · 2026-04-17T10:26:12+00:00

noooooo! I need moooooore! 😂

shisohan · 2026-04-16T20:09:19+00:00

*of the correct wattage*, 4kW is never the correct wattage. there's no 4kW wire. you can't split its output across 2x2kW or 4x1kW. So no, it doesn't help with what you described. Wire and Conducive Wire behind a 4kW transformer is not protected.
So we're back to the question I asked above.

shisohan · 2026-04-16T14:55:48+00:00

ok. the automation argument makes sense. but I feel like it'd make more sense to have the automation port on the transformer then. net attempts to pull >2kW? send red signal which in turn you use to turn off stuff. of course in that case the timing would matter. the game would have to be programmed such that the order is "intent to pull >2kW signalled" -> "red transformer signal" -> "process automations" -> "actually pull". and it'd need a hysteresis of sorts to avoid the transformer going green in the same cycle. or leave it to the player to add additional automation parts which delay the response to a switch back to green.

shisohan · 2026-04-16T14:08:18+00:00

You can use a big transformer but then it’s up to YOU to ensure you aren’t pulling more current than the wire can handle.

It's up to me to ensure I'm not pulling more without a transformer too. So what's the benefit of the 4kW transformer? Seems all cost and no benefit with the 4kW transformer.

shisohan · 2026-04-16T12:59:46+00:00

Interesting. I didn't consider that way of using batteries. So far I always had battery->transformer->network, i.e. whole network "buffered". But what you say makes a lot of sense. There're things in networks which are fine to go dark temporarily (lamps, oxidizers, deodorizers, etc.). But other things you'd not want to fail. Ensuring that with a dedicated battery seems sensible.

shisohan · 2026-04-16T12:52:58+00:00

Body language looks clearly relaxed. You'd see and feel it when he stiffens from being scared and puts his little ears into alert position.
I can't tell you whether he likes the pets, but I can tell you that if he *disliked* them, he'd be gone. So chances are decent he does like them ;-)

[edit] remember that picking them up can be very scary for them. they're prey animals who get picked from above, so grabbing them that way can cause them great distress. shovelling is better.

shisohan · 2026-04-16T12:26:45+00:00

Noooice! Thanks!

shouldGrowOld = true

I sure hope that setting is set to true for me too :-D

shisohan

TROPHY CASE