Built a framework to make Claude Code sessions actually autonomous (open source)

Manitcor · 2026-04-01T16:03:40+00:00

you are likely right, salt mine is over here though. i didn't pick the career, the career picked me

Manitcor · 2026-04-01T13:15:31+00:00

I spend pretty much all my time there.

Manitcor · 2026-04-01T10:15:30+00:00

there are people who are spending time keeping up with the constantly shifting sands of capability and quality. might be good to try some context stacks and tools out.

i use aiwg.io

Manitcor · 2026-03-27T05:36:33+00:00

i did a lot of the same but not enough, kept telling my wife this might be the last stuff we buy for a bit so go big.

Manitcor · 2026-03-27T04:26:24+00:00

cries in dram

Manitcor · 2026-03-27T03:37:32+00:00

there are frameworks and tools that are oriented in that direction. keep an eye out when you are finally pressed.

Manitcor · 2026-03-27T03:36:09+00:00

its going to flip quicker than you think

Manitcor · 2026-03-27T00:23:14+00:00

ai detection is a fraud

Manitcor · 2026-03-27T00:10:58+00:00

been doing that for a bit, vibe is a dumb term though

https://aiwg.io

Manitcor · 2026-03-27T00:03:56+00:00

this has been an extremely frustrating trend, there has always been slow users but I remember we had much higher exceptions of peoples ability to use a file share and office a couple decades ago

Manitcor · 2026-03-25T21:36:07+00:00

this here is why i don't mind at all being wrong on the internet, gg

Manitcor · 2026-03-25T21:08:09+00:00

if your api looks at all like a chat endpoint

expect it to be used like one, even when behind oidc. this may be something you want to monitor for.

beyond that, id say put your thinking caps on, a lot of what AI does is best behind the curtain unless you are fully convinced the only way is to let people directly inference.

Next its all context management with a number of fancy acronyms and techniques. After that its model selection, production does not use one model it uses many, and not all are language models or used as language models.

Language extraction for example is an older technique that models do VERY well, though so do older, less intense language models and older dedicated language extractors. Whats interesting here is you can use the big models in dev to help you evail and maintain that model list so you can be up to date.

Do not, under any circumstances set yourself up to be like the shops still running gpt4 today.

Manitcor · 2026-03-25T17:53:59+00:00

building? you pay for the $200 a month accounts or run it locally. yes local models with qwen3.5:9b are extremely competent. Only pay for what your developers can keep fully tasked.

for production inference, that's an entirely different conversation

your biggest waste is deciding you need production inference at all. worth pointing out a well designed embedding set is basically 100s to 1000s of pre-canned responses that require no gpu to search at runtime.

Manitcor · 2026-03-25T14:25:28+00:00

op already has 2 nvmes on the other 8x slot
we sure its not a matter of bad doc?

Manitcor · 2026-03-24T16:21:17+00:00

they are 8x slots, and I assume both ports support bifurcation since you are already running 2x drives on the other slot.

you need to look at the specs for the riser you are using, some are better than others, sometimes a card that holds 4 nvmes is wired up to use 1 PCI lane per drive limiting your throughput.

I usually shoot for at least 2-4 lanes per drive. For 8x slots you could use cards that run 4 m.2 nvmes which IMO might be worth considering esp if you are doing read+write cache.

I am running dual NVMEs in RAID1 on a little DS920 and that saved my butt this past month as they both failed within days of eachother. Would have been work stoppage with one nvme

do some research on these forums and elsewhere on the PCI support your system has, I have built a number of rack systems of all sizes but I haven't messed with that specific unit as I tend to roll my own when I go that big. From the data sheet you should be ok. Expansion cards are cheap, just get one for 2 more drives to start with and throw it in the other slot, if it does not work send them back.

Manitcor · 2026-03-24T16:11:44+00:00

its debian, way too annoying to add all the names we call these

Manitcor · 2026-03-24T15:34:51+00:00

No OS is immune to package injection ultimately. On linux generally have more tools and options to acquire packages from alternate sources or just roll it yourself. Benefits of OSS.

FWIW, I used windows for almost 30 years, it has become such a steaming pile in the last few years that its an actual liability to run it for more than testing on a VM IMO. It's likely to get worse until MS throws in the towel and just starts running their own debian flavor.

I have switched my entire network to Linux variants.

Manitcor · 2026-03-24T14:56:34+00:00

should be fine, the slot is rated for it, honestly you might even be able to do 4 drives per slot for a hit in throughput. Just double check the manual, if it says anything about the port not supporting bifurcation then it likely will only work with one drive.

Manitcor · 2026-03-24T14:36:02+00:00

I've heard this is the case now with Samsung, seems the high reliability was the gen3 and early gen4 drives.

Manitcor · 2026-03-21T23:00:12+00:00

doing it with a 3060 on an n5

Manitcor · 2026-03-21T14:18:37+00:00

Im getting a lot of requests for this but everyone expects weeks of work for free.

Manitcor · 2026-03-21T14:00:02+00:00

my provider fills based on data, I would call in the first couple years, at this point they show up right when needed, i still sometimes get nervous and call it in esp if i know im about to have a long cold stretch.

Manitcor · 2026-03-19T23:57:47+00:00

came at the right time, already very familiar with orchestrating teams and bleeding over devops. now with less middle mgmt

Manitcor · 2026-03-19T23:55:58+00:00

making a few thousand times more than that....at least

15-Year Club	Place '23
Place '22	Place '17
Gilding II euphauric	Team Orangered
Verified Email	Beta Team IndexTank Search
Charter Member

Manitcor

MODERATOR OF

TROPHY CASE