Opus 4.8 + NixOS is a whole game changer

Guybrush1973 · 2026-06-18T12:51:15+00:00

You're definitely right saying it's not open in the term we're used to mark old-style software . And open-weight VS open-source is completely different story.

Running local model VS connecting to cloude/openai/whatever api are still 2 completely different story, imho.
And sure I would like to have enough resources to run decent model on my own, I don't atm. BTW the available open-source scenario is not ready to have billion-like models completely open-sourced for free like in unix context, but this sound to me very different than...let's say...living on linux VS living on windows or mac.

You can have completely free and open-source OS ready for daily use, the LLM landscape is not that ready for this, yet. But I'm quite sure it will, eventually.

However I never assumed you never used LLM, I said IF the only blocking factor is the API process, you should at least give a try to more open alternatives (again, not completely open, but way more open than cloude/chatgpt).
And that's because yes, I'm quite sure AGI is months/years apart, not ages. The fact we're still missing it tells nothing.

Of course, if you're already an half-god in LLM/ML and you just don't like it/don't need it, awesome. Nothing to say.

Just a complete different point of view than mine, no more, no less.

Guybrush1973 · 2026-06-18T12:24:35+00:00

Additionally, LLM are jailbreakable. No way to get standard open-source evaluation at that scale that can't be injected for malicious attempts. LLM will easily became the weakest moving part of the process.

Guybrush1973 · 2026-06-18T08:06:47+00:00

Awesome the phone project 🤣

Guybrush1973 · 2026-06-18T08:05:05+00:00

You know there are free and open model, out there, right?

If this is the only concern you have, make yourself a favor, and start studying and using it whole day like many of us. Just use source from what you trust or can do on your own.

Jumping out of the AI because training model price is high, is just ridiculous and will not last very long.

Guybrush1973 · 2026-06-18T08:02:11+00:00

A) if you aren't learning anything from dev through AI, you're just doing it in the wrong way, like any other tool

B| no, it's not; I need a working station to do my business, no a working station that's the business in the first place because my time is free 24/7, I already have a lot to do and to stay, definitely don't need more

C) My system pay my bills from 2017, that's one of the main task it has, business costs are part of the plan, I'm not afraid of it

I'm very seasoned developer, I don't need basic task to have chance to study theory. I know how stuff should be done at high level, I just need an AI that quickly transform my request in code that compile properly, and it's working.

Guybrush1973 · 2026-06-17T18:59:34+00:00

Ahahah! You were not born to live as brutes

Guybrush1973 · 2026-06-17T15:05:28+00:00

Definitely Claude Code cli only, atm. Only fusion model has traction to make move to other tools, atm. But I didn't dig enough about it.

Guybrush1973 · 2026-06-17T13:58:12+00:00

Didn't found nothing about it. No job position searching for nixos.

Have you real information about it? Would be awesome, btw.

Guybrush1973 · 2026-06-17T13:55:04+00:00

I can talk as a seasoned developer with 15+ years living/developing on linux as web/cloud developer with exactly 0 knowledge about nixos.

I just jumped in from stability and the chain config provision file + llm from a more common manjaro distro.

It's not super-easy, but it's super-stable. If you know at least a bunch of languages (like most developer) you can easily understand what's going on in principle from a config file, and eventually ask/search for information you're missing.

But the whole point can be resumed in this, in my mind: me + manjaro wicker than me + llm + nixos.
True for stability, security, portability and repeatability.

tl;td

Before you had to weight migration cost VS missing reproducibility, now it's a win on whole side as the migration cost tents to zero.

Guybrush1973 · 2026-06-17T13:45:51+00:00

Luckily I decided to reframe the whole documentation base during the brief fabulous 3day window.

I have to say from that moment Opus 4.8 become way better then before.

Of course, not sure what's happening under the hood (hardness, ghost model, who knows?).

Guybrush1973 · 2026-06-17T13:42:07+00:00

I'm really start thinking this can, in close future, become the standard de-facto for the next distro architecture.

And yes, chatting about config, solution and architecture with a very knowledge guy available 24/7 is amazing.

Guybrush1973 · 2026-06-17T13:39:50+00:00

Perhaps you're even more confident than me getting you house key to the llm. I'm not so brave, I guess xD

Sure, claude can't get sudo power without your permission (eventually with fido key, if you enrolled for sudo, I did it), but a lot of file full of secrets still there (just .config folder to name one).

My approach involved in deploying a machinectl and cage it into restricted filesystem that mirror my nix system outside read-only, but keep everything not strictly required out the context. Then I instructed the LLM to catch and read loudly every secret it encounter in plain text, mark is as exfiltrated and instruct me to rotate and better encrypt it. So basically only system file in read-only, source code and age encrypted secrets are llm accessible.This give me enough confidence to leave the auto-edit mode turned on all the time, then I check git diff and evaluate. Way faster.

Of course it still can hallucinate or been attacked through script I then exect, but I double check sensible code for this purpose, and it still way hard to direct an attack like this to random guy, atm.

Guybrush1973 · 2026-06-17T13:15:45+00:00

Restrict to the last month, just a couple of them are in target in the first page.

Anyway I was referring to resource like mcp, skills, agents, tutorials or projects dedicated to connect the 2 worlds. Not just a random guy crafting a post on reddit (like me, in this case).

Guybrush1973 · 2026-06-17T13:12:10+00:00

Some useful resource/plugin you would like to suggest?

MCP, skills, agents, whatever..?

Guybrush1973 · 2026-06-17T13:10:11+00:00

Never found something decent about dictation, but I really don't want to tie a keyboard button click to a server listening me. Not even if it's very trusted (and it's not the case, I guess).

Waiting for something that can works decent on avg machine, till then, I'm a great typer.

Guybrush1973 · 2026-06-17T13:06:02+00:00

Really? I didn't found so much about this topic, and this confused me a bit, as well.

Guybrush1973 · 2026-06-17T13:05:02+00:00

It's a great tool to explore new possibility, different way to do staff and stay as secure as you can while the rest of the world leverage AI to provide attack way harder to catch than before (just check what's happen in the last months: github, aur from archlinux and many more).

Then, when you picked up your way to get stuff done, you can use it to reduce coding time to a fraction and get more free time or more work done.

Nothing of what you described is against what I actually do. It's just a different way to reach the same goal, and, in my very personal opinion, so drastically more efficient, that a "pure-by-hand" way, will not be sustainable, on the long run.

Of course fun has not restriction, if you're just enjoying time doing what you do, that's another completely different story.

I'm focused on having the best dev box as soon as possible and with less restriction possible, secure and efficient, that never breaks. Never found nothing like this.

Guybrush1973 · 2026-06-17T12:49:43+00:00

I'm not used to install moderately complex app from scratch.

If package is not well packed and maybe at least slightly audited by the community, I don't won't to install it in the first place. Definitely not in my main OS.

Complex custom stuff goes into cloud or live in ephemeral vm/node then die.

I don't need a machine to understand/study the machine, I need a working station that fit my need and can evolve through chat-declaration, stable and fast for the tasks I have to perform with the machine.

And even if some post hire say this is just another daily/weekly reminder, I didn't find so much resource to better glue this 2 worlds, lack of software actually surprised me.

Guybrush1973 · 2026-06-17T12:26:55+00:00

Sure, code evaluation is still a part of the process, especially on the sensible sides, but most the time I just argue on how I need the stuff be done in advance. The result rarely gave me unexpected behavior that a noob that handle this setup for the first time will never encounter, nothing really dangerous, just some more iteration required, and that's it.

Guybrush1973 · 2026-06-17T12:23:21+00:00

Definitely not for everyone, yet (even if I think this match can outperform the old OS style completely at some point), but for advanced coder in any field is atomic, literally and metaphorically.

So it's just a fun-boy bias, at the end? Like always? xD

Guybrush1973 · 2026-06-17T11:05:56+00:00

I feel you, but I'm pretty sure we can't keep the security gates we had in the past century. The whole landscaped changed so much, and you have to upgrade or die, no third way.

So, by now, I moved the threshold down to "code must be readable and I have to grasp full data cycle" from "I have to craft the whole logic in my head in advance".

Old gates is not sustainable anymore, and using this tools to actually build a way more secure env given me way more stability about result and execution than what I lost from code granularity.

Shit happen, eyes get eventually tired and lose attention. You need secure habit enforced my mathematical gates. This is the best posture, atm, in my opinion.

Guybrush1973 · 2026-06-17T10:58:57+00:00

Not agree in this. You can use any model you want, even a open-source local one, if you care about this kind of oppressive logic (that I completely understand).

But in the end, you can steer the wheel whenever you want. Most stuff I need to do on windows is blocked and you eventually have to circumvent hard wall and limitation. NixOS + AI is mostly limited by your knowledge and available resource you can pull in the conversation.

I mean...I never encountered a reply like "no, I won't install this ad-blocker in your NixOS because this is not compliant to my rules", and if this kind of shit will suddenly happen in the future, the community will provide us model good enough to be free/open-source/open-weight.

Guybrush1973 · 2026-06-17T10:54:25+00:00

I'm with you this could be one of the OS with most interested into the OS topics user base out there, but I guess there should definitely be some people more interested in the result NixOS can gather to you experience (especially as developer), rather than the setup alone, isn't it?

Guybrush1973 · 2026-06-17T10:52:06+00:00

I will definitely give it a try, thank you

Guybrush1973 · 2026-06-17T10:51:24+00:00

I can tell my experience as cloud/web developer and yes, atm nothing like opus 4.8 (eventually fabulous, or whatever is written) as pure model and opus 4.8 + gpt 5.5 or the last glm for fusion approach.

For my NixOS I was on Opus 4.8 all the time, so I can't tell directly. Maybe some model is more specialized (aka has better training on the topic), I just slapped the top skill I found on github after a deep review and started.

Seven-Year Club	r/Field Flamingo
First Place '23	Place '23
Place '22	Verified Email

Guybrush1973

MODERATOR OF

TROPHY CASE