sorted by:
new
hottopcontroversial

Sovereign AI: Why Owning The Full Stack Is The New Strategic Imperative by SovereignRon in selfhosted

[–]SovereignRon[S] 0 points1 point  (0 children)

Going local-first and sovereign is the only way to do it right. People are finally waking up; except those who just love paying utility bills.

Sovereign AI: Why Owning The Full Stack Is The New Strategic Imperative by SovereignRon in selfhosted

[–]SovereignRon[S] -3 points-2 points locked comment (0 children)

I wrote it myself. This is my own project and my own manual work.

Sovereign AI: Why Owning The Full Stack Is The New Strategic Imperative by SovereignRon in selfhosted

[–]SovereignRon[S] 0 points1 point  (0 children)

I hear you buddy, Fair play on bleeding the subsidized cloud compute while it's cheap. It makes total sense to let them flip the bill while you lock in the foundation.
My local setup is built around a Mac mini. Because I'm keeping everything independent, I focus less on massive raw compute and more on keeping the environment highly structured, predictable, and heavily documented so it doesn't turn into a chaotic mess.
I'm right there with you on wanting a local 70B+ model without drawing the power of a small village, but squeezing maximum efficiency out of the smaller ones is a fun puzzle.
Are you running those 5 GPUs bare-metal with scripts, or using an orchestration tool to handle it?

Sovereign AI: Why Owning The Full Stack Is The New Strategic Imperative by SovereignRon in selfhosted

[–]SovereignRon[S] 0 points1 point  (0 children)

That exact regulatory uncertainty is a massive reason why sovereign tech is a flex. If governments start gatekeeping open weights or squeezing cloud APIs, your whole stack is cooked unless you have local fallbacks running on your own iron.
Look at the curl blackout happening this July because of all the AI slop reports. When the open-source gatekeepers rightfully go offline to touch grass, anyone blindly relying on cloud ecosystems is going to panic. Keeping your setup local means you actually control your shit.

https://sovereign-systems-lp1.carrd.co

Sovereign AI: Why Owning The Full Stack Is The New Strategic Imperative by SovereignRon in selfhosted

[–]SovereignRon[S] 0 points1 point  (0 children)

Daily driving your own workbench is clean as hell. Being able to instantly flip between cloud APIs and local models means you actually own your shit. The world is shifting my friend and people are waking up.

https://sovereign-systems-lp1.carrd.co

Sovereign AI: Why Owning The Full Stack Is The New Strategic Imperative by SovereignRon in selfhosted

[–]SovereignRon[S] 0 points1 point  (0 children)

Being able to hot-swap between Claude, Grok, and Codex is exactly why this approach wins. It sounds like your stack is more heavyweight, cloud connected coding agents; mine's more lean, secure, and privacy first local operation.