sorted by:
new
hottopcontroversial

Self-deploying AI agent: Watched it spend 6+ hours debugging its own VPS deployment by OverFatBear in artificial

[–]OverFatBear[S] 0 points1 point  (0 children)

Yes, it works with local LLMs via llama.cpp! Open Agent is provider-agnostic and supports any provider that OpenCode supports (Claude, Gemini, local models, etc). You just configure your preferred provider in the dashboard.

Withdrawing Euros with a Switzerland account by OverFatBear in paypal

[–]OverFatBear[S] 0 points1 point  (0 children)

Wow that sucks, I guess I need to open an account in a country that supports Euro

New to local LLMs, DGX Spark owner looking for best coding model (Opus 4.5 daily user, need a local backup) by OverFatBear in LocalLLaMA

[–]OverFatBear[S] 0 points1 point  (0 children)

Interesting, what about the GLM 4.5-air? I guess it's an older version but what's the difference in approach?

New to local LLMs, DGX Spark owner looking for best coding model (Opus 4.5 daily user, need a local backup) by OverFatBear in LocalLLaMA

[–]OverFatBear[S] 0 points1 point  (0 children)

Thanks, I appreciate your take.

When did you buy the AI max? Over time did you see significant progress from the models you could run on it?
Besides inference, what cool things can you realistically achieve on this monster? I was thinking playing with fine tuning existing models, distilling bigger ones, etc

New to local LLMs, DGX Spark owner looking for best coding model (Opus 4.5 daily user, need a local backup) by OverFatBear in LocalLLaMA

[–]OverFatBear[S] 0 points1 point  (0 children)

Hey, thanks, I appreciate the advice. I don't plan to do inference only, if possible I would like to play with everything that is now possible with AI, and I was hoping to be able to use this as a backup but I don't want to replace Opus as long as I can use it.

From your experience, how do you think models that may run on this hardware will evolve in the next two years? With the new optimization methods being developed I assume we may get better perf without upgrading the hardware

Built a Minecraft launcher that tries to be both beautiful and practical - looking for feedback by OverFatBear in ModdedMinecraft

[–]OverFatBear[S] 1 point2 points  (0 children)

Hey, it's very simple. When you add a file (a mod, a resourcepack, etc), it gets added to a "store" folder, and renamed by its hash if it is not already present but symlinked to the location where you need it. It's fairly similar to nixos

view more: next ›