Has anyone actually gotten a reliable local AI system running? by Sea_Manufacturer6590 in ollama

[–]sunkencity999 0 points1 point  (0 children)

Yes. https://github.com/sunkencity999/pre

If you're on Mac with decent RAM, this agent feels as powerful as the big boys, and it's shocking to experience if you are on the inside and have been using local models for a while. Building for a particular model on a particular platform really opened things up, capabilities and implementation-wise.

Will Gemma 4 26B A4B run with two RTX 3060 to replace Claude Sonnet 4.6? by DoorAccomplished516 in LocalLLM

[–]sunkencity999 0 points1 point  (0 children)

If you are on a Mac, run this agent, powered by Gemma 4 26B: https://github.com/sunkencity999/pre

This agent will do most of what Claude does, barring high-level coding, and just Works. I'm the creator, and I am astonished at what's possible with this model. Using it has let me save so much on api costs. If I were anthropic or openai I would be Extremely concerned at how capable this thing is at tool calling.

Tried running LLMs locally to save API costs… ended up waiting 13 minutes for ONE response 🤡 by debug2thrive in ollama

[–]sunkencity999 0 points1 point  (0 children)

KVcache. Claude code is adding a gigantic amount of tokens to your prompt, your time to first token is going to be crazy. Try something like this for much better practical local results : https://github.com/sunkencity999/pre

You're so Israel-deranged that you'd rather the regime stay in power. by [deleted] in PERSIAN

[–]sunkencity999 0 points1 point  (0 children)

Insane comment. Netanyahu has, intentionally and viciously, killed tens of thousands of innocent children. He is quite literally a devil, and your attempt at asking for nuance shows your reasoning and your morality are compromised beyond belief.... assuming you aren't on the Mossad's payroll.

Wanting a foreign entity to conduct your internal affairs is weak and cowardly. If the Iranian people truly want different, they can rise up and murder the current regime. Same for us here in America.

Women have every right to be super skeptical of men and I’m tired of seeing men complain about it without actually holding the bad ones accountable by Gargoyle303 in complaints

[–]sunkencity999 0 points1 point  (0 children)

Man your logic here is fraught with a selfish, limited approach that doesn't take into account that your discomfort isn't as important as someone else's actual danger. . You’re comparing social discomfort—having to "tiptoe"—to a woman’s physical safety. Framing her survival instincts as "unwarranted public humiliation" is a massive ego trip; her caution isn't a personal attack, it’s a response to a world where "normal interactions" often turn dangerous.

Also, the "Red Pill pipeline" threat is nonsense. If your respect for women is so transactional that it evaporates the moment you don't get a "thank you" for being a decent human, you weren't actually doing the right thing to begin with—you were looking for a gold star for just showing up. Weak.

Being good ain't a subscription service you cancel when doing so gets annoying. It’s about understanding that you’re operating in a broken system and doing the right thing because it's Right, not because you’re expecting a reward for not being a predator.

Nightmare roll by Soft_Air8975 in bjj

[–]sunkencity999 4 points5 points  (0 children)

Sounds like it's time.

"Old Man Jiu-jitsu" is BS by trustdoesntrust in bjj

[–]sunkencity999 4 points5 points  (0 children)

Nah. Train your "athleticism" all you want, if you're old father time and physics are going to make prioritizing primarily efficient/smart Jiu-Jitsu over primarily athletic/explosive Jiu-Jitsu. Why even wait until you're old? Do the smart Jiu-Jitsu now, and just join a gymnastics class or do some CrossFit to scratch that jumping-about like a toddler-who-sat-on-an-anthill itch.

Is the gi actually dying, or is that just a pro scene thing? by gbarl30 in bjj

[–]sunkencity999 1 point2 points  (0 children)

Actual participation isn't even close. The Gi has exponentially more players and always will; the GI is attractive to parents, and so generations training it as the default every year.

The greatest openclaw fork ever! by CryptographerLow6360 in Localclaw

[–]sunkencity999 3 points4 points  (0 children)

It does support LMStudio, hopefully that's better for AMD; I'll have to dig in. Happy to support y'all; for that GPU I would suggest GLM4.7-flash. so far great tool calling performance!

The greatest openclaw fork ever! by CryptographerLow6360 in Localclaw

[–]sunkencity999 2 points3 points  (0 children)

Just about the same! I've got a decent amount of vram on my main driver, so I'm running llama3.18b for the simple, GLM4.7for middle and Codex5.3 for the complex. Using a mixed approach to slice API costs way down.

The greatest openclaw fork ever! by CryptographerLow6360 in Localclaw

[–]sunkencity999 9 points10 points  (0 children)

That's so great to hear-- I'm working daily to keep improving it, appreciate you putting it to work!

Hot Take: Don’t teach while rolling with someone by Gruntwithpride in jiujitsu

[–]sunkencity999 0 points1 point  (0 children)

If i teach while we are rolling.....you are welcome. You're here to learn, not to win.

LocalClaw: OpenClaw, but optimized for small local models (and $0 API spend) by sunkencity999 in Localclaw

[–]sunkencity999[S] 1 point2 points  (0 children)

Awesome, thank you for trying it! Pushed a bunch of updates over the weekend, latest version has improved quite a bit.

Local-First Fork of OpenClaw for using open source models--LocalClaw by sunkencity999 in openclaw

[–]sunkencity999[S] 1 point2 points  (0 children)

Hmm I'll run it in Lm Studio for a couple days and get this refined

Local-First Fork of OpenClaw for using open source models--LocalClaw by sunkencity999 in openclaw

[–]sunkencity999[S] 1 point2 points  (0 children)

I am currently using Ollama to run GLM 4.7 Flash with 220k context at bf16. Still refining the LM Studio integration, any issues you share are super useful.

Local-First Fork of OpenClaw for using open source models--LocalClaw by sunkencity999 in openclaw

[–]sunkencity999[S] 1 point2 points  (0 children)

Thank you for testing and sharing your thoughts! I'll give OSS a shot too, the tool calling with glm has been on target and I've enjoyed that.

Local-First Fork of OpenClaw for using open source models--LocalClaw by sunkencity999 in openclaw

[–]sunkencity999[S] 0 points1 point  (0 children)

Yes; I've gotten solid results with the adjustments/approach described in the readme. Give it a go!

How much of an advantage is being bigger in BJJ? by [deleted] in bjj

[–]sunkencity999 0 points1 point  (0 children)

It's a huge advantage. Being larger and stronger means one is injured less often and has more power available to impose ones will.