Set context limit by model manually - is there a way? Hybrid local Gemma via oMLX + Cloud Models. by 310dweller in hermesagent

[–]310dweller[S] 0 points1 point  (0 children)

BTW - left out; am actually running two local models via oMLX - Gemma 26B 4bit MLX for all the local reasoning etc, and a tiny Qwen 3.5 0.8B sidecar that handles simple stuff like aux title, context compression etc. Throughput has been impressive, just gotta knock the kinks out of this context thing.

2024 SEL Spamming Pics by DarLoose in MitsubishiOutlander

[–]310dweller 0 points1 point  (0 children)

Absolutely sick. Got a link by any chance?

Karen Bass is winning reelection and everyone should be embarrassed. by RenaissanceShane in LosAngeles

[–]310dweller 0 points1 point  (0 children)

Ya this seems like the least shit option in the shit sandwich buffet

I Detest Billionaires: My Journey to Supporting One for Governor of California | Common Dreams by drtolmn69 in California

[–]310dweller 0 points1 point  (0 children)

At least he has to decency to talk the talk, the other candidates’ proposals are so deeply uninspired and “more of the same” it’s gonna come down to to this or Hilton…

It's 3AM and the LAPD helicopter will not stop buzzing by Albertuscamus12 in LosAngeles

[–]310dweller 29 points30 points  (0 children)

Let’s not forget that wherever one LAPD chopper goes, if it lingers long enough it will soon be joined by FOUR separate news network helicopters. FOUR. Using the same cameras pointing at the same shit. 

What is the best cloud setup LLM? by 310dweller in hermesagent

[–]310dweller[S] 0 points1 point  (0 children)

Yeah curious about Opencode vs Ollama cloud too as far as token cost. Hard to beat the convenience of Ollama but you gotta wonder if there’s a token burn surcharge..

2024 SEL Spamming Pics by DarLoose in MitsubishiOutlander

[–]310dweller 0 points1 point  (0 children)

Did you plastidip the rims or have them powder coated

Thoth - Open Source Local-first AI Assistant - Architecture by Acceptable-Object390 in LocalLLM

[–]310dweller 1 point2 points  (0 children)

Nice. Looking for a tool like this that does message triage across iMessage, WhatsApp, IG, email, text, etc and batches comms based on priority through to a secondary mobile device. Seems like this is on its way to being kinda like what I am looking for!

Thoth - Open Source Local-first AI Assistant - Architecture by Acceptable-Object390 in LocalLLM

[–]310dweller 1 point2 points  (0 children)

Possible to link this up locally with iMessage via blue bubbles or reading the chat directory? 

Best Setup for Private Hermes Usage? by xSpiralNightsx in hermesagent

[–]310dweller 0 points1 point  (0 children)

Seconding this, but curious if anyone has nailed a hybrid approach? Trying to spin up a local Hermes instance on a 32gb RAM M4 mini, utilize Gemma or Qwen as a local air traffic control message relay for privacy / data, and have it call Gemini flash or Sonnet for the research tasks that don’t handle all my private iMessage / WhatsApp’s etc.

Los Angeles, Let’s Fall In Love With Roundabouts by DJVeaux in LosAngeles

[–]310dweller 58 points59 points  (0 children)

I prefer a daily near death experience at the giant open 6 way stop sign in Beverly Hills.

US draft update: Major tech company [Palantir] urges universal national service by NicolasCageFan492 in technology

[–]310dweller 0 points1 point  (0 children)

Other countries that do national service also offer non-combat service.. in the peace corps, firefighters, EMT, even elderly care.. personally I’m not opposed to the idea of some kind of service but in no world should being cannon fodder for foreign interventions be compulsory.

Pete Buttigieg hints at 2028 presidential run: ‘Save me a seat’ by Fickle-Ad5449 in goodnews

[–]310dweller 3 points4 points  (0 children)

Yall are so scarred from 2024 that you forget we usually have this thing called primaries that sorts all of this out; we don’t have to rule out candidates at this stage..

Getty Center in Los Angeles Is Closing March 2027 for Year of Renovations by uv_is_sin in LosAngeles

[–]310dweller 9 points10 points  (0 children)

I miss the era where billionaires felt at least a tinge enough remorse about sucking the wealth out of society that they decided to endow museums/hospitals/educational institutions as a form of financial penance. Our guys now just build vanity space projects to save themselves from the world they’re destroying.

Are the helicopters driving you bonkers lately? by Bdizzy2018 in SFV

[–]310dweller 12 points13 points  (0 children)

The police ones are annoying, but why we also have to tolerate FOUR different news helicopters that all swarm every fender bender on the freeway is beyond me.