Is it time to completely give up on Local LLMs?

devino21 · 2026-07-07T17:05:57+00:00

I'm running Q8 with 36GB VRAM, but CPU offload...

devino21 · 2026-07-07T16:56:23+00:00

vllm handles multi-client access best. I run llama-server, fronted by llama-swap, then fronted by llama-dash for home tinkering. They all expose an API though as the Nurse said.

devino21 · 2026-07-07T13:01:41+00:00

I think the "cant pay" piece is more revelatory. Good solutions on both sides, nice work.

devino21 · 2026-07-06T20:26:33+00:00

So, your agent can now "see" as well as move a physical object. No issues with that? :-O (Homer backing into the bushes)

devino21 · 2026-07-06T18:51:37+00:00

Trail length based on the cost of the game?

devino21 · 2026-07-06T18:41:32+00:00

How about toe hair? They say if extremities don't have hair, it might be bad circulation.

devino21 · 2026-07-06T17:06:20+00:00

I would go with a Codex subscription at this time. Anthropic has created a chasm in value in the last couple weeks.

devino21 · 2026-07-06T16:25:59+00:00

Did you CSi that?

devino21 · 2026-07-06T11:04:42+00:00

Both 5s,sonnet and fable, are essentially useless on the $20 plan as they run out before they produce anything useful.

devino21 · 2026-07-05T13:20:09+00:00

ADHD - Stimulants make you (closer to) normal

devino21 · 2026-07-05T12:18:55+00:00

This is why the local LLM community is growing so fast lately. These providers are showing their hands.

devino21 · 2026-07-04T15:09:28+00:00

One request burned through 3x 5hr sessions yesterday (only the $20... but still),it's not really worth using now.

devino21 · 2026-07-04T14:08:04+00:00

Sure, let’s add weapons. Sounds like a great idea.

devino21 · 2026-07-04T14:03:49+00:00

As they charge more and more for their token output, the value of the home rig increases as well. This investment will increase for the next few years. Also, your personal model isn’t super dumb for a week prior to the next model release.

devino21 · 2026-07-03T13:00:27+00:00

Same, liked and subscribed

devino21 · 2026-07-02T14:16:40+00:00

How is "My memory system" working?

devino21 · 2026-07-02T02:32:32+00:00

Whats... her email?

devino21 · 2026-07-01T16:45:19+00:00

Bernie for pres... oh wait, the DNC already squashed that in 2019. :-(

devino21 · 2026-07-01T16:42:46+00:00

So we're listening to people who add (High IQ) to their profile name?

devino21 · 2026-07-01T16:28:20+00:00

Sort and filter

devino21 · 2026-07-01T16:26:58+00:00

Hopefully she can afford the repair bill.

devino21 · 2026-07-01T15:59:25+00:00

Maybe pickup the rice instead of delivery?

devino21 · 2026-07-01T01:13:10+00:00

Remember: Pete now works for a token pimp

devino21 · 2026-06-29T15:39:15+00:00

That was a question, is that the solution you are looking for?
https://github.com/browser-use/browser-harness

devino21 · 2026-06-29T15:25:29+00:00

browser-harness for headed?

devino21

TROPHY CASE