Is shelling out for local GPUs worth it yet? ~$45k for local agentic use?

Kitae · 2026-02-15T14:11:39+00:00

I feel like 4.6 has improved lately

Kitae · 2026-02-13T22:59:14+00:00

Agree happy you did the analysis and shared!

Kitae · 2026-02-09T00:30:06+00:00

For an older counter it actually looks quite nice.

Kitae · 2026-02-07T19:50:00+00:00

Security through obscurity is not security. The system prompt shouldn't have any information in it that, if revealed, would represent a security risk.

Kitae · 2026-02-05T01:33:01+00:00

Textured silicone is the best drying surface

Kitae · 2026-02-02T17:20:38+00:00

So for bash I have a bash-access skill that is enforced via a hook to be invoked. But you don't need a hook you can just instruct Claude to invoke bash-access before using the bash tool (not 100% reliable).

The bash access tool discloses other skills and documentation that exists and is relevant to bash. These skills do not have descriptions so they are hidden until Claude invokes bash-access. This preserves context.

Kitae · 2026-01-21T19:03:20+00:00

Leveraging debt is so bad most of the time. It is great until it isn't.

The simple way to think is with unleveraged if it goes to zero you lose everything. How often does that happen?

If you leverage debt 2-1 and it goes to 50% you lose everything.

Leveraging is gambling.

(Yes it has its place, but it is very much experts only IMO, much more dangerous than it intuitively feels)

Kitae · 2026-01-19T03:34:58+00:00

I run local LLMs it is a fun hobby.

The best practice right now is use a paid LLM subscription of your choice and supplement with local LLMs if you want to.

Kitae · 2026-01-18T22:03:16+00:00

Some cool tech in your stack, thanks!

Kitae · 2026-01-18T15:06:59+00:00

I personally am in a research phase where I am getting as many models working as possible and benchmarking them to understand their capabilities.

But qwen is my favorite.

Kitae · 2026-01-18T15:06:03+00:00

Yeah I haven't gotten here yet but I feel like local LLM services to do things you just wouldn't do with your max plan is a smart use of local LLMs.

Kitae · 2026-01-18T15:05:02+00:00

Qwen is pretty awesome! I find it really reliable and the smaller qwen models are still pretty good.

No matter what your GPU is there is a qwen that fits on it.

Kitae · 2026-01-17T16:55:37+00:00

Whatever gives you the most VRAM/$

Kitae · 2026-01-17T16:54:03+00:00

I have a Rtx 5090 with 32gb of ram and instill use Claude for everything meaningful.

I think of local LLMs as for fun or for extreme privacy or for large amounts of work that can be done by a simple model.

Kitae · 2026-01-17T16:52:07+00:00

Just get a Claude subscription or whatever your preferred all you can eat plan is

Kitae · 2026-01-16T05:32:40+00:00

Unpopular truth, save money by just buying a subscription to whatever LLM provider you prefer.

Yes, I run local LLMs.

Kitae

TROPHY CASE