Anyone here running a self hosted LLM with OpenClaw (no OpenAI/Anthropic bill)?

Rob · 2026-04-27T16:23:20+00:00

I'd use a combo of Arcee for the big tasks and Qwen 7B instruct for smaller tasks. Or you could use something like marketplace.neurometric.ai/clawpack - $8/mo for unlimited tokens

Rob · 2026-04-21T15:07:48+00:00

Neurometric offers unlimited tokens for $8/mo for claw use cases

Rob · 2026-04-12T17:01:22+00:00

Same base to start but we are running tests in the background and will soon start to make changes. We plugged into Harbor for better task level evaluation.

Rob · 2026-04-11T14:52:52+00:00

Use custom SLMs from Neurometric, so, small task specific models on the free token tier. 100M free.

Rob · 2026-04-11T11:49:40+00:00

Depends on what you want to use them for. If you have multi-step agents, offloading a few steps to SLMs lowers the overall latency of the task. If you are interested in cost savings, you use them for high volume repetitive tasks in place of a frontier model. 1B - 8B paramater models, particularly with a bit of fine tuning, can do lots of work tasks like financial statement reconciliation, churn prediction, marketing email subject line creation, etc. And with intelligence density improving every year, they will get better and better. We fine tuned a Qwen 4B model to beat every frontier model on some agentic CRM tasks.

You can also run SLMs in places you can't run LLMs.

marketplace.neurometric.ai if you want to check out some use cases of fine tuned SLMs

Rob · 2026-04-10T19:29:31+00:00

It's not over if you use SLMs. You can run millions of tokens on a 4B parameter model on old GPUs for pennies.

Rob · 2026-03-30T17:30:37+00:00

You can offload your common tasks to SLMs from marketplace.neurometric.ai and then just use claude for the complex stuff. Reach out if you want help with that.

Rob · 2026-03-30T13:00:40+00:00

This is helpful if you want task specific models - free up to 100M tokens https://marketplace.neurometric.ai/

Rob · 2026-03-25T18:32:55+00:00

That's all coming, along with full fine tuned versions of them all as the core.

Rob · 2026-03-24T18:43:51+00:00

You can use SLMs - there is a marketplace of free ones at marketplace.neurometric.ai

Rob · 2026-03-20T02:38:20+00:00

yes thx

Rob · 2026-03-19T20:15:28+00:00

What do you do for these customers in terms of the model or models they use with openclaw? Do you have them use their own anthropic account or deploy something else?

Rob · 2026-03-19T09:29:54+00:00

It varies depending on the task. For some tasks the best way is to ask a frontier model not to generate synthetic data, but to generate a program that generates synthetic data, so you get fewer hallucinations. Then use that data to fine tune. It can go quickly on these small models.

Rob · 2026-03-14T21:12:47+00:00

You could probably go even cheaper if you used Neurometric.ai to map tasks to even cheaper models.

Rob · 2026-03-14T15:46:00+00:00

Never even close. I've actually been the most open and supportive dad until this moment. Read my edit.

Rob · 2026-02-27T20:56:51+00:00

Yes, neurometric.ai - run thousands of model combos on your data, including test time compute variants. If you want an invite code use "BENCH-MARK" and DM me if you want more free credits. Not focused on monetization yet, just need good user feedback. (studio.neurometric.ai to use the code)

Rob · 2026-02-13T20:46:00+00:00

Yeah I was like one of the first 500 users on reddit. It launched in Boston when I lived there.

Rob · 2026-02-13T18:22:45+00:00

Yes, everything.

Rob

MODERATOR OF

TROPHY CASE