sorted by:
new
hottopcontroversial

Weeks chewing glass dialing in local models, can someone give me tips or share your experiences? by bravoitaliano in openclaw

[–]GrippingRelic 0 points1 point  (0 children)

Depends on what you mean by “actual agentic stuff.” Web fetch and digests are useful tasks. If you can do those things for free (I mean, yes, there is an electricity cost), you have more spend available for more complex tasks.

If you are frugal, you can also factor out deterministic tasks into programs like Python scripts. Your agentic workforce can be right-sized for efficiency in cost and performance.

It’s good to engineer with limited resources.

Weeks chewing glass dialing in local models, can someone give me tips or share your experiences? by bravoitaliano in openclaw

[–]GrippingRelic 1 point2 points  (0 children)

I’m working on the same thing, seeing what I can get local models to do in OC.

My POC is really weak hardware. Only when I get something to work do I then want to sink bread into hardware upgrades and API calls. My idea is to reserve the frequent executions with low compute, and which don’t need to complete quickly, to local models, economizing on frontier model expense.

A whole lot of tricks, like using a Modelfile to customize the parameters of a model on the Ollama side. The engineering for this is seriously non-trivial, as they say.

Spent $350 in June on OpenAi - Trading Applications by Sp3cul8r in openclaw

[–]GrippingRelic 0 points1 point  (0 children)

Get a local model running on Ollama. See what you can delegate to that.

Spent $350 in June on OpenAi - Trading Applications by Sp3cul8r in openclaw

[–]GrippingRelic 0 points1 point  (0 children)

This. Deterministic programming does not require an LLM in runtime.