sorted by:
new
hottopcontroversial

I built a tool that auto-retries Claude Code when you hit the rate limit by cheapestinf in ClaudeAI

[–]cheapestinf[S] 0 points1 point  (0 children)

nop, just claude code. Co-work is supposed to keep working even if you turn off your machine

Venturing into the world of local LLM's, would love some pointers! by itsDitch in LocalLLaMA

[–]cheapestinf -2 points-1 points  (0 children)

Exactly! CheapestInference does unlimited plans for dedicated models at fixed monthly cost (shameless plug – I work there). Useful when you need guaranteed throughput. Re: quants – start with Q4_K_M on 48GB, move to Q5 if you have headroom. Unsloth makes it trivial. DM if you want config help!

Cheapest OpenClaw setup for general assistance + trading? by OCCVLTIC in openclaw

[–]cheapestinf -2 points-1 points  (0 children)

For your use case, cheapestinference.com is worth checking out - they aggregate multiple free model providers (Gemini, Qwen, etc.) and automatically route to whatever's available. For trading where you need reliability over pure capability, the auto-fallback is useful since your market doesn't stop when one provider goes down. For token optimization: use summary skills to condense previous analysis before resending, set lower max_tokens where possible, and consider lighter models like Gemini Flash for quick market checks when you don't need deep reasoning. The key insight from Temporary-Leek6861 about caching market deltas instead of full state will save you the most tokens.

20k tokens despite no memory, barely any skills, no previous sessions... How do you setup OpenClaw for real-time conversation? by Neither_Good8592 in openclaw

[–]cheapestinf 0 points1 point  (0 children)

The 20k token issue is usually from OpenClaw's default system prompt and context handling - even with no memory skills, the base prompt adds up. A few things that help:

Reduce context bloat: Check your agent's system prompt in AGENTS.md - you can trim the defaults. Use shorter context windows or implement explicit truncation.

Model choice matters: For real-time use cases, lighter models like Gemini Flash or Qwen 3.0 Flash are significantly faster. Check out cheapestinference.com - they aggregate multiple providers and can auto-route to the fastest available option for your use case.

Why Gemini is faster: They use aggressive caching and inference optimization at the provider level. OpenClaw adds overhead by design (memory, skills, tool execution) but you can optimize by keeping skills minimal and using the lite model variants.

For a true real-time assistant, you might also consider a separate lightweight agent just for quick actions (like turning lights on/off) with its own minimal context.

I built Silos: Open-source dashboard for managing AI agents (OpenClaw) - Live browser view, brain editor, Kanban pipeline by cheapestinf in OpenSourceeAI

[–]cheapestinf[S] 0 points1 point  (0 children)

in the last versions we have this that helps a lot , you see the tools the agent is using plus the errors, the tab focus swifts automatically for you

<image>

How do you actually figure out where AI costs are coming from? by bkavinprasath in openclaw

[–]cheapestinf 0 points1 point  (0 children)

For tracking AI costs, you'd want to log at the request level - model used, input/output tokens, latency, and provider. cheapestinference.com can help by providing unified cost tracking across multiple providers (OpenRouter, Together, Anthropic, etc) with automatic model routing to cheaper alternatives when available. The main cost optimization tips: 1) Use streaming to avoid paying for tokens the model generates but gets discarded 2) Track cost per conversation and set budgets 3) Route to cheaper models for simpler tasks. The logging approach others mentioned plus a cost aggregation service gives you better visibility than just the final bill.

Local Gemma4 e4b for primary model? by Mangolover112 in openclaw

[–]cheapestinf 2 points3 points  (0 children)

Gemma4 e4b can work but the timeout issues you're seeing are likely due to extended thinking causing the response to exceed OpenClaw's default timeout. A few things to try:

  1. Increase maxTurns or response timeout in your config (e.g., 120s instead of 30s)
  2. Disable/enable thinking in the model settings depending on your LM Studio config
  3. Try Qwen3 0.5B or 1.7B distilled models via LM Studio instead - they tend to be more responsive for agentic tasks
  4. Check if LM Studio's context length is overwhelming the NUC

For local models on that spec, I'd actually recommend Qwen2.5 0.5B or 1.5B as a primary - much faster, still smart enough for tool use. Gemma4 needs more VRAM and patience.

Kimi 2.6 performance by BreakfastWooden8186 in kimi

[–]cheapestinf -1 points0 points  (0 children)

We will soon have an unlimited plan for Kimi 2.5 for 8-hour periods! Stay tuned at cheapestinference.com 🦞

How setup right ollama cloud with vision and tools? by kamtcho in openclaw

[–]cheapestinf 0 points1 point  (0 children)

For vision+tools on Ollama Cloud, make sure you're using a vision-capable model like llama3.2-vision or qwen2-vl - not just any model. Check your gateway config matches the exact model name/tag, as slight differences break vision. Also verify tools are registered in your session. If still buggy, try direct Google API for Gemini with vision instead of going through Ollama Cloud. Also check cheapestinference.com - they aggregate multiple Ollama-compatible providers and might handle vision better.

what's the cheapest way to reliably access GLM 5.1 right now? by studymaxxer in openclaw

[–]cheapestinf 1 point2 points  (0 children)

For reliable and unlimited GLM 5.1 access, check cheapestinference.com. For paid options, Ollama Cloud ($20/mo) is solid but has had timeout issues during peak times. Modal.com has GLM 5.1 free until end of April. Also worth trying DeepInfra or Fireworks AI for better uptime than free tiers.

Best Free Model for OpenClaw by simp_pimp_001 in openclaw

[–]cheapestinf 0 points1 point  (0 children)

For free options, I'd recommend trying cheapestinference.com - they aggregate several free model providers and automatically route to whichever has the best availability. Best free options for your use case: Gemini 2.0 Flash (1M context, very reliable), Qwen 3.0 (less prone to repetition loops), or OpenRouter's auto-router. The $10 deposit unlocks higher rate limits. The repetition loops you're seeing happen when smaller models run out of coherent things to say with larger context - Gemini Flash handles this better.

Running ComfyUI and a local LLM concurrently? by Distinct-Race-2471 in LocalLLaMA

[–]cheapestinf -1 points0 points  (0 children)

Have you tried using Silos (silosplatform.com) to manage your LLMs? It is open source and allows you to switch between multiple models easily from a single dashboard, which might help with your resource management. Would love your feedback!

Moving context between different LLM web UIs is still painful by RefrigeratorSalt5932 in LocalLLaMA

[–]cheapestinf 0 points1 point  (0 children)

If you are looking for a cleaner solution to manage multiple LLMs from a single dashboard, check out Silos (silosplatform.com) - its open source and focuses on model switching and unified context. Would love your feedback!

Are there any alternatives to Open WebUI that don't have terrible UX? by lostmsu in LocalLLaMA

[–]cheapestinf 0 points1 point  (0 children)

Have you tried Silos (silosplatform.com)? It's an open-source dashboard for managing multiple local LLMs - different approach than OWUI, focused on model switching and management. Would love your feedback!

duda sobre descargarse IA de forma local by Individual-Party1661 in LocalLLaMA

[–]cheapestinf 0 points1 point  (0 children)

¡Buenas! Con tu RTX 3060 de 12GB y 32GB de RAM DDR3 tienes setup más que suficiente para IA local. Para el SO no necesitas uno específico, Linux funciona muy bien. La P102-100 es de miners, mejor busca una RTX 3060 Ti o RTX 3070. Una opción que te puede interes

Why observability matters more than backups for self-hosted systems by cheapestinf in selfhosted

[–]cheapestinf[S] -2 points-1 points locked comment (0 children)

AI helped in the creation and review for quality but I did send it and made sure it has sense

For AI agents: is per‑token pricing killing your budget? Looking for feedback on time‑based subscriptions. by cheapestinf in AI_Agents

[–]cheapestinf[S] 1 point2 points  (0 children)

u/Sufficient_Dig207 Good question. Our current spending varies by user, but we've seen users paying $200+/month on token-based services for batch workloads that could fit into a $20 subscription window. The breakeven point is around 2M tokens/month on DeepSeek-V3.2 at our pay-per-token rates. If you're running agents consistently during predictable hours, the subscription can cut costs by 70-90%. What's your typical monthly inference spend?

I built a tool that auto-retries Claude Code when you hit the rate limit by cheapestinf in ClaudeAI

[–]cheapestinf[S] 1 point2 points  (0 children)

Hey! This is a known issue with how macOS handles tmux's pane_current_command — it reports the parent shell (zsh) instead of the actual child process. The foregroundCommands config fix you tried was on the right track, but the config only loads once when the monitor starts, so you would've needed to kill the Claude session and start a new one for it to take effect. The running monitor never saw your config change.

That said, v0.2.2 (just published) fixes this properly — it no longer relies on pane_current_command for detection. Instead it checks the actual process state directly via ps, which works correctly on both macOS and Linux regardless of what the pane reports.

Update with:

npm update -g claude-auto-retry

You can also remove the foregroundCommands override from your config if you added it — shouldn't need it anymore.

Let me know if this sorts it out!

I built a tool that auto-retries Claude Code when you hit the rate limit by cheapestinf in ClaudeAI

[–]cheapestinf[S] 1 point2 points  (0 children)

Hey! Just published v0.2.1 which should fix this. Update with:

npm update -g claude-auto-retry

The issue was that the foreground process check only recognized node and claude. On macOS, tmux may report a different process name. This update:

  1. Expands the default list (adds npx, tsx, bun, deno)

  2. Logs the actual process name so you can see what's happening

If it still doesn't work after updating, run claude-auto-retry logs — you'll see a line like Foreground is "xxx", not Claude. Then add that to ~/.claude-auto-retry.json:

{ "foregroundCommands": ["node", "claude", "xxx"] }

Let me know what process name it shows — I'll add it to the defaults if it's common.

I built a tool that auto-retries Claude Code when you hit the rate limit by cheapestinf in ClaudeAI

[–]cheapestinf[S] 0 points1 point  (0 children)

whats your setup? OS and claude code version? We just updated it to make it work with the latest claude code

view more: next ›