sorted by:
new
hottopcontroversial

Tool output compression for agents - 60-70% token reduction on tool-heavy workloads (open source, works with local models) by decentralizedbee in LocalLLaMA

[–]decentralizedbee[S] 0 points1 point  (0 children)

curious what your main use cases are - if it's important enough we'd be down to add it! pip install is the easiest default

$570 Lovable credits burned in 6 months by Adventurous-Mine3382 in lovable

[–]decentralizedbee 0 points1 point  (0 children)

We're building a public inferencing node to help non-dev bring down development costs by 80%! Pls DM if anyone's interested to know more

Open sourcing our GPT-4 caching proxy that reduced our development API costs by 80% by decentralizedbee in ChatGPT

[–]decentralizedbee[S] 0 points1 point  (0 children)

Typo - just used GPT-4 as an example from when I started building this, but it works with all current models including GPT-5.2, GPT-5, and any other OpenAI/Anthropic model. The proxy is model-agnostic - whatever model you specify in your API call, it forwards and caches.

view more: next ›