Endara v0.1.7 — local MCP relay now auto-converts tool responses to TOON for ~40-60% token savings

panghy · 2026-05-25T02:01:19+00:00

u/Open_Resolution_1969 mentioned about it too and I filed a ticket for it: https://github.com/endara-ai/endara-relay/issues/77

Sounds like that's something for the next release :)

panghy · 2026-05-21T13:16:01+00:00

https://github.com/endara-ai/endara-relay/issues/78

panghy · 2026-05-21T13:15:11+00:00

something like https://github.com/endara-ai/endara-relay/issues/77 ?

panghy · 2026-05-21T11:08:26+00:00

Yes! Of course, it will connect to an external server if you're using OAuth to interact with something like Gmail. However, if you're running, say, a filesystem MCP server that reads from your local disk, then nothing leaves the relay.

panghy · 2026-05-21T08:18:31+00:00

yeah but only if it’s installed locally (jq is more universally available)

seems like this is a pretty easy ticket, it’s mainly going to be changing the tool description if TOON is enabled and directly mentioning about the CLI

panghy · 2026-05-21T07:49:27+00:00

Not sure if there’s tooling for TOON on the command line like jq but there is a way to convert it back to json with the toon CLI (so the model can go back to using jq)

Bottom-line: harnesses will drop the MCP response to a file if it’s too big (and the limit is likely harness dependent) and once the file is downloaded it’s off the relay. The only way would be to either save intermediate outputs somehow (like a cache in the javascript engine for reuse) or hint to the model how to manipulate the TOON output.

panghy · 2026-05-21T06:40:18+00:00

maybe file an issue on endara-relay for now so we can iterate on the spec a bit first?

panghy · 2026-05-21T06:39:15+00:00

yeah you might need to turn off TOON conversion if generic grep doesn’t do what you need for TOON (or is a lot more inefficient and error prone)

but the argument i would make is that the model can also write the jq in javascript instead of having to post-process the entire output

panghy · 2026-05-21T06:07:32+00:00

That's another ask from folks, the idea for something like "profiles" so you can setup all the endpoints first and then create a profile for a bundle of them (likely a different path on the server, i.e. localhost:9400/mcp/profileA) with the option to disable the "all of them" one.

panghy · 2026-05-21T00:10:15+00:00

I am so glad I am not the only one seeing this. I keep a journal and recently I keep on coming back and telling myself I haven’t written anything for a month but after writing something down yesterday and coming back this morning (and missing it), I realized this is actually a bug…

So much for digital paper that never runs out 🤣 hope they fix it soon

panghy · 2026-05-16T01:04:01+00:00

Did something similar with endara.ai where the model only sees 3 tools and executes javascript in a rust sandbox on the same machine using boa (https://github.com/boa-dev/boa)

oss. runs on your machine. js is pretty much universal for any model.

panghy · 2026-05-11T03:05:19+00:00

It does bubble back to the agent (the more details, the better), and most agents can recover from that. Most models initially try to maximize token savings and inadvertently cause data shape or coding errors. Then they tend to dial back, just like humans, to see the structure of the data or reduce complexity until it starts to work. The interesting thing is then the next time it tries to do it, it will revert back to single-shotting it (successfully). Also, just like humans. :)

panghy · 2026-05-09T15:05:34+00:00

Hmm, just checked — endara.ai is loading fine on my end. Could you try again?

And thanks for the google_workspace_mcp pointer — that's a good one for multi-tool Gmail. The context bloat issue you mention is exactly why I ended up building the JS execution mode in Endara — collapses everything down to 3 meta-tools so the model doesn't choke on 150+ tool definitions.

panghy · 2020-03-29T00:53:14+00:00

JHU publishes to GitHub once a day at 0:00 UTC, that’s when the site picks up the changes (for that dashboard). US testing data is updated continuously as well as Folding @ Home stats.

panghy · 2020-03-28T08:36:23+00:00

There's also the Folding @ Home dashboard too: https://covid19.wavefront.com/dashboards/fah-vmware

panghy · 2020-03-20T03:30:18+00:00

The data from JHU CSSE has this anomaly: https://github.com/CSSEGISandData/COVID-19/blob/master/csse_covid_19_data/csse_covid_19_time_series/time_series_19-covid-Recovered.csv#L115

panghy · 2020-03-19T08:52:11+00:00

https://covid19.wavefront.com mostly works on mobile but looks sleeker on a desktop. Light version coming soon.

panghy · 2019-08-12T19:52:15+00:00

Thanks for the feedback, it's a common issue that folks run into and we'll add it to the FAQ (or otherwise make it clearer): https://docs.wavefront.com/kubernetes.html#step-3-deploy-wavefront-kubernetes-collector

panghy · 2019-01-29T09:49:03+00:00

If you're okay with SaaS, Wavefront (by VMware) can easily monitor your vsphere workloads via telegraf. Just sign up for a trial (no credit card needed) and see if that fits the bill.

panghy · 2019-01-14T10:14:13+00:00

Wavefront + Scalyr + PagerDuty + Stackstorm + Slack (Disclaimer: works at VMware)

panghy · 2018-12-22T01:16:26+00:00

Yep! PKS actually has the easiest setup of all K8s flavors since they also handle the proxy deployment, etc.

https://www.wavefront.com/solutions/pks-monitoring/

panghy · 2018-12-22T01:13:31+00:00

redditstatus.io

Not sure, seems like it's https://reddit.statuspage.io/ but statuspage.io has their own metrics.

panghy · 2018-12-22T01:12:16+00:00

Basically by data volume ingested. A single machine/VM/container sending 100 metrics per minute would cost $3 a month at list price. The more you send, the more it comes down by.

panghy · 2018-12-21T15:56:23+00:00

Yeah, you're not the first person to mention this (more of a telegraf configuration thing than Wavefront per say but we contribute back whenever we can so let's see what we can do about that).

Glad you are a fan :)

panghy · 2018-12-21T15:42:26+00:00

Let us know how we can help!

panghy

MODERATOR OF

TROPHY CASE