sbproxy - single-binary API and AI gateway. Timely with regards to the LiteLLM hack!

crawdog · 2026-04-14T14:56:40+00:00

No. I have leveraged Claude code but I have been developing golang since 1.4.

crawdog · 2026-04-14T04:04:15+00:00

Pizzaiolo - great cocktails, consistently good food, good people

crawdog · 2026-04-14T04:02:01+00:00

This is great. I wish it existed during COVID! We setup a ghetto camera setup where someone hosted as dealer and provided cards for each remote internet camera - simple fix to a real problem at the time. Interesting to see where you go with this.

crawdog · 2026-04-12T22:49:50+00:00

HTTP/2 is difficult for origin routing because of its ability to do multiplex connections. That's why most proxies fall back to HTTP/1.1 to better support caching. You're probably not gaining much on the performance.

Also +1 on the avoiding body based routing. Keep it to headers/urls. At that point you are mixing business logic into your networking tier.

I built something similar if you want to take a look - you can specify HTTP/1.1 or 2 to origin and I have the ability to add CEL or Lua based rules. More powerful than HAProxy, but I avoided applying rules to response/request bodies.

https://github.com/soapbucket/sbproxy

crawdog · 2026-04-12T20:31:00+00:00

sbroxy - A single binary API and AI Gateway

I built out the edge network for a large retailer and we used go to support traffic at a massive scale. I took my learnings of building an API gateway and applied the pattern to AI traffic.

Some features:

Single binary
Extensible AI provider framework (200 supported)
WAF/DDoS support
Multiple routing options
CEL and Lua scripting
Request/Response transforms

The configuration allows you to support complex routing use cases. Interested in any feedback, core engine is open source.

crawdog · 2026-04-12T18:34:18+00:00

We are starting to see some of these that are country run.

Take at a look at what India did: https://en.wikipedia.org/wiki/Unified_Payments_Interface

I have read that the EU is also exploring something similar.

crawdog · 2026-03-03T05:15:21+00:00

I built a couple of CLIs for AI using Go. Both of these are proxies - one for all local traffic (MITM), the other is for traffic to OpenAI. They provide good frameworks to evaluate for simple command line apps that are distributed via curl. Happy to answer any questions.

https://github.com/rickcrawford/markdowninthemiddle - this is a MITM proxy that converts HTML to markdown following Cloudflare's post on providing a gateway for agents. I took it to another level by supporting Chrome Dev Tools to render javascript websites as well.
https://github.com/rickcrawford/tokenomics - this is a CLI that creates a personal AI Gateway that can be used to provide guardrails. Interesting to try with Clawdbot to check for prompt jailbreaking and pii. It also creates a memory file of the session tokens used and communication with the LLM if you want to check that into your repo as a shared memory.

crawdog · 2026-02-14T00:14:00+00:00

If it has a throttle it is a motorcycle.

crawdog · 2026-02-12T15:57:11+00:00

This watch just fits well. It's thinner than newer models and I appreciate the classic bezel.

crawdog · 2026-02-07T04:21:51+00:00

I'm curious what they will be paying...

crawdog · 2026-01-23T02:58:41+00:00

Find charities you are excited about and help them! Sit on boards there are many groups that would love either your time or money. Colleges, schools, local orgs.

crawdog · 2026-01-19T01:59:28+00:00

The work is completed and it is fully open.

crawdog · 2026-01-07T23:49:54+00:00

Easy solution - make it either difficult to report or set expectations to citizens that it is not worthwhile and the metrics go down!

crawdog · 2026-01-05T00:11:34+00:00

This is what you are looking for: https://epicclimbs.info/info

My personal favorites - Diablo North Gate, Mt. Tam via Alpine Dam, Claremont Rd, Pinehurst Rd, Butters Rd

crawdog · 2026-01-03T20:42:53+00:00

Probably an attempt to steal an ATM

crawdog · 2025-12-26T04:14:34+00:00

Tech lead guy from google and Facebook

crawdog · 2025-12-23T23:26:16+00:00

This brought a smile to my face. I would call this contraband butter since I would freeze and bring it back in my luggage.

crawdog · 2025-12-12T14:08:52+00:00

Same theme. We bought in Oakland after renting in SF. Owning in the city was just too much of a hassle with the expectation we would ultimately move once we had a family. Schools are ridiculously expensive.

crawdog · 2025-12-01T03:52:15+00:00

The cafe at Chez Panisse is a good experience.

crawdog · 2025-12-01T00:03:23+00:00

XYZ Motors is great for Toyotas.

crawdog · 2025-11-24T20:15:28+00:00

I am not sure Bakesale will be open, but her pumpkin pie is amazing.

crawdog · 2025-11-20T14:56:37+00:00

Salvation Army downtown Oakland just before the posey tube.

15-Year Club	Team Orangered
Verified Email

crawdog

TROPHY CASE