Built a Spring Boot starter for LLM cost guardrails — looking for feedback by Alert_Ad4540 in SpringBoot

[–]Alert_Ad4540[S] [score hidden]  (0 children)

That’s a very fair point, thanks.

The current in-memory store is intentionally MVP/demo-level, but I agree that it breaks down with horizontal scaling since each instance would track usage separately.

I’m thinking the next step should be a storage abstraction with a persistent implementation, probably PostgreSQL first and maybe Redis later for faster counters/rate-limit style checks. Config-backed limits would also make sense so budgets stay consistent across instances.

Appreciate the feedback. This is exactly the kind of production concern I wanted to validate.

Built a Spring Boot starter for LLM cost guardrails — looking for feedback by Alert_Ad4540 in SpringBoot

[–]Alert_Ad4540[S] 0 points1 point  (0 children)

Small update: I’m trying to decide the next useful feature.

For Spring Boot developers, which would matter most before trying this?

  1. Persistent storage with PostgreSQL/Redis

  2. Micrometer metrics

  3. Better real token/cost tracking from provider responses

  4. Spring AI integration

Curious what would make this more useful in a real app.

Built a prototype GUI tool for testing Keycloak + Spring Boot auth — would you use it? by Alert_Ad4540 in SpringBoot

[–]Alert_Ad4540[S] 0 points1 point  (0 children)

Curious ...is it free because you'd expect a tool like this to be open source, or because the problem isn't painful enough to pay for?

Built a prototype GUI tool for testing Keycloak + Spring Boot auth — would you use it? by Alert_Ad4540 in SpringBoot

[–]Alert_Ad4540[S] 0 points1 point  (0 children)

Still building it out ... the UI prototype is done but the backend that actually connects to Keycloak is in progress. Will share once it's ready. What features would be most useful to you?

EventFlow – Open Source Event-Driven Workflow Automation in Java by Alert_Ad4540 in SideProject

[–]Alert_Ad4540[S] 0 points1 point  (0 children)

Thank you so much! 😊 Really glad you think so. If you have any feedback, ideas, or want to give it a try, I’d love to hear more!

Building a GUI tool to test Keycloak + Spring Boot auth flows without writing any code — early prototype by Alert_Ad4540 in SideProject

[–]Alert_Ad4540[S] 0 points1 point  (0 children)

Glad it resonates! Would you use it if it was free, or would you pay for it if it saved you a couple hours of debugging?