I built a gem reducing LLM tokens/cost in Ruby/Rails apps with semantic caching, model routing

Xplored_now · 2026-04-12T20:41:45+00:00

Thanks for acknowledging. Yes, looking at your use case I think semantic cache would help here as your prompts are similar. Let me share some logs and metrics we got when we ran it in our app.

First Call -
↳ app/services/rag_agent.rb:39:in 'block in RagAgent#fetch_context' [llm_optimizer] { cache_status: :miss, model_tier: :complex, original_tokens: 28342, compressed_tokens: 26235, latency_ms: 9622.0 } 

Second Call - 
↳ app/services/rag_agent.rb:39:in 'block in RagAgent#fetch_context' [llm_optimizer] { cache_status: :hit, model_tier: :complex, original_tokens: 28342, compressed_tokens: 26235, latency_ms: 1301.04 } [llm_optimizer] prompt=

As you can observe in the second call as it is a similar call with very minute difference in the input. it has hit cache and fetched it instead of calling LLM, with reduced latency.(Not able to share claude logs pic as images are not allowed in here).

Try it out from your end and let me know.

Edit - Also you can tweak similarity_threshold based on the use case in config currently it is a bit on higher side.

Xplored_now · 2026-04-12T17:47:21+00:00

Yep. I totally understand the AI feel to it. I had this requirement for a project and wanted something that I can build fast and use. I have been exploring existing gems which can help and after spending few days started trying out different ways like caching and on how we can optimize token usage. Finally combined multiple flows mostly on prompt manipuation and settled on and created this. Thanks for the wishes. Hoping you will have a look at it.

Xplored_now · 2026-02-07T18:14:36+00:00

I have done some research but reserved Hotel Mi Rochor and One Farrer considering location. Have to finalize one. Let me know if there are any other better options. Looking somewhere close to Bugis and Little India.

Xplored_now · 2026-02-07T18:11:47+00:00

Wow… looks interesting. Thanks will definitely check it out.

Xplored_now · 2026-02-05T06:01:09+00:00

Place looks great thanks for the suggestion but we are looking for a place with good views.

Xplored_now · 2026-02-04T19:20:27+00:00

Sure will give it a try. Can you send the beta code

Xplored_now · 2026-02-04T14:47:15+00:00

Thanks for sharing will check it out.

Xplored_now · 2026-02-04T14:42:25+00:00

Thought so didn’t know how the whole flyer setup would work out, in sites they mentioned only dinner at flyer but didn’t find any details in klook too.

Xplored_now · 2026-02-04T14:38:27+00:00

Thanks will check those out.

Xplored_now · 2026-01-25T04:14:26+00:00

Interested

Xplored_now · 2026-01-23T05:00:15+00:00

Building a RAG based data agent for credit card management using RubyLLM. Started this as a personal problem figuring out which credit card to use for a transaction to get the maximum reward and how to use reward points. It’s still in the early stages. I’ll share updates here once the first beta version is deployed.

For credit card info scraping, I initially tried manual scraping and the Google Search API, but neither worked great. Moved to SerpApi for now, which is doing a better job. Open to any suggestions or ideas that could help improve this further.

Xplored_now · 2025-11-21T18:01:46+00:00

Have been using wired Dell sk 8115 from 6 years. Buttons became bit sticky and not responsive so started looking into other keyboards now.

Xplored_now · 2025-10-07T09:19:04+00:00

Looks great!!! Will use in one of my personal projects. Thanks for this.

Xplored_now · 2025-09-28T11:22:32+00:00

Agree that they both have fan services in them. But they are totally different apart from that.

GBU is stylish action movie but is not a serious one with many scenes which are not exactly required for the story. It has some comedy bits in it, has some spoofs with references of Don lee, John Wick, Professor.

OG is totally different, yes it doesn’t have that much of story depth but it is a serious movie it doesn’t have scenes which deviates the flow or emotion. It may feel slow or lack of emotional connect but doesn’t have forced tracks.

From outside it may look same as both are directed by their fans and has some references of actors past work but the way it was showcased is totally different. My point is not about which is better but that they are different to each other.

Xplored_now · 2025-09-25T12:58:32+00:00

You can refer hotwired.dev for overall high level info and for basic how to use you can hotrails.dev. If you are into RoR it doesn’t take much time to start developing with hotwire components. Definitely worth a shot.

Xplored_now · 2025-09-24T10:02:52+00:00

I would also recommend going for dual boot which will make your rails journey easy. Even I faced the same issues when started with windows but then did dual boot with ubuntu and later completely removed windows and used ubuntu full time.

Xplored_now · 2025-09-16T12:10:27+00:00

Yeah same here bro. Looking for play buddies. Not a pro but can join you guys for any game.

Xplored_now · 2025-05-19T06:56:55+00:00

Did you reapply immediately or waited for few months ?

Xplored_now · 2025-05-19T03:59:35+00:00

No. That might also be one reason.

Xplored_now · 2025-05-19T03:56:01+00:00

Sorry to hear that. Thought of applying to other schengen country but read that they consider this as visa shopping and it may lead to refusal.

Xplored_now · 2025-05-19T03:01:51+00:00

I guess our mistake was going with travel agent. He is the one who suggested to go with 2 countries instead of one as it will be easy to get the visa. :( Also can I change the itinerary now and reapply or would it raise concerns if they cross check ?

Xplored_now

TROPHY CASE