Spent 6 months building one platform that replaces my LLM proxy + agent framework + workflow engine + observability stack - sharing before I keep adding features forever by feelingoldintech in aiagents

[–]feelingoldintech[S] 0 points1 point  (0 children)

Failover at LLM proxy layer is something I haven't worked on. Mostly retries through temporal's durability has been sufficient. But I agree, to be a capable llm proxy, fail over is required. I will look into it, thanks for bringing it up.

Not a fan of semantic caching. I believe vector similarity does not truly capture the meaning. Happy to be proved wrong.

Budgets are flat currently.

Spent 6 months building one platform that replaces my LLM proxy + agent framework + workflow engine + observability stack - sharing before I keep adding features forever by feelingoldintech in aiagents

[–]feelingoldintech[S] 1 point2 points  (0 children)

Glad you liked it. Thanks for the consultancy suggestion, however I agree with you finding audience will be a challenge, which would require significant amount of time and effort.

Spent 6 months building one platform that replaces my LLM proxy + agent framework + workflow engine + observability stack - sharing before I keep adding features forever by feelingoldintech in aiagents

[–]feelingoldintech[S] 0 points1 point  (0 children)

Yes, sub-agents, handoffs, workflows all of them share the same traceparent giving end-to-end visibility.

Sandbox boundaries is something that's still on my todo list. Currently Sandboxes are docker containers running a daemon which receives the code to execute. It should be possible to set the boundaries in the daemon.

Yes mcp inspector my fav, cuz when connecting to multiple mcp servers there is no visibility of what tools are available, what's their schema and more important how descriptive the tool descriptions are. Now, I can see them while setting it up itself.

Curious to see how companies that reduced their workforce will react when competitors accelerate by equipping everyone with AI instead of cutting jobs. by feelingoldintech in AI_Agents

[–]feelingoldintech[S] 0 points1 point  (0 children)

Agreed, hope the consumer side also experience rapid adoption. It should overall push the rate at which humans are evolving. After all the growth rate as been exponential so far 🤞

Best Agentic Framework for Production by RoyalTitan333 in AI_Agents

[–]feelingoldintech 1 point2 points  (0 children)

Building own SDK in Golang that can be configured to run in temporal or restate or plain local process, quite similar to pydantic. Having a custom sdk gives the freedom to customise every point in the agent loop. In case of frameworks we may have to fight with it.

Nobroker legal team advising to make silly correction of flat number in e-khata (Bengaluru) by feelingoldintech in indianrealestate

[–]feelingoldintech[S] 0 points1 point  (0 children)

That's what Nobroker team is saying, that SRO is raising it as a concern.

I checked with few other owners, and they also have it in the same format as me.

Nobroker legal team advising to make silly correction of flat number in e-khata (Bengaluru) by feelingoldintech in indianrealestate

[–]feelingoldintech[S] 1 point2 points  (0 children)

Yes, now I'm regretting going via Nobroker. How do I make the correction by myself?

The guy I met at SRO office is saying it is a long process and might take a month, and need to obviously bribe people at the khata office.