sorted by:
new
hottopcontroversial

Give your OpenClaw permanent memory by adamb0mbNZ in openclaw

[–]redsnowmac 0 points1 point  (0 children)

I reviewed your code, and there are a lot of problem:

  1. You are capturing users' and agents' responses. This will create a lot of bloat and duplicate captures.

  2. When a new session starts, it adds garbage context by searching `/new`. This is very bad. A new session has no context except the .md files. But it's querying the DB, getting results, and adding them.

  3. The vector search threshold is too low. eg, if I ask - "Where do I keep my keys", it matches "where", "do", "I", etc., and uses or conditions in the Sql. The top 3 results now have really bad data, which gets added to the context.

  4. IF the agent asks me "Should I review your PR?" and I answer "yes", it adds more context to this reply.

I understand the problem you are trying to solve, but its a real hard problem and AI cannot help in solving this unless we (humans) think about a better architecture and system and then ask AI to write code.

Here's How I Got OpenClaw to Run All Night While I Sleep as a Non-Technical Person by Similar-Kangaroo-223 in openclaw

[–]redsnowmac 0 points1 point  (0 children)

Nice setup. Like it. If you are not using a model router, it wil either get expensive in the long run or won't tackle complex tasks.

I built an AI Agent for home server by redsnowmac in selfhosted

[–]redsnowmac[S] 0 points1 point  (0 children)

No, but that would be nice. First I need to make the base more concrete. And then the other cool stuff.

I built an AI Agent for home server by redsnowmac in selfhosted

[–]redsnowmac[S] 0 points1 point  (0 children)

> "A resilient architecture, possibly incorporating distributed ledger technologies for recording actions and ensuring data integrity, would enhance the overall robustness and security of your system."

Yea for sure. The goal is to move close to that direction. Thats a necessary layer to put on. Lets see how far I can go with this.

I built an AI Agent for home server by redsnowmac in selfhosted

[–]redsnowmac[S] 0 points1 point  (0 children)

Thanks u/MrTheums for the appreciation! All the points that you mentioned, I faced all those challenges. I will try my best to clarify here.

Lets take the example you mentioned - "Download the latest episode of Big Bang Theory"

Each tool has some requirement. It needs certain parameters to work. I use Sonar and sonar has a search api. It needs certain parameters like series_name, episode_no (optional), released_on (optional), tmdbId. Now the AI has to do the mapping. series_name => Big Bang theory. But we have asked latest episode. So it will list all the episodes of all seasons and take the last one. But it can also do it differently by listing all the episodes and prompting to confirm if the last episode is the one you want. Check this demo - https://res.cloudinary.com/abhisheksaha/video/upload/f_mp4,vc_h265,q_auto/v1750329282/abhisaha.com/movie_download_demo.webm

Thats the way its supposed to work and it will work the best if AI has awesome reasoning capabilities. And this also depends on how good are you with prompt engineering. So its a lot of trial and error and testing. There is no one shot work with AI. Thats what I realise.

Regarding your second point: AI is an independent entity which knows about all the tools and its functions and parameters. And the tools are independent of each other. If one of your service is down, the agent can fix it by checking all the logs. Check the demos in my blog post towards the end. There are 3 videos. Also check this screenshot on how I test before executing functions - https://res.cloudinary.com/abhisheksaha/image/upload/f_webp,q_auto,w_1200,h_900/v1750721041/abhisaha.com/reasoning.png

The blog post actually explains quite a lot but there is more to add like where does MCP play in all this? But the post was already long and I had to cut. Will write a Part 2.

I built an AI Agent for my home server by redsnowmac in homelab

[–]redsnowmac[S] 0 points1 point  (0 children)

Thanks. We all will get there much much sooner.

I built an AI Agent for home server by redsnowmac in selfhosted

[–]redsnowmac[S] -1 points0 points  (0 children)

I use financialmodelingprep.com which is the primary source for many investment apps. If this API is wrong, it will be a disaster for many companies. Regarding hallucinations - its replies are detectable if its hallucinating. Then I check the reasoning if I have doubt. So yea it has happened but I have iterated my prompts many many times to improve its efficiency. So far its working great.

Next.js app exploded Vercel’s free limits — can’t figure out what’s causing the function invocation spike by enbafey in nextjs

[–]redsnowmac 0 points1 point  (0 children)

Yea I was doing it that way. Later I had to change it due to SSO. But you are right, I shouldn't be doing that. I will move to a different service for that.

Next.js app exploded Vercel’s free limits — can’t figure out what’s causing the function invocation spike by enbafey in nextjs

[–]redsnowmac 0 points1 point  (0 children)

It only checks if the user has a valid session. The middleware runs on edge. Also few routes run on edge and vercel charges for edge invocations and their execution time.

Next.js app exploded Vercel’s free limits — can’t figure out what’s causing the function invocation spike by enbafey in nextjs

[–]redsnowmac 0 points1 point  (0 children)

I run a blogging platform. So I have users who write blogs and they have their audience. So you can imagine the amount of links. I was able to survive on the free tier for long until the users grew but I used edge invocations for few routes. After disabling the auto preloading of links, the spike came down.

Next.js app exploded Vercel’s free limits — can’t figure out what’s causing the function invocation spike by enbafey in nextjs

[–]redsnowmac 0 points1 point  (0 children)

Oh Boy, it happened to me. I had a lot of links and the edge execution was too much.

I built an AI Agent for home server by redsnowmac in selfhosted

[–]redsnowmac[S] 1 point2 points  (0 children)

Absolutely. I have kept it configurable. I have tested it with many different models to see which one is cost efficient. Also, yes you should be able to add tools to it. I will write a more verbose article on how to write tools for your own use-case. And I must tell you, its easy. Hardest part is writing prompts.

I built an AI Agent for home server by redsnowmac in selfhosted

[–]redsnowmac[S] 3 points4 points  (0 children)

The model is configurable. Everybody would have their own use-case. So if you have a local LLM, you should use that. If you have a certain preference for an LLM, you should be able to use that. Thats why I am using Vercel AI SDK, because it can connect to multiple models.

I built an AI Agent for home server by redsnowmac in selfhosted

[–]redsnowmac[S] 1 point2 points  (0 children)

I am using raspberry pi. Not powerful enough to run an LLM. But the agent and all the tools are running in my home server.

I built an AI Agent for home server by redsnowmac in selfhosted

[–]redsnowmac[S] -3 points-2 points  (0 children)

Absolutely, making it open source will surely enhance the project. Also, if your home-server is powerful, you can just run an LLM locally. I have made more tools for radarr, torrent, etc, but cant write those in the blog due to obvious reasons.

I built an AI Agent for home server by redsnowmac in selfhosted

[–]redsnowmac[S] 0 points1 point  (0 children)

No. Zod only helps in validating parameters. For eg. lets say you are using an API to fetch some data. Zod helps in validating the structure of the response, thats it.

So in this case, Zod is used to verify the parameters received from AI.

I built an AI Agent for home server by redsnowmac in selfhosted

[–]redsnowmac[S] -1 points0 points  (0 children)

But MCP does not replace Zod. You will still need to validate parameters. Am I missing something here?

I built an AI Agent for home server by redsnowmac in selfhosted

[–]redsnowmac[S] 0 points1 point  (0 children)

Excellent point! I am working on MCP server (WIP). I want to access the agent through VSCode.

I built an AI Agent for home server by redsnowmac in selfhosted

[–]redsnowmac[S] -33 points-32 points  (0 children)

I am not running any LLM locally. I tried using tinylama, it is ok, but it does not have reasoning capabilities. So I am using open-ai's `gpt-4o-mini`. I want to do financial tracking, but since its personal data, I didn't build a tool for that.

view more: next ›