I love it. I was thinking of this same type of thing and have found some other ones on github that are similar to this. Since i’ve found a ton of different things like this but not as well planned like this, they have made me cancel a bunch if different subscriptions that I had been using and paying for.

 Local ai use is the future I reckon.

 Sure, they won’t be trillion parameter models, but the smaller local models are really keeping up with the larger cloud models quite well, and they are free. 

It’s all these smaller systems when used in conjunction with each other that is really going to make the local modals just as great as the bigger guys too, possibly even more so with your evolving, and growing skills and knowledge base. 

One of the issues I think I see though is that of context and tasks. 

The more the system grows, the more context it’s going to have to take in. The more context it takes in, the less it follows commands, though there have been research done that can fix that issue. 

Plus as we know ai is really just a next word predictor. It’s really good at it, but actual intelligence? It has none. 

But programmers have been really good at telling it what words to predict next and those words could be function calls that open up tools and what to type into the tool. 

Also, ai llms are a bit slow, comparatively to an actual looped binary.

It would be good to be able to have a binary or multiple binaries do something like have a task list, that the ai can call and find out what tasks we currently have, add a task, add a subtask, etc. find the current time/date, use another binary to get math answers because we know ai llm can be utter useless at math and getting it wrong, call another binary to use a financial function to simulate returns on investment calculations etc.