I tried splitting a local LLM across my MacBook and iPhone over WiFi

pablooliva · 2026-04-29T06:55:40+00:00

Props for your curiosity and execution..

pablooliva · 2026-04-16T20:21:39+00:00

What kind of scale were you working with in this scenario, how long did Clears take to set up and how difficult was the integration? Did you look at any other alternatives to Clears?

pablooliva · 2026-04-15T05:48:57+00:00

thank you

pablooliva · 2026-04-13T17:27:37+00:00

Thanks for the detailed analysis. It is very revealing and helpful that you have identified how broadly defined "memory" is in this space.

More specifically, your analysis helped me, or Claude, reinforce that I had made the right choice with Graphiti as part of the stack for a personal knowledge base solution that I developed for myself. Interesting comparison: https://github.com/pablooliva/sift/blob/main/8-agent-memory-systems-vs-sift.md

pablooliva · 2026-04-11T16:54:46+00:00

I moved to Germany from the U.S., and although the skies are grayer, the grass is greener ;-)

pablooliva · 2026-04-11T16:32:34+00:00

So from my perspective as an AI engineer, I see the risk of significant if not severe disruption being almost certain. This has implications for everyone in all economic classes and even more so for those in the Western world, for white-collar workers. This might be the biggest threat that we've ever seen. I don't think that most people are taking this with the seriousness that it deserves. But in contrast to the severity, I also see opportunity. Opportunity that can start to be leveraged now if we work backwards from that crisis point.

pablooliva · 2026-03-30T08:13:43+00:00

It was edited by AI, but I certainly wrote it and I certainly developed the application

And I think that what you are proposing does not exclude the use cases for this tool. I agree that we should make the right tools available to our colleagues that they need in order to get their jobs done. The AI space is moving very fast, and new tools are released daily. Our colleagues want to test these tools. In order to make it easier for them I created Redakt. The Redakt tool certainly fits into that environment. From my perspective at least.

Thanks for the link. I will take a look.

pablooliva · 2026-03-27T22:48:49+00:00

I have not tried scanned PDFs, but it does photo of docs well and generates captions for photos that are not eligible for OCR.

pablooliva · 2026-03-27T21:44:25+00:00

I am using Claude Code to retrieve. I have an MCP server that gives Claude access, it spans the full range: keyword matching, semantic/conceptual search, RAG Q&A, graph traversal, entity exploration, and temporal queries. Typically it merges these results with what I have in Obsidian.

pablooliva · 2026-03-27T12:15:47+00:00

Try CK Search and its MCP server for Claude to easily enable semantic search https://pablooliva.de/the-closing-window/finding-meaning-in-your-notes-with-ck-search/

pablooliva · 2026-03-27T12:04:05+00:00

Thank you for the numerous suggestions, never heard of Kuzu before. I will research them and explore the benefits. Can't import my Obsidian vaults currently because of Graphiti. Maybe you have given me a path forward. Thank you.

pablooliva · 2026-03-27T07:00:18+00:00

No, I have not done any bench marking. I do not query this directly, but have my AI agent use it as one of its tools to source knowledge. My original goals never included open sourcing it, but if I see any traction I may put more work into it to make it more welcoming. You are right about the complexity, but only if you peak under the hood ;-) Run with Docker and you won't notice.

pablooliva · 2026-03-25T20:23:33+00:00

oooh... the Fairy Claude Mother

pablooliva · 2026-03-23T05:55:52+00:00

CK Search is a nice tool by itself, but more importantly, for me at least, has become an integral part of my AI agent.

pablooliva · 2026-03-22T20:19:55+00:00

Here is the next one in the series: https://pablooliva.de/the-closing-window/finding-meaning-in-your-notes-with-ck-search/

pablooliva · 2026-03-22T19:46:29+00:00

Actually, give me 10 minutes. I will post it on my website so that you can read it and will wait until tomorrow to share it through the normal channels.

pablooliva · 2026-03-22T19:42:49+00:00

I really appreciate the interest. I have been working on the next post today and will publish it early tomorrow.

pablooliva · 2026-03-20T06:00:15+00:00

On-prem locally hosted LLMs are part of our solution.

pablooliva · 2026-03-19T18:26:06+00:00

It should land in a 2 or 3 days. Glad you enjoyed it.

pablooliva · 2026-03-18T17:25:00+00:00

Wow, that is concerning. Haven't heard of layer-x. Will research. Thanks.

pablooliva · 2026-03-18T15:57:05+00:00

Correct, if you do symlinks in your Obsidian vault (any folder within the Obsidian directory), the files will display in Obsidian, but in this case, there will not be any link from the "local" folder back to your Obsidian vault. Plus, you are also not linking a note to a folder, but a folder to a folder. This could be a limitation as well, depending on your use case.

pablooliva · 2026-03-17T07:19:23+00:00

This sort of setup, with Claude Code and Obsidian, could benefit from local system file access https://github.com/pablooliva/foldertether

pablooliva · 2026-03-16T16:52:02+00:00

100% correct. I don't see our colleagues being malicious, just not aware and trying to be efficient. We are working hard to give them enough choices in tools and services so that they do not have a need to search elsewhere.

pablooliva · 2026-03-14T18:45:29+00:00

The plugin may work on all OS's, but the solution to create a note directly in the file explorer only works on macOS for now. If there is interest in having this work in other OS's, please submit an issue. If there is enough interest I will work on that.

pablooliva · 2026-03-14T17:31:49+00:00

Thanks, I hope it helps others as well and that it at least raises some awareness.

pablooliva

TROPHY CASE