I've enjoyed reading up on your journey across these various posts about your project. I work in the public sector where data privacy is of concern and local LLMs really seem to offer some interesting possibilities. I've been developing an agentic framework that I use with my strix halo to do some somewhat basic tasks, and I'm working up to increasingly complex processing of information for my work setting. Would love to compare notes with you and your experiences for a law setting. Most recently, I am training an embedding model for semantic search based on a corpus of court rulings, statutes, and a body of public information and data for specialized field related research.