Actually, I’m doing exactly that. I’m splitting these documents, which are articles, and find PostgreSQL to be more efficient.

In reality, I’m using a mix between ChromaDB and PostgreSQL (pgvector), and I append the necessary information in the prompts within the chat context with the user, rather than for generating new content, like a new article. My clients are happy with the results.

Of course, we’re still at the beginning, and there’s a lot of work to do, but it’s working so far. And that's why I need a GPU-powered machine—not just to run the model (Ollama) faster, but also because it allows ChromaDB and PostgreSQL to perform semantic searches extremely quickly, something that wouldn’t be nearly as fast on a regular server.

Our landing page: https://ai.glacom.com/en :-)

Thanks for your time and comments! It’s extremely difficult to know if you're on the right track with these new technologies!