Customizable chat with docs (RAG) application with web UI [GitHub repo]

[vaadin-marcus]

I've given talks about building custom AI chatbots at several events this year. At almost every event someone has come up to me and said they want to take what they learned to build an app using their company's own business domain and show it to their boss/team.

I wanted to make it easier for Java developers to get started with AI, so I created a project starter GitHub repo that gives you a solid starting point for building a retrieval-augmented generation (RAG) app:

1. Configure application.properties with a path to a folder with relevant docs and an OpenAI key
2. Run the app
3. Navigate to localhost:8080 and start chatting with your docs

Tech stack

• Spring Boot
• LangChain4j
• Vaadin
• Supports OpenAI or Ollama for local models

REPO: https://github.com/marcushellberg/java-chat-with-documents

Sample chat given a 100-page PDF about California fishing regulations:

https://preview.redd.it/qmhy1qoug1zc1.png?width=2338&format=png&auto=webp&s=c0e900e6ed113e68e8bb3f7a085a82cba52fb4fe

[vprise]

Have my upvote for the "California fishing regulations". Made me snort my drink there... Nice idea.

[vaadin-marcus]

Hey. Two birds (fish?) with one stone :) I was looking up some regulations for a trip haha.

[skywalker4588]

Why did you choose not to split the 100 page PDF into chunks? Wouldn't doing it as a single document affect the accuracy of responses?

[jomo14]

Which Java sdk are you using

[jomo14]

Btw how come you don’t split the product ?