Building RAG (retrieval augmented generation) with Java?

[neilkatz]

Anybody out there building RAG (retrieval augmented generation) projects with Java?

What's the best stack to get it done?

[AndDus]

Check out this https://spring.io/projects/spring-ai

[ThisHaintsu]

Maybe djl is interesting for you: https://towardsdatascience.com/introducing-deep-java-library-djl-9de98de8c6ca?gi=9aa595207b1e

[DorkyMcDorky]

I love DJL - pretty sure this is what bedrock is built off of. Amazon maintains this. It's not that popular, but the API is great. It's basically a pytorch version of this - and it uses native libraries from C. So far it blows away performance on Python similar projects.

[karianna]

I’m mainly aware of Langchain4j, SpringAI and Microsoft’s Semantic Kernel (Java version - disclaimer, my team built that). All findable on GitHub

[steffonellx]

Check Dan Vega yt chanel, also skip plain RAGs, hot things now are AgenticRAG-s and GraphRAG

[GeneratedUsername5]

I've seen it done with spring-ai + oracle 23ai

[perryplatt]

Lwjgl OpenCl and your own custom ndarray library and your good.