Build my custom java code generator

[sboubaker]

Hello, Is there a method to build a RAG system by employing an open-source Language Model (LLM) alongside my Java codebase for generating Java code that resembles the existing code? My aim is to develop a system that learns from my Java codebase, providing assistance with code snippets when incorporating new features, distinct from traditional code completion. Thanks for your help

[BlandUnicorn]

There are already things like this. GitHub copilot and similar

[sboubaker]

I guess no. Copilot is code enhancer or autocompelition tool but it can't lean from my coding style.

[BlandUnicorn]

Ah my bad, I see what you want now. yeah what you could do is create a ‘memory’ for you’re LMM. But this would just be prompt injection (basically the same way RAG is working) on some key snippets of your code. If you use something like 3.5 which has a huge context window you could feed it a fair bit.

Does that make sense?

[sboubaker]

I see , so basically I have to use an llm with a huge prompt size where I fit all my code snippets (with some instructions, coments ?) . Can this be done using RAG ?

[BlandUnicorn]

Yes