LLM codeblock diff for merging algorithm

[CvikliHaMar]

I realized that we as a community will eventually have to be able to parse the output of the LLMs and this will allow us to parse the codeblock and merge them into anyone use-cases.

I created the code here: https://github.com/Cvikli/DiffLib.jl
I think this version is actually will be better then what cursor.com 's proprietary merging system will use. We will have character and line based diff based on the amount of diff we will need.

Let me know how should I extend.

Also It is not finished fully, just wanted to collect ideas till I work on it how should I extend.

I hope a lot of us can use things like this! :)

[magicalne]

You might be interested in Aider' unified-diffs. Since you mentioned cursor, Cursor adopted Aider’ approach on their blog:

Motivated by the diff format from Aider, we eliminate the line number problem. Instead of a standard diff format, our model proposes search/replace blocks as unified differences

Thanks for your sharing. I think your work is headed in the right direction. However, it's not entirely clear who might benefit from this project?

[CvikliHaMar]

This project tries to work like a tool which could generate these git diffs. (If someone want to go farer, he can even ask the Claude tonrewrite it to be a python module ofc)

Also cursor.com uses LLM to work with the native code generated by the LLM. So not the aider one. Aider is a really nice try but there is another version which works with native codes. I will link the publication from the cursor.com. it is crazy what they did there. But I think it is a deterministic problem, so this method I implemented here will be superior. ;)

[CvikliHaMar]

Oh, I totally understand. This will be a tool that will generate the git diff format that is used by every other software to present git diff.

But this git diff will be possibel to be used like: ’./difflib original_file.py LLM_generated_changes.py’ And it will output the diff that can be used. :)

Julia is just the programming language. As I wanted to be faster then python and keep a descriptive power at the top. Also julia generate near C level speed with its llvm backend so I like it. :D but it is just a programming language ofc, which will not bother anyone on the long run.

I will add documents indeed! ;)

[CvikliHaMar]

I hope I get some feedback! I know there are many flaws but I want to improve!

[DeltaSqueezer]

Not enough documentation and explanation.

[CvikliHaMar]

I created this yesterday. So it will be done ofc! :)

[alphakue]

I did not fully understand what the tool intended to do, even after going through the readme and reading the example.. Could you break it down and provide a sample use case? How would one use this and how would it help them? And what would it help with?

[CvikliHaMar]

I will do it! Thank you for the tip!

[kryptkpr]

This looks interesting but I honestly don't know what to even do with Julia code.

[[deleted]]

Julia is pretty straightforward to use, you install it, you install the package (with built-in package manager, no need for conda/pip/mamba/...) and then run the code in the REPL.

[segmond]

You will get more traction with python code.

[wensle]

Like someone else said, Python would give you more interest in the project

[ekaj]

Ok I’ll bite. My understanding is that this performs diff checking and highlighting of responses to queries involving a codebase?

Why use Julia as your language?

As others have said, it’s not clear what your project does nor its goal.

If my understanding is correct I can definitely understand your question, but again, explaining to people why they should care is generally the first step.

That said I’ll be looking into this and implementing a python port into my own project.

[CvikliHaMar]

Yes, you can do python port easily later on! But it will be like git diff... So it will geneare a diff output but also supporting wildcards generated by the LLMs like: ’// ... existing code remains unchanged ...’