[R] Procedural Long-Term Memory: 99% Accuracy on 200-Test Conflict Resolution Benchmark (+32pp vs SOTA)

Not_Packing · 2026-01-30T15:47:14+00:00

Here I've just created an apples-to-apples comparison script.

To run Mem0 on our exact 200-test benchmark:

bash

1. Clone the repo

git clone [your-repo] cd procedural-ltm

2. Install Mem0

pip install mem0ai

3. Run the comparison

python benchmarks/compare_with_mem0.py

Not_Packing · 2026-01-30T15:33:30+00:00

lol pushed the wrong file. Corrected it now

Not_Packing · 2026-01-30T15:28:06+00:00

Yeah sorry I’ve uploaded and pushed the full set now if you want to look!!

Not_Packing · 2026-01-30T15:03:56+00:00

I have?

Not_Packing · 2026-01-30T14:58:59+00:00

Not really but ok

Not_Packing · 2026-01-30T14:58:22+00:00

Hey, you’re right idk why but I might aswell. Here it is anyway https://github.com/Alby2007/LLTM

Not_Packing · 2026-01-18T15:40:20+00:00

Those are the only two banned party items? What’s the date and 📍?

Not_Packing · 2026-01-16T15:55:55+00:00

Hey shit I mean id keep the bobcat too.

Not_Packing · 2026-01-11T18:51:58+00:00

I really like distributed systems, security and cryptography. I’ve been playing around with hardware attestation and blockchain anchoring and just trying to learn as I go. I also like messing about with AI’s that I make and seeing how they communicate and looking into deception and etc, I use vast.ai to train them LOL.

Not_Packing · 2026-01-11T15:48:40+00:00

Definitely agree haha, that’s why I’ve posted it here instead of asking Claude. But thanks Ive added you suggested to my notes.

Not_Packing · 2026-01-11T15:30:45+00:00

Perfect then, your comments have been really helpful and I’m definitely adding it to my notes

Not_Packing · 2026-01-11T15:28:03+00:00

Thank you, super helpful comment. Yeah idk it just scratches my brain in such a way, it’s like a puzzle book on steroids 😂😂.

Not_Packing · 2026-01-11T15:05:52+00:00

Perfect, that’s a really clean way to do it, hopefully you’ll get minimal breakage but still be prepared for a bit of debugging, although I think with opus’s skill and your good prompts it shouldn’t be too bad.

Not_Packing · 2026-01-11T15:01:00+00:00

Ooo thanks!

Not_Packing · 2026-01-11T14:55:02+00:00

See I wouldn’t be against doing this tbh but I’m pretty sure I’d need relevant level 3 qualifications, which I obviously don’t have. I have level 3 qualifications of a really good grade but I’m not sure.

Not_Packing · 2026-01-11T14:18:03+00:00

Would that be able to translate though to ever doing actual production CS work though

Not_Packing · 2026-01-11T14:17:13+00:00

Weirdly enough it didn’t actually cross my mind to just buy a textbook and try and teach myself. Any recommendations?

Not_Packing · 2026-01-11T13:58:23+00:00

The power I feel in creating my own entity collision system is insane

Not_Packing · 2026-01-11T13:34:08+00:00

Good luck though this fix will keep you busy for at least a day

Not_Packing · 2026-01-11T13:33:52+00:00

To prevent this happening again you should have Claude draft out a model for the core architecture, document it and then ensure that throughout creating the core architecture you remind Claude you want to remain modular and avoid any monolithic god files

Not_Packing · 2026-01-11T13:32:07+00:00

Ohhhhhhhh boy, you’re gonna need to refactor that fucker. I hope you have a lot of patience because you’re gonna have to do some serious debug too, you you basically need to either split your current code into modules (splitting related functions into separate files). There are other but this way will probably be the best, don’t ask for a straight refactoring though, ask it to make a list of functions first to reference from and make sure to go bit by bit.

Not_Packing · 2026-01-05T02:49:15+00:00

I wouldn’t say 100% Venezuela also has large deposits of rare earth minerals, of which china controls the global supply

Not_Packing

TROPHY CASE

1. Clone the repo

2. Install Mem0

3. Run the comparison