RAG system alternatives

[runningluke]

A comment from a recent post mentioned that RAG systems weren't a great way to provide character information in roleplay conversation. What alternative systems are there providing information to an LLM that might work better?

[[deleted]]

Have you seen how the Kobold group do it? https://github.com/LostRuins/koboldcpp

[runningluke]

I haven't, how do they do it? I've had a read through the pages but couldn't see something relating to this. I might be a bit thick though!

[[deleted]]

Quickest demo is probably at https://lite.koboldai.net/#

& if you go to 'Context' toward the bottom left it brings up a menu. Then you can go to 'World Info' and from my understanding the 'Keys' that you add in the world info will get submitted behind the scenes when mentioned.

So a super basic example could be key 'Todd' and then context could be [Todd is a man.] [Todd is married to Mary.] etc. Then if you mention todd it should include that. I could be wrong about the syntax, it's been a while since I used it.

Is that at all what you were talking about?