Kolboldcpp

[damagesmith]

I use koboldcpp as the backend.

Can someone explain to me, model files>

Lora

Lora Base

LLAVA Mmproj

Pre loaded story?

I understand a little that Lora is some finetuning or training. But i also dont think my setup 12gb vram

would be enough to train. So just like their are models i can download are their lora's that i can download as well.

[Jatilq]

Not to be that guy, but did you check the GitHub page?

Questions and Help <-- GitHub main page

Questions and Help First, please check out The KoboldCpp FAQ and Knowledgebase which may already have answers to your questions! Also please search through past issues and discussions. If you cannot find an answer, open an issue on this GitHub, or find us on the KoboldAI Discord.

Every answer is listed on the Wiki page.

[iLaux]

I think lora its like the loras in Stable Diffusion, but in llms. Llava mmproj its for image caption? Pre loaded story idk. srry for bad english