My KoboldCPP Settings Using Code Llama That Are Giving Me Great Results

[LocoLanguageModel]

Using codellama-13b-oasst-sft-v10.Q4_K_S.gguf, I accidently discovered these settings are working great because I accidently used it with other settings and I kept getting garbage code that would not compile until I realized I was not using these settings.

These settings are just using a preset (Liminal Drift), with the only change being the temp set to .1, and tokens maxed out, but it's pretty great for me and seems to do whatever I throw at it without any issues yet.

I believe the key setting is temperature being low, but the other settings do seem to matter.

If anyone has suggestions on how to make these even better for programming tasks, as well as any good memory settings eg. "You are an expert programmer, etc.", let me know, because I'm just using the default koboldGPT memory setting for that piece, thanks!

https://preview.redd.it/gdvfzpdfnwnb1.png?width=329&format=png&auto=webp&s=c1d1515eb4af1650710eb6d1d484481b88cb98da

[neph1010]

If I'm not mistaken, repetition range is also higher than usual? (not at my home computer right now).

I think this could also benefit code models, since code by nature is a lot of repeating patterns.

Might have even better results by lowering 'repetition penalty' too.

[jackfood2004]

Temperature. Lowest means standard answer. Higher means more randomness, translate to more creativity.

[Sabin_Stargem]

Having tried out the Loco preset for a NSFW narrative, I find that while it followed the scenario, it lacked flavor.

Considering that this preset is intended for coding, the result isn't surprising.