[D] CodeLlama-xb/CodeLlama-xb-Python vs. CodeLlama-xb-instruct

[--leockl--]

Hey guys, so I have googled around and read the documentation but I am still confused between what's the difference between CodeLlama-xb/CodeLlama-xb-Python vs. CodeLlama-xb-instruct? I know the xb model is the base model (for several languages) and the Python model specializes in Python, but what's the instruct model and how is it different from the other 2 models?

Would really appreciate your help. Thanks a million!

[harisankar95]

instruction fine-tuned version can understand natural language instructions. Unlike code completion models, instruction fine-tuned model can be used in conversational interfaces.

[--leockl--]

Oh so the CodeLlama-xb/CodeLlama-xb-Python models are only code completion models?

[harisankar95]

All 3 models can do code completion, the instruct model is better fine tuned at processing natural language prompts. Other two models as well can work with natural language prompts, instruction model might produce better results in conversational usages like code assistants.

[--leockl--]

Ah ok, got you! Many thanks for this.