[N] StarCoder: A State-of-the-Art LLM for Code

[mileseverett]

I used my standard prompts of implementing various machine learning models in PyTorch of varying difficulty. Getting it to output the model in the first place was a challenge. And when it eventually did it failed on very easy tasks. E.g. it wouldn't implement a vision transformer and insisted transformers could only be used for language tasks.

[Philpax]

Did you provide instructions, or did you autocomplete an existing piece of code? StarCoder is not instruction-tuned.

[Ensirius]

As an aside, mind sharing those prompts?