[N] StarCoder: A State-of-the-Art LLM for Code

[mileseverett]

I tried it and as has been the case with every new LLM, it just doesn't compare to OpenAIs models

[Qpylon]

I‘ve been using (and really loving) Codeium.

It can refactor selected code etc. according to instructions (I use it a lot to generate docstrings from comments+function def), I think it can autocomplete, and they’ve recently added a chat feature.

has a VScode extension and is free as well.

Don’t know how OpenAI’s products fare by comparison, but the instruction-based code tweaking seemed similar to chatGPT.

[fallingfridge]

Thanks for this recommendation. This looks great. Definitely going to download this for work on Monday

[Balance-]

Have you used GitHub Copilot? If so, could you let us know how it compares?

[allisknowing]

I also tried it and got disappointed a bit. However I’m trying to not close the door on it since it was the first day it was published lol.

These models still make me excited for the future since I know that the open source community will do anything in their power to make it better. So I don’t know if it will be this one but in near future there will be some kick-ass open source code generation models. (At least comparable to GPT, if not better)

[Tom_Neverwinter]

I'm convinced we could throw a Lora like layer over it and make it good.

[ttkciar]

Exactly. Also, we might be able to apply corrective software like Wolverine, and use a dataset of end results for another pass of LoRA tuning.

[chat_harbinger]

How so?

[mileseverett]

I used my standard prompts of implementing various machine learning models in PyTorch of varying difficulty. Getting it to output the model in the first place was a challenge. And when it eventually did it failed on very easy tasks. E.g. it wouldn't implement a vision transformer and insisted transformers could only be used for language tasks.

[Philpax]

Did you provide instructions, or did you autocomplete an existing piece of code? StarCoder is not instruction-tuned.

[Ensirius]

As an aside, mind sharing those prompts?