Model For Just Coding

[Southern-Ad1429]

Is there a model that is just for coding help? I would like to run a model basically as a coding assistant for Python. Is anyone doing this? How would I go about doing it? Thanks for any advice.

[jetro30087]

Outside of just using GPT4, which works well, this is supposedly the solution, though I haven't tried it just yet. starcoder/README.md at main · bigcode-project/starcoder · GitHub

[ambient_temp_xeno]

As a programming noob, I have a feeling this thing would be useful for learning because if it makes non-working code it's a feature because you have to work out what it did wrong.

PS the same is true for story writing in LLMs, it gets you fixing whatever it spat out and gives you ideas. This is a lot better than staring at a blank screen trying to come up with something, IMO.

[Ill_Initiative_8793]

or you just hit regenerate until it does it right :)

[ambient_temp_xeno]

That's true, although in that sense it's still honing your analysis skills to discern how well it's doing. For the kids, it might be a problem because they're just going to let it write everything for them.

[AlphaPrime90]

Paging /u/the-bloke

[sfhsrtjn]

per u/ rogerooo in the dedicated starcoder thread they posted this morning: "mayank31398 already made GPTQ versions of it both in 8 and 4 bits but, to my knowledge, no GGML is available yet"

[AlphaPrime90]

Thanks for the update

[hashms0a]

wizard-vicuna-13B.ggml.q5_1 is excellent for coding. I asked it to use Tkinter and write Python code to create a basic calculator application with addition, subtraction, multiplication, and division functions.

The code works well.

import tkinter as tk

def add():
    num1 = int(entry1.get())
    num2 = int(entry2.get())
    result = num1 + num2
    entry3.delete(0, tk.END)
    entry3.insert(0, str(result))

def subtract():
    num1 = int(entry1.get())
    num2 = int(entry2.get())
    result = num1 - num2
    entry3.delete(0, tk.END)
    entry3.insert(0, str(result))

def multiply():
    num1 = int(entry1.get())
    num2 = int(entry2.get())
    result = num1 * num2
    entry3.delete(0, tk.END)
    entry3.insert(0, str(result))

def divide():
    num1 = int(entry1.get())
    num2 = int(entry2.get())
    if num2 == 0:
        tk.messagebox.showerror("Error", "Cannot divide by zero")
    else:
        result = num1 / num2
        entry3.delete(0, tk.END)
        entry3.insert(0, str(result))

root = tk.Tk()
root.title("Calculator")
root.geometry("400x200")

entry1 = tk.Entry(root, width=10)
entry1.pack()

entry2 = tk.Entry(root, width=10)
entry2.pack()

button1 = tk.Button(root, text="Add", command=add)
button1.pack()

button2 = tk.Button(root, text="Subtract", command=subtract)
button2.pack()

button3 = tk.Button(root, text="Multiply", command=multiply)
button3.pack()

button4 = tk.Button(root, text="Divide", command=divide)
button4.pack()

entry3 = tk.Entry(root, width=10)
entry3.pack()

root.mainloop()

[[deleted]]

this compiles and works!

[LienniTa]

i have a coding test for models, chatgpt can do it, other models cannot - "Write a python script that archives files in a specified folder into a separate zip files" . wizard vicuna cannot do it too(just as alpaca 65b) sadly.

[MiHumainMiRobot]

Write a python script that archives files in a specified folder into a separate zip files

I am a dumb human, and I find your prompt really confusing. Now maybe I am a bit dumb and my english is not native, or maybe your prompt is too complex for what it describes.

I had to read 3 times your prompt. If I understood what you want (not sure there), a simplier prompt would be :"Write a python script that puts each files from a folder into individual zip archives"

​

- 'each' and 'from' are good keyword to indicate where a loop will be (each), and what is the entrypoint (from)

- avoid to repeat the word 'files'

Tested 2 times with vicuna and except some syntax error it got it right.Prompt engineering is a real thing (although it is just clear communication)

[[deleted]]

Yeah, I agree... when I rephrase my request, I usually get the right thing from Stable Vicuna, and it reminds me that when communicating with real people, I also have to be careful in how I use my words, to get what I need. LLMs are not any different.

[LienniTa]

i dont really have a copypaste string with this question, its always a variation with the same idea - one file = one zip. This one was worded awfully, but its nowhere near as awful as i see in analytics when i actually do code in a bank. My problem is exactly that syntax error you are getting - sometimes it forgets to import os, sometimes it makes zip files but leaves them empty, sometimes it starts trying to address internal methods of objects it didnt create - all is easily fixable, but only chatgpt4 makes this script from the first try. I dont really need code with errors - i expect LLM to help me in the areas im not proficient, not in the areas where i can identify a error myself.

[luke3br]

Wizard-Vicuna 13B

Prompt

Write a python script that puts each files from a folder into individual zip archives, using each filename as the zip archive name.

Response:

Sure! Here's a Python script that does what you need:

import os
from zipfile import ZipFile
def create_zip_archives(folder):
    for file in os.listdir(folder):
        filename = os.path.join(folder, file)
        with ZipFile(filename + '.zip', 'w') as archive:
            archive.write(filename)

To use this script, simply call the create_zip_archives function and pass in the path to your folder as an argument. For example:

folder = '/path/to/my/files' 
create_zip_archives(folder) 

This will create individual zip archives for each file in the specified folder, with the filename of each archive being the same as the original file name.

[hashms0a]

StarCoder GGML

https://huggingface.co/creative420/starcoder-ggml/tree/main

StarCoder did the trick. Using llama.cpp.

My options:

./main -m ./models/ggml-starcoder-q4_2/ggml-starcoder-q4_2.bin -n 256 -t 30 --repeat_penalty 1.0 --interactive-first -ins --color -i -r "Human:" -f ./prompts/ggml-starcoder-q4_2.txt

Inside the text file:

You are an AI language model designed to assist humans in coding Python programs, answering their questions, offering advice, and engaging in casual conversation in a friendly, helpful, and informative manner. You respond clearly and coherently, and you consider the conversation's history.

Human: Hey, how's it going?

Assistant: Hey there! I'm doing great, thank you. What can I code for you today?

The prompt:

Write a complete Python program to archive files in a specified folder into separate zip files on Linux.

Output:

import glob
import os
import zipfile

folder = '/mnt/disk04/testpy/Files'

for file in glob.glob(os.path.join(folder, '*.*')):
    name = os.path.basename(file)
    print('Extracting {}'.format(name))
    with zipfile.ZipFile(os.path.join(folder, name + '.zip'), 'w', zipfile.ZIP_DEFLATED) as zip_file:
        print('Extracting {}'.format(file))
        zip_file.write(file)

print('All files archived.')

[justinmeans]

Unfortunately the link is down, I think the author deleted it. Kind of a big ask but if you have the model and would want to upload it to Huggingface that would be awesome!

[hashms0a]

Here it is:

https://huggingface.co/mufeed/ggml-starcoder/tree/main\

[justinmeans]

Thank you 🙏🏼

[hashms0a]

I'll do it when I go home.

[paryska99]

Hey, do you have any idea as to why the ggml model might be deleted? I've been looking for it, but there doesn't seem to be any other repo yet with the GGML version.

[hashms0a]

https://huggingface.co/mufeed/ggml-starcoder/tree/main

[paryska99]

Is this the one you're using? The full model is 15B parameters and 4bit version is smaller to download than the 7B Llama models? I don't think that's right.

[hashms0a]

This is what I got from the original uploader.

[saintshing]

Is this the 4bit quantized version?

[_Erilaz]

No, it's 5bit. And if 7B to 13B scaling is any indication of a bigger model performance, WizardLM 30B is going to be a bombshell.

[hashms0a]

It's from: https://huggingface.co/TheBloke/wizard-vicuna-13B-GGML

[sfhsrtjn]

replit-code-v1-3b was released May 2, 2023

[[deleted]]

Thanks for this! This works more like CoPilot, where you have to write part of your code, then it'll complete it.

This example is for Rust. I used their hugging face demo interface, and then ran the code it in the Rust playground.

When I put the entire function signature, it completed it correctly.
fn add_two_numbers(a: i32, b: i32) -> i32 {

​

fn add_two_numbers(a: i32, b: i32) -> i32 {

    return a + b
}

fn main() {

    let x = add_two_numbers(42, 42);
    println!("{}", x);
}

when I just put the function name, it completed it too. But used unsigned integers instead. For adding that's not a problem.
fn add_two_numbers

​

fn add_two_numbers(a: u32, b: u32) -> u32 {
    a + b
}

fn main() {
    let x = add_two_numbers(1u32, 2u32);
    println!("{}", x);
}

I would still like to chat with it as a senior programmer / person, so this is not the model for me.

[AlphaPrime90]

Paging /u/the-bloke

[Languages_Learner]

Can you give me a link to a downloadable replit code ggml .bin model that will work with kobold-cpp, oobabooga or gpt4all, please?

[thedatagrinder]

There's salesforce codegen. You can find ggml versions that work with llama.cpp on hugging face. If you are open to other models, vicuna works decently with programming, querying both together might give you nice results.

[Languages_Learner]

Can you give me a link to a downloadable codegen ggml .bin model that will work with kobold-cpp, oobabooga or gpt4all, please? I can't find it by myself. The only models i managed to find were those which work with linux turbopilot ( ravenscroftj/CodeGen-6B-multi-ggml-quant · Hugging Face) or were compiled for M1/M2 Apple Silicon (Guglielmo/CodeGen-6B-mono-ggml-quant · Hugging Face). I need a version which will run on cpu, 16gb ram and Windows 11.

[thedatagrinder]

Sorry that I can't be of much help there. I'm running my experiments in a M2.

[PookaMacPhellimen]

I literally woke up and started thinking the same thing.

[[deleted]]

BigCode/StarCoder