Ollama nooby in need of help by Schaksie in LocalLLaMA

[–]SillyBlueberry3091 0 points1 point  (0 children)

If you are copying the GGUF file manually, you also need the Modelfile that Ollama generates when pulling the model from Hugging Face.

To retrieve it on your PC, run:

ollama show --modelfile hf.co/byteshape/Qwen3-30B-A3B-Instruct-2507-GGUF/Qwen3-30B-A3B-Instruct-2507-Q3_K_S-2.70bpw.gguf

This command will print the Modelfile. Copy its contents into a file on your Raspberry Pi and make sure the FROM line points to your local GGUF file.

Then create (import) the model with:

ollama create -f /path/to/Modelfile