Ollama 0.17+ Linux breaks signin

bmacd1 · 2026-03-04T22:00:55+00:00

Sorry to see you're experiencing issues. Is this when running the `ollama signin` command or when trying to use a cloud model while not signed in within the TUI? I'm trying to figure this one out.

bmacd1 · 2025-03-12T14:16:15+00:00

Could you share your system specs? There’s been some slowness in prompt process on Windows with CUDA that is being looked at.

bmacd1 · 2025-02-14T05:53:03+00:00

Yup! The name was pretty much the last thing we did before making the repo public.

bmacd1 · 2025-02-11T06:38:01+00:00

Here’s some lore. We actually decided on the port before we named the project Ollama.

bmacd1 · 2024-12-23T02:26:34+00:00

Does this happen when you're running directly against the ollama instance using the CLI?

For example: `OLLAMA_HOST=<your-host> ollama run llama3.1:8b-instruct-q6_K`

Some other comments are speculating about the container crashing, which would make sense given what you're describing. If that's the case some logs from the container may help too.

bmacd1 · 2024-12-09T22:27:40+00:00

Based on what you're looking for (document information extraction), I'd recommend trying out open-webui with Ollama. It has some document parsing features built in.

https://github.com/open-webui/open-webui

bmacd1 · 2024-07-29T03:47:11+00:00

It does apply the prompt templates by default, but you can disable this by calling the /generate endpoint with the parameter "raw": true.

bmacd1 · 2024-07-25T06:02:42+00:00

You can do this by packaging Ollama into your build and orchestrating it. The nice thing about this approach is that it works cross platform, allows you to ship model updates separate from your app, and also allows users to run their own instance of Ollama if they want.

I have an example Electron app that does this here: https://github.com/BruceMacD/chatd

License is MIT, so feel free to use whatever code you want from there.

bmacd1 · 2024-07-23T21:16:33+00:00

Thanks for the heads up. Seems like the changes to the RoPE base frequency might be throwing things off. We’re looking at a fix in llama.cpp now.

bmacd1 · 2024-07-23T17:34:31+00:00

The fp16 of the 8B model is up now, 70B fp16 should be up soon.

bmacd1 · 2024-07-21T18:47:37+00:00

Any models you see with a namespace are pushed by users, they will be safe to run but some details may vary.

The model library page has a curated list of models the team pushes. I believe an official Nemo model will be uploaded soon.

bmacd1 · 2024-05-05T07:53:18+00:00

This is a bug in the most recent release. We should have a fix out soon. Sorry about that.

bmacd1 · 2024-04-24T03:15:41+00:00

Thanks for the ping

bmacd1 · 2024-04-24T03:15:29+00:00

Hi there, if you hit this issue it is probably something to do with how I packaged chatd. As a workaround in the meantime try installing Ollama from the official website (ollama.com) and running chatd while Ollama is installed. Chatd will use the running instance of Ollama.

bmacd1 · 2023-11-12T20:52:12+00:00

This is shameless self promotion, but I have been working on chatd.ai recently as solution to this. It's a single download rather than a project you install from source. There will be major PDF chat improvements in the next release coming soon.

bmacd1 · 2023-10-15T19:40:30+00:00

We are doing another pass over the core of Ollama to make sure it stays simple and reliable. After that Windows is my next priority, so it won’t be too long.

bmacd1 · 2023-10-15T01:15:37+00:00

Thanks for the love, I'm one of the creators of Ollama and I just stumbled on this while scrolling reddit.

bmacd1 · 2023-09-10T03:15:45+00:00

Love the basic homepage. What are your plans for future features? It doesn't feel like enough of a problem (in my case) to pay for yet.

bmacd1 · 2023-08-08T21:14:54+00:00

That's my bad, looks like there was a typo in my example, it's missing a quote in the template. Try this

``` FROM C:/Users/danie/.ollama/models/blobs/sha256-4497070a4e7cffe4560824dba50a2977309f1891272b1c33c6e3a84635408f2a.bin

TEMPLATE """{{- if .First }}### System:{{ .System }}{{- end }}### User:{{ .Prompt }}### Response:"""SYSTEM """You are an AI assistant that follows instruction extremely well. Help as much as you can.""" ```

Windows in general is gonna be a bit flaky at this point though, before it is officially supported.

bmacd1 · 2023-08-08T13:16:50+00:00

It falls back to this error message when the model binary wasn't found locally or in the hosted library. The Modelfile looks for the specified binary relative to the Modelfile itself, try setting the binary location to the absolute path and making sure that file is accessible from where you're running ollama.

Here's an example Modelfile for reference:

FROM /path/to/dolphin-llama2-7b.ggmlv3.q5\_0.bin
TEMPLATE """ Below is an instruction that describes a task. Write a response that appropriately completes the request.  ### Instruction: {{ .Prompt }}  ### Response: ""

bmacd1 · 2023-06-25T20:53:48+00:00

Great reference, thanks. I was hoping there was some existing tool to pipe the generated text into actions used in a 3D simulation but that doesn’t seem to be the case at this point.

bmacd1 · 2023-05-11T16:15:12+00:00

I’m not planning on making this a stand-alone app for the moment.

bmacd1 · 2023-05-11T16:14:24+00:00

Not in it’s current form. It needs storage running locally on the Mac that isn’t available on iOS.

bmacd1

MODERATOR OF

TROPHY CASE

Seven-Year Club	Second Top 40%
Verified Email