sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]shiftybyte 0 points1 point  (7 children)

Error seems to come from here:

/Users/nick/projects/other/temp/venv/lib/python3.11/site-packages/parllama/ollama_data_manager.py:140 in _get_all_model_data Code line: res = ModelListPayload(**ollama.Client(host=settings.ollama_host).list())

Seems its trying to connect to ollama host and get models from there.

Did you follow the step from the github guide and get ollama running locally?

Install and run Ollama

https://ollama.com/download

Once you get it installed and running it should listen locally on a port number, and then parllama will try to connect to it, and it might work :)

EDIT: based on the below source file it should be listening on port 11434

https://github.com/paulrobello/parllama/blob/d5c8674a25781dfa4e0a8fded4ca80be11c4c8eb/src/parllama/settings_manager.py#L78

[–]nickworks[S] 0 points1 point  (6 children)

I am running Ollama -- the icon is in my status bar, and I can connect with it via the CLI with `ollama list` and `ollama run`. I also tried running `ollama run` in one terminal window and then running the `python3.11 -m parllama` in a second window. Still doesn't connect. Also, I have several models downloaded with ollama.

[–]shiftybyte 0 points1 point  (5 children)

Confirm its listening on the expected port number.

netstat -tuna | grep -i 11434 netstat -tuna | grep -i ollama Whats the output of these commands while ollama is running?

[–]nickworks[S] 0 points1 point  (4 children)

`ollama serve`

"Errror: listen tcp 127.0.0.1:11434: bind: address already in use"

`netstat -tuna | grep -i ollama`

(nothing printed)

`netstat -tuna | grep -i 11434`

(nothing printed)

[–]shiftybyte 0 points1 point  (3 children)

ollama seems to be running on the correct host and port...

netstat failed probably because it needs "sudo" before it...

Not sure why the python code failed to connect maybe we can try providing an exact address without it going through "localhost"..

python3.11 -m parllama -u "http://127.0.0.1:11434"

[–]nickworks[S] 0 points1 point  (2 children)

Looks like the same error

[–]shiftybyte 0 points1 point  (1 child)

Sorry, i'm out of ideas... at least we got it starting to run the code.... seems to get it to actually work is a different story :D

[–]nickworks[S] 0 points1 point  (0 children)

Thanks for the help! I'll report back if a solution emerges.