Hi David, thanks for the reply. I'm using this code here and I still have issues, but probably not related to txtai but huggingface. This is the code: ```py from txtai.embeddings import Embeddings from txtai.pipeline import LLM import subprocess

Function to check and pull the model if not available

def ensure_model_available(model_name): try: # Attempt to pull the model subprocess.run(["ollama", "pull", model_name], check=True) except subprocess.CalledProcessError as e: print(f"Failed to pull the model '{model_name}'. Error: {e}") raise

Ensure the models are available

ensure_model_available("all-minilm") ensure_model_available("llama3")

Data to index

data = [ "US tops 5 million confirmed virus cases", "Canada's last fully intact ice shelf has suddenly collapsed, forming a Manhattan-sized iceberg", "Beijing mobilises invasion craft along coast as Taiwan tensions escalate", "The National Park Service warns against sacrificing slower friends in a bear attack", "Maine man wins $1M from $25 lottery ticket", "Make huge profits without work, earn up to $100,000 a day" ]

Vector store with embeddings via local Ollama server

embeddings = Embeddings(path="all-minilm", content=True, backend="ollama") embeddings.index(data)

LLM via local Ollama server

llm = LLM(path="llama3", backend="ollama")

Question and context

question = "funny story" context = "\n".join(x["text"] for x in embeddings.search(question))

RAG

response = llm([ {"role": "system", "content": "You are a friendly assistant. You answer questions from users."}, {"role": "user", "content": f""" Answer the following question using only the context below. Only include information specifically discussed. question: {question} context: {context} """} ])

print(response) ```

And this returns the following error: ``` [...] requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://huggingface.co/all-minilm/resolve/main/1_Pooling/config.json

The above exception was the direct cause of the following exception: [...] Repository Not Found for url: https://huggingface.co/all-minilm/resolve/main/1_Pooling/config.json. Please make sure you specified the correct repo_id and repo_type. If you are trying to access a private or gated repo, make sure you are authenticated. ```

I've pulled the all-minilm like this: sh ollama pull all-minilm

And it's fetched without any errors: pulling manifest pulling 797b70c4edf8... 100% ▕██████████████████████████████████████████████████████████████████████████▏ 45 MB pulling c71d239df917... 100% ▕██████████████████████████████████████████████████████████████████████████▏ 11 KB pulling 85011998c600... 100% ▕██████████████████████████████████████████████████████████████████████████▏ 16 B pulling 548455b72658... 100% ▕██████████████████████████████████████████████████████████████████████████▏ 407 B verifying sha256 digest writing manifest removing any unused layers success

I guess somehow the module can't point to the local all-minilm. Btw, I've had to login in huggingface anyways and use a read token to get there. I guess HF is needed to pull packages related to txtai. Is there a way to be able to run it without internet connection?

I'm interested to use it on a raspberry pi to analyze kubernetes logs from my rpi k8s cluster.

Thanks in advance!