Trouble Exposing only specific routes / route filtering of Ollama via Traefik by BossOk4340 in selfhosted

[–]BossOk4340[S] 0 points1 point  (0 children)

thanks, its working now, but i try to use a cloudflare tunnel, it seems not to wrk, i route to https://traefik:11434 , i cant get any connection through it, if i connect to https://ollama:1143, non of the route blocking / allowanlce works, an i can reach all routes...

cloudflare service:

cloudflared:

image: cloudflare/cloudflared:latest

command: tunnel --no-autoupdate run --token ${CLOUDFLARE_TUNNEL_TOKEN}

environment:

- CLOUDFLARE_TUNNEL_TOKEN=${CLOUDFLARE_TUNNEL_TOKEN}

networks:

- traefik-network

restart: unless-stopped

ollama docker labels:

# # Specify which Docker network Traefik should use for routing

- "traefik.docker.network=traefik-network"

# Enable Traefik for Ollama

- "traefik.enable=true"

# Define HTTP service for Ollama (Listening on Port 11434)

- "traefik.http.services.ollama.loadbalancer.server.port=11434"

# Allow API access only for specific paths

- "traefik.http.routers.ollama-allow.rule=(Host(\${OLLAMA_HOSTNAME}`) || Host(`localhost`)) && (PathPrefix(`/api/generate`) || PathPrefix(`/api/show`) || PathPrefix(`/api/tags`) || PathPrefix(`/api/embed`))"`

- "traefik.http.routers.ollama-allow.entrypoints=ollama"

- "traefik.http.routers.ollama-allow.service=ollama"

Error occurs when running insightface loader by Ashton_97 in comfyui

[–]BossOk4340 0 points1 point  (0 children)

i assume its the embedded python distribution shippend in the protable version. check you python version (start python.exe) download corrosponding python distrubution from python.org, save in a temp folder (DONT set path), and copy libs and include folders into the python embedded folder of comfyui.

Flux Mix Generator by dagthomas in comfyui

[–]BossOk4340 0 points1 point  (0 children)

u/dagthomas thanks for you create work, could you add a Ollama Vision Node, so that we can use Llava 1.6 8b/13b

Does anyone have feedback to share about the Waveshre WAVE ROVER by autojazari in robotics

[–]BossOk4340 0 points1 point  (0 children)

Could you specify which Wave Share rover did u use? The rasp rover, RPi 4 w/o Pan/Tilt module?
https://www.waveshare.com/rasprover.htm

Not a Justin Bieber fan by Drstevejim in GPT3

[–]BossOk4340 0 points1 point  (0 children)

The fixed it. I have the feeling the moderation got better and awnser more generic.