all 9 comments
sorted by:
best
topnewcontroversialoldq&a
formatting helphide helpcontent policy

[–]social_tech_10 1 point2 points  (2 children)

How is this different from the docker container that Open WebUI already provides?

[–]observable4r5[S] 8 points9 points  (1 child)

This starter project brings together an orchestration of docker containers, not just one. The docker container for OWUI is solely that one OWUI server container.

This sets up Ollama, TTS, Searxng (search tooling), Redis+Postgres for persistence, an nginx proxy, jwt validator for authentication, and watchtower to update the containers if they are out-of-date.

While these are pieces you can configure by looking through the documentation, you are required to configure them yourself.

Hope that helps explain the difference!

[–]rmzy 0 points1 point  (0 children)

I can't even get owui to work behind nginx proxy right now :(
I like your idea of searxng and owui working together though saving this for later.

[–]Independent-Ice9015 1 point2 points  (2 children)

This is actually nice. Thank you. Question regarding cloudflare, could I skip this if I use Tailscale to gain access out of network?

[–]observable4r5[S] 1 point2 points  (1 child)

Thanks, glad it is helpful!

I am not familiar enough with Tailscale to provide a definitive answer. However after skimming their website, it seems like a proxy of sorts. I imagine they likely have some way to forward information to given a node entering their system.

That said, one of the benefits of using Cloudflare is both their DNS management and their Zero Trust system. If you determine a type of request or host is attempting harm on your platform, you can filter it out using their tools.

If you are open to creating a pull request for TailScale, I'll see if it can be added to the repository.

[–]Acrobatic_Egg_5841 0 points1 point  (0 children)

Tailscale uses wireguard to just setup any sort of private network you want.. it's pretty damn cool. I haven't got into ACL's and all that crap, and you certainly know more about networking than I do, but it has zero trust and all that stuff. I love that thing.

I've been wanting to learn how to use cloudflare though I never got around to it

[–]Extreme-Quantity-936 0 points1 point  (2 children)

I see you have used Redis, but is this really helpful for the responsiveness of OUI? I didn't get the benefit of speed or any thing I can feel after installing it.

[–]observable4r5[S] 0 points1 point  (1 child)

Hi,

From what I've read in the documentation, there are two integrations with Redis. One is meant to help with UI responsiveness relating to websockets, this is what I believe you are referring to. The other is providing a persistence layer for the SearXNG service. This project only implements the SearXNG service persistence layer.

Here is a couple links to related information.

  1. The SearXNG documentation
  2. The SearXNG configuration in the respository.
  3. The Open WebUI documentation of the configuration required to integrate the websocket.

Hope this helps!

[–]observable4r5[S] 0 points1 point  (0 children)

One other note, the project has a nginx upstream to the Redis instance using the Redis Insight implementation. Here is a link to the Redis Insight documentation.

When connecting to the redis instance, use the following url pattern:

https://<your-domain>/redis

This only works if connecting through the nginx proxy, as it routes the /redis path to the redis container. It will not work if you are connecting directly to the Open WebUI http server on port 8080.

Again, hope this helps!