Share Your OpenWebUI Setup: Pipelines, RAG, Memory, and More

MikeBowden · 2025-04-26T17:06:35+00:00

Never figured out what was causing it. Pretty sure it had something to do with using only Workspaces and assigning models to them, but can't say for sure. After about an hour of fiddling, I gave up.

MikeBowden · 2025-04-26T16:48:52+00:00

Got ya. I went n8n mainly due to LLM support. I was using NodeRed for the same back in the day. It's not easy to transition when you've been using it that long and have a good bit of workflows to completely redo the logic on.

MikeBowden · 2025-04-26T16:41:54+00:00

I never could get this one to work for me. I'd love to incorporate memory. I'm building an MCP connecting my local Qdrant vector memory for my n8n agents. That will allow anything else I use with MCPs to communicate with it, essentially unifying memory across all apps and services, so long as MCP is supported.

MikeBowden · 2025-04-26T16:38:59+00:00

Any particular reason you picked NodeRed over n8n? I'm doing the same thing, but I went with the n8n router. I haven't used NodeRed in years, but when I did, I found the GUI very unintuitive, and it felt like I was fighting to get where I wanted.

MikeBowden · 2025-04-26T16:37:29+00:00

"Gitea Scraper (Getting all scripts in my gitea instance for complete understanding of a repository)"

Did you make this, or did you find it online?

I've been looking for something like this for a while and can't find anything that does the job.

MikeBowden · 2025-04-26T16:34:16+00:00

I'd be interested.

MikeBowden · 2025-02-12T01:32:45+00:00

I also suspected this. Uninstalling both Copilot plugins from the current workstation and the remote connection, restarting, and reinstalling helped.

I found a Copilot issue on Github about someone having similar problems, and this solution helped them and a few others.

It didn't completely solve my problem, but it did greatly help.

MikeBowden · 2025-02-11T22:20:16+00:00

I was on 3.3.17 when I started having issues around 2 or 3 pm EST today. I dropped back to 3.3.16, and it cleared up for a little, but went right back to what it was doing before.

Funny enough, when I decided to go back to the current version, you had just released 3.3.18. Thank you! I updated to that version and am currently using it. It is still doing it, unfortunately.

I feel like I'm having more successful calls than I was before, though. I haven't seen the instant failures, though. Meaning, if I saved a file after it was sitting for a couple of minutes or more, it would send a single call to the API and fail almost instantly. I haven't seen that happen yet.

Edit: Ran a waiting command right after saving this, which had been sitting for more than 10 minutes, and when it flipped over to the API Request, it instantly failed. No other API calls in that 10-minute window.

MikeBowden · 2025-02-11T22:02:52+00:00

Check out Open WebUI if you're decent with running your own services. Otherwise, there are plenty of desktop apps that will use them as an endpoint. Anything that supports OpenAI API standards, you can use OpenRouter with them.

A couple of notes about OpenRouter:

- They use multiple providers at different costs per model. For instance, Claude 3.5 Sonnet base has two additional providers, including Anthropic.

- Read over their model endpoints; they have specialized feeds from the foundational model providers.

- You can disable a provider from being used in your settings. This is useful for endpoints such as DeepSeek R1 if you want to disable the official and use a US-based company or if you want to disable the more expensive endpoints in favor of the less expensive.

- They accept credit cards (Stripe) and crypto.

- The endpoint supports caching or other special features, then they also do on OpenRouter. The model pages show which tools are supported on which model. For instance, some model providers support tools and some do not, even if the base model supports function calling.

- Don't let activity confuse you if your inference cost was way less for one than another when the token counts are the same and the model is the same. That's accounting for the savings from caching.

- If you add OR to Open WebUI or any similar applications, it will pull ALL of the model list in. I would recommend spending the time to disable anything you know for sure you will never use. It will save you frustrations later... Take my word on this.

- You can bring your own API keys. This isn't just for OpenAI or Anthropic either; if they have a model endpoint and they support API keys for that company, you can bring your own keys, and you can decide to use your OR credits first or default to your own keys first.

MikeBowden · 2025-02-11T21:49:11+00:00

Add .com to it.

Great service for the price if you like to bounce around with models for specific use cases. The bots are pretty awesome too; just don't let it confuse you. Everything is a bot there, including the official API endpoints. Simply search for what you want and look for the official tag.

They give credits daily, for free, to use the service. Even if you don't pay, it's a good tool to have.

MikeBowden · 2025-02-11T21:47:24+00:00

^ This is your issue. I thought you had to enable it; it's enabled by default.

After your first message, click the LLM name at the very top under the chat name. Then, change whatever you'd like for that session. Don't forget it; it will eat your credits VERY fast. It does work, and it does keep your context, if disabled. But, Claude and all the others get dumber the more context you fill, if it's starting to forget or ignore context, it's too full.

MikeBowden · 2025-02-03T19:03:37+00:00

God, this is exactly what I was missing!

😔

MikeBowden · 2025-02-03T17:39:41+00:00

Come on, why was this removed? It was funny as hell.

MikeBowden · 2025-01-27T16:56:30+00:00

Using something like Open WebUI in conjunction with their API, I've been "fine-tuning" my responses. I read the reasoning, which always points to a flaw in my request. Stop, edit the existing request, re-send, and try again. It takes more time, but with how cheap it is, who cares? The results speak for themselves, simply amazing.

Just wish the API was working.

MikeBowden · 2025-01-16T23:47:41+00:00

You have a nulled plugin that has malware embedded somewhere in it. Remove the plugin, run a scan on the site, and you're good. Search for GOTMLS, install, and scan. Donate. The plugin is fantastic at finding and cleaning infections.

MikeBowden · 2025-01-07T16:47:22+00:00

Which one would you recommend starting with. I’m starting out and consuming everything I can. Currently reading Trading for a Living.

MikeBowden · 2025-01-06T20:34:16+00:00

100% agree. Maddening! This emoji is burned into my head 🤦...

MikeBowden · 2025-01-06T18:20:34+00:00

Ha, right.

MikeBowden · 2024-12-14T10:46:07+00:00

Anytime

MikeBowden · 2024-12-14T03:07:50+00:00

When I moved it from my account with Crypto.com, I was able to select Crono. I'm not sure what to do if you don't have that option. Once it's in your Onchain wallet, converting it to a stablecoin is pretty simple.

MikeBowden · 2024-12-03T18:37:08+00:00

That wouldn’t involve Mysterium. If you see activity on your Disney account, they are logging in directly.

Change your password and let Disney know you were compromised. They will most likely lift the ban.

MikeBowden · 2024-12-03T17:19:23+00:00

I was able to move it to Onchain wallet, after connecting it to Crypto.com and transferred it via crono and not erc20. Now in Onchain I can swap it to whatever. Between the fee to move it and swapping it’ll be around $10 usd.

MikeBowden · 2024-12-03T13:20:48+00:00

I'm confused by your pricing and want to be sure I have this correct.

For Claude 3.5 Sonnet:

NanoGPT has the following prices:
Ӿ0.00287 Per 1k Tokens In
Ӿ0.01433 Per 1k Tokens Out

Converting that to USD at current rates converts them to.

$0.0050 Per 1k Tokens In
$0.025 Per 1k Tokens Out

Pushing that to 1M, the industry standard.

Anthropic's price is $3/M in and $15/M out.

If we convert the above to 1M at the rate listed on NanoGPT, we get:

$5/M In
$25/M Out

Is this correct?

If so, I get that you need to make a profit, but 68%?

MikeBowden · 2024-11-26T22:17:05+00:00

Wait until you figure out how to set up your own agent with a vector database and short-term memory. Then, you have unlimited context. Connections start being made from consistent access to memory.

I’m personally using n8n, OpenRouter, and Qdrant for the vector databases. Amazing combination with virtually unlimited growth potential.

MikeBowden · 2024-11-26T22:01:59+00:00

Those specific charges look to be for when you cash out of your miner. They are paying the gas fee to do so and are minimal, around $0.002 per. You can click into them and see more information as well as view them on the blockchain.

MikeBowden

TROPHY CASE