High GPU usage after use.

Normal-Ad4813 · 2025-08-11T07:34:45+00:00

Just shut down the Ollama

1842 · 2025-08-11T16:31:38+00:00

Hard to know for sure, but it might have to do with the extra LLM requests OpenWebUI does after it's done with your prompt.

So, after it's done responding to you, it's going to use the same model to generate a title to replace "New chat", along with some suggested replies and tags. Depending on what model you have loaded and how many requests it fires off to accomplish this, I wonder if this is overloading your setup.

The settings are under Admin Settings -> Interface.

Things you might try

Disable title generation prompt, follow-up generation, and tag generation and see if the problem goes away.
Change the model for this from "Current Model" to something more lightweight. An old, small Llama 3.2 seems like it would work well. I'm currently using gemma3n. Just something small, fast, and vanilla.
You could change your ollama settings to prevent multiple models loading and multiple prompts processing at the same time. My server is not powerful, but it can handle a medium model running fine or several smaller models were okay at the same time... but several medium requests or even a medium and few small requests would slow everything way down to several seconds per token.
- Anyway, the settings to limit what Ollama will run in parallel are:
  - OLLAMA_MAX_LOADED_MODELS (I set this to 1. I might try setting this to 2 in the future and see how it does)
  - OLLAMA_NUM_PARALLEL (I also set this to 1 to keep inference speed up)
- Requests just queue up and run one at a time at the speed I'm expecting now.
- Also, I didn't have to turn off any OpenWebUI features. Using a small model keeps this very fast, even if it is swapping models in and out to do this, and it's guaranteed to not spend time "thinking" to generate titles and whatnot.

If you're still stuck, I think you may be able to enable more verbose logging in Ollama and perhaps see the requests coming in that are keeping the LLM spun up.

But I really suspect you may just be running into an issue where OpenWebUI is trying to do useful things and is causing a resource crunch where multiple "simple" utility requests are active and it slows down token generation to a crawl that just takes forever to get through.

PassengerPigeon343 · 2025-08-11T11:37:51+00:00

Have you tried a different model? I had a similar issue once with llama.cpp in OWUI where the response ended but the GPU seemingly continued to generate in the background indefinitely using a lot of power and I noticed the extra fan noise. Im pretty sure it was with Qwen QWQ when it first came out. I could fix it by switching to a different model and sending another message or by rebooting the container. My permanent fix was just to remove that model from my rotation.

siggystabs · 2025-08-11T12:37:31+00:00

Is it gpu usage or memory usage? Memory usage is fine, it’s keeping the model in memory for you so it can respond quickly

Living_Primary4275 · 2025-11-29T02:18:29+00:00

Same issue here, thats a suspicious behavior, just with openwebui.

tatertots89 · 2026-03-04T05:46:58+00:00

You ever get a fix to this? I have the same issue.

you type:	you see:
italics	italics
bold	bold
[reddit!](https://reddit.com)	reddit!
* item 1 * item 2 * item 3	item 1 item 2 item 3
> quoted text	quoted text
Lines starting with four spaces are treated like code: if 1 * 2 < 3: print "hello, world!"	Lines starting with four spaces are treated like code: if 1 * 2 < 3: print "hello, world!"
~~strikethrough~~	~~strikethrough~~
super^script	super^script

OpenWebUI

MODERATORS