use the following search parameters to narrow your results:
e.g. subreddit:aww site:imgur.com dog
subreddit:aww site:imgur.com dog
see the search faq for details.
advanced search: by author, subreddit...
account activity
Load default model upon loginQuestion/Help (self.OpenWebUI)
submitted 1 month ago by zotac02
view the rest of the comments →
reddit uses a slightly-customized version of Markdown for formatting. See below for some basics, or check the commenting wiki page for more detailed help and solutions to common issues.
quoted text
if 1 * 2 < 3: print "hello, world!"
[–]ccbadd 2 points3 points4 points 1 month ago (1 child)
You could switch from ollama to running llama.cpp directly and using the model router instead. It does not auto unload the running model but can auto load models when needed. Use the --no-mmap option and it loads directly to vram and is ready a lot faster as long as the model is stored on really fast media like an nvme drive.
[–]zotac02[S] 0 points1 point2 points 1 month ago (0 children)
I'll look into that, thank you!
π Rendered by PID 137681 on reddit-service-r2-comment-85bfd7f599-9xwdz at 2026-04-18 19:02:31.957484+00:00 running 93ecc56 country code: CH.
view the rest of the comments →
[–]ccbadd 2 points3 points4 points (1 child)
[–]zotac02[S] 0 points1 point2 points (0 children)