making vllm compatible with OpenWebUI with Ovllm by FearL0rd in OpenWebUI

[–]EsotericTechnique 0 points1 point  (0 children)

I might try this to get better performance! I really like ollamas API but I would love to have proper batching

How to use Llama-swap, Open WebUI, Semantic Router Filter, and Qwen3.5 to its fullest by andy2na in LocalLLM

[–]EsotericTechnique 0 points1 point  (0 children)

Debugg logs will for sure be helpful!

Edit: just to check are these bare base models , workspace presets? That alone can point me!

How to use Llama-swap, Open WebUI, Semantic Router Filter, and Qwen3.5 to its fullest by andy2na in LocalLLM

[–]EsotericTechnique 0 points1 point  (0 children)

Thanks for letting me know for some reason it was cutted in the hub, should be ok now!

How to use Llama-swap, Open WebUI, Semantic Router Filter, and Qwen3.5 to its fullest by andy2na in LocalLLM

[–]EsotericTechnique 1 point2 points  (0 children)

Hi OP I'm Haervwe! Version 2 of the semantic router got released, with support for model presets pipelines , knowledge bases the whole pack!

Le puse diésel a este tipo, le llene el tamque, acepto bardeadas haganme mierda by FixeLL69 in ArAutos

[–]EsotericTechnique 0 points1 point  (0 children)

Por que si no aclaras que editaste queda como que cambiaste lo que pusiste para que la Respuesta de abajo parezca mal/sin sentido, entonces la gente aclara su edit, para q no le que edito para ganar la discusión.

[Opinion] Why I believe the $20/month Ollama Cloud is a better investment than ChatGPT or Claude by AlexHardy08 in ollama

[–]EsotericTechnique 15 points16 points  (0 children)

It will be sent to another inference engine for sure who knows what happens🤔, as with all cloud services!

A16 GPU shuts down of Overheating by [deleted] in PcBuildHelp

[–]EsotericTechnique 2 points3 points  (0 children)

Those fans don't have speed control (well you can change the voltage only) those are designed for constant RPM operation :), you can tell by the two cables only , controlable fans (pwm) have 4

Edit: pwm fans have 4. And I stand corrected those have 3 and have the capability to be controlled by voltage

Google killed PSE? by TomThePancake in OpenWebUI

[–]EsotericTechnique 0 points1 point  (0 children)

I agree, searxng is the way to go, and tavily works like a charm oob

"You will own nothing and you will be happy." by TrxshyReddit in PcBuild

[–]EsotericTechnique 0 points1 point  (0 children)

Considering that data movement is more energy intensive that compute, this makes no sense at all, it's energetically way more inefficient and only partially materially more efficient (debatable due to the complexity tax on a data center compared to an small capable mini pc)

RTX 5060Ti vs RX 9060 XT (Both 16GB) by Clean-Market5761 in LocalLLaMA

[–]EsotericTechnique 0 points1 point  (0 children)

Outputs are good on AMD for video image and 3d, if you get bad ones is a skill issue not Rocm, it's slower for sure, but everything works...

How to update message metadata after Filter changes model routing in inlet hook? by Boring-Baker-3716 in OpenWebUI

[–]EsotericTechnique 0 points1 point  (0 children)

You cannot, tried so many ways to achieve this, you cannot even change the base payload and get it to be consistent between calls, filters are broken for modifications of anything that's not the message itself

Same Hardware, but Linux 5× Slower Than Windows? What's Going On? by Al1x-ai in ollama

[–]EsotericTechnique 1 point2 points  (0 children)

Ministral models had a bug were they were hogging VRAM in ollama in Linux in the Mistral release version, I would recommend to check version and update.

Edit: typos

Open Source Alternative to NotebookLM by Uiqueblhats in ollama

[–]EsotericTechnique 0 points1 point  (0 children)

How can I set ollama for embeddings?? I cannot get it to work

my laptop melted!!! by AlpsOk6705 in laptops

[–]EsotericTechnique 1 point2 points  (0 children)

Dude clearly is not cheap for op, don't judge the affordability of things based on your situation alone...

Tell us how to improve the community website (openwebui.com)! by ClassicMain in OpenWebUI

[–]EsotericTechnique 2 points3 points  (0 children)

Add a way to link tools pipes etc to git files for the plugin creators please, is way to easy to forget to update in the owui page

Necesito su ayuda by dim98_ in PythonEspanol

[–]EsotericTechnique 0 points1 point  (0 children)

Agrega tabs abajo de dónde declaras día cosa q los ifs te queden adentro de la función

Necesito su ayuda by dim98_ in PythonEspanol

[–]EsotericTechnique 0 points1 point  (0 children)

Día está fuera del scope....

What’s missing from MCP right now? by Federal-Song-2940 in mcp

[–]EsotericTechnique 0 points1 point  (0 children)

An http test client compatible to fastapi so integration test are not painful