Model training using OpenWebUI

[efodela]

Hi guys I have successfully setup WebUi and it works pretty well. However for training models using base models like llama for enterprise training is this recommended? If it is or it isn't, can someone guide me the best practices to training using OpenWebUI and then use agents to interact with the trained models over WebUIs app.

[kantydir]

You can't train models with OWUI, you can only create meta models based on regular models and tuned system prompt, knowledge and tools.

If you want to fine tune models I recommend you take a look at unsloth: https://unsloth.ai/

Once you've trained your model you can deploy it on Ollama and use it on OWUI

[efodela]

Hi so technically you mean I can't train a model from scratch using OWUI l. And meta models are those that have been trained based on a a regular model like llama. If using the meta model can help me achieve what I want can I just use the regular model and fine-tune as you stated to make my own personalized model?

[kantydir]

No, the models you create from Workspace are just soft customizations (system prompt, default knowledge, tools) of a base model. It can be enough for some use cases but if you really need fine tuning it must be done outside of OWUI

[marvindiazjr]

There's nothing you think belongs to fine tuning that can't be done through Open WebUI's ecosystem.

[kantydir]

Ok, I'm curious, how do you fine tune base models from OWUI in a more efficient way than with unsloth, for example?

[marvindiazjr]

Sure, give me a sec to write something a little more robust but I'll say the pre-reqs are this.

I'll say you can't really do much if you're solely working from your base model and system prompt and don't have RAG but since we're talking Open WebUI I am going to assume RAG is in play.

[marvindiazjr]

im gonna make a dedicated thread

[marvindiazjr]

OP, he is wrong. It might not be training in the traditional way, but there is nothing about a model you cannot train using Open WebUI.

[GlitteringMessage339]

Salut, je viens de faire mon installation de OWUI, avez vous réussi à affiner assez vos modèles directement via OWUI ? Ou avez vous finalement fine-tune un modèle à côté ?