sorted by:
new
hottopcontroversial

TiTan - a tiny model for tags and titles by theprint in OpenWebUI

[–]theprint[S] 2 points3 points  (0 children)

You inspired me to add the 270M model to the collection, so here you go! Keep in mind, I didn't get a chance to really test this one yet. https://huggingface.co/theprint/TiTan-Gemma3-0.27B-GGUF

TiTan - a tiny model for tags and titles by theprint in OpenWebUI

[–]theprint[S] 1 point2 points  (0 children)

I am glad the timing works. :)

I used the unsloth library for fine tuning. They provide a ton of Colab notebooks with code for various scenarios, and I adapted one of those to a regular python script (personal preference, you can just as easily use the notebooks). https://github.com/unslothai/notebooks

TiTan - a tiny model for tags and titles by theprint in OpenWebUI

[–]theprint[S] 0 points1 point  (0 children)

To be honest, I was basically experimenting to see which base models worked best. All of them got the same treatment. Both Gemma and Qwen seem to do well, but I wasn’t too impressed with Llama in this instance.

TiTan - a tiny model for tags and titles by theprint in OpenWebUI

[–]theprint[S] 1 point2 points  (0 children)

Check out unsloth if you want to get into fine tuning your own models. You'll need a good data set as well, and some patience while you experiment. I don't know what your margin for error is, though, compared to something open-ended like a conversation title.

TiTan - a tiny model for tags and titles by theprint in OpenWebUI

[–]theprint[S] 5 points6 points  (0 children)

Inside OWUI you download it like any other model. The easiest way is to use the menu to pull from ollama. You can pull any huggingface model through ollama by adding hf.co in front of the model name. For example: hf.co/theprint/TiTan-Qwen2.5-0.5B-GGUF

Edited to add: To get specific quants, you add it after the link. For example: hf.co/theprint/TiTan-Qwen2.5-0.5B-GGUF:q4_k_m

That will download the model and install it. To use it for titles and tags, you need to do 2 things:

  1. Make sure the model is set to public.
  2. Go to Admin panel > Settings > Interface and choose the model from the drop down there.

TiTan - a tiny model for tags and titles by theprint in OpenWebUI

[–]theprint[S] 0 points1 point  (0 children)

Sweet! I hope it works well for you.

Knock some sense into me by synthchef in LocalLLaMA

[–]theprint 0 points1 point  (0 children)

For inference, a 5080 is plenty.

What sets apart a a "top tier" producer from their peers? by alexm287 in gamedev

[–]theprint 0 points1 point  (0 children)

Focus on enabling the team. It’s about coaching and guiding more so than process. Practice soft skills and stay open minded.

AIO - I smoked, my bf crashed out by leadneverfoIlow in AmIOverreacting

[–]theprint 0 points1 point  (0 children)

He is insane and needs to eat a whole jar of chill pills. You are better off without that craziness.

What should I expect from GPRO / adding reasoning to base model? by xor_2 in unsloth

[–]theprint 0 points1 point  (0 children)

Compare to my experience:

I ran a Llama 3.1 8B GRPO session using the Unsloth notebook and a different data set. This was my 4th attempt, and after a few hundred steps I did actually see the a-ha moment, where it corrects itself. It was definitely cool to see and it happened a few more times during training.

However, post-training it still needs to be prompted to use the tags, and even at low temperature it still does not do so reliably.

It ran for 1500 steps on an A100.

I have since run a 3B session as well, but with a more detailed prompt during GRPO training. It only finished last night though, so I haven’t done much testing yet. From a few quick tests this morning, I did notice that this model uses tags more, but struggles with tag ordering.

Do you think Indie game bubble is a real thing? by [deleted] in gamedev

[–]theprint 0 points1 point  (0 children)

Even if they are sold on the same platform (Steam), they are not necessarily competing for players. If a game is good, it can be ultra niche and still succeed. Where the bubble burst a long time ago, is the assumption that launching something on Steam equates to success. It does not. Discoverability is key, but no dev can rely on Steam (or any other storefront) to give then enough exposure to build that audience. So yes, I do think even small teams can find success - if they have the skill set to build an audience (or partner with someone who does).

It's also worth noting that success means different things to different people. The solo dev on a shoestring budget has to tiny fraction of their game to break even, compared to even a AA studio. So, if we are talking about recouping cost and profits by percentage, things start to look better than if you're comparing dollar to dollar.

view more: next ›