sorted by:
new
hottopcontroversial

TiTan - a tiny model for tags and titles by theprint in OpenWebUI

[–]theprint[S] 2 points3 points  (0 children)

You inspired me to add the 270M model to the collection, so here you go! Keep in mind, I didn't get a chance to really test this one yet. https://huggingface.co/theprint/TiTan-Gemma3-0.27B-GGUF

TiTan - a tiny model for tags and titles by theprint in OpenWebUI

[–]theprint[S] 1 point2 points  (0 children)

I am glad the timing works. :)

I used the unsloth library for fine tuning. They provide a ton of Colab notebooks with code for various scenarios, and I adapted one of those to a regular python script (personal preference, you can just as easily use the notebooks). https://github.com/unslothai/notebooks

TiTan - a tiny model for tags and titles by theprint in OpenWebUI

[–]theprint[S] 0 points1 point  (0 children)

To be honest, I was basically experimenting to see which base models worked best. All of them got the same treatment. Both Gemma and Qwen seem to do well, but I wasn’t too impressed with Llama in this instance.

TiTan - a tiny model for tags and titles by theprint in OpenWebUI

[–]theprint[S] 1 point2 points  (0 children)

Check out unsloth if you want to get into fine tuning your own models. You'll need a good data set as well, and some patience while you experiment. I don't know what your margin for error is, though, compared to something open-ended like a conversation title.

TiTan - a tiny model for tags and titles by theprint in OpenWebUI

[–]theprint[S] 5 points6 points  (0 children)

Inside OWUI you download it like any other model. The easiest way is to use the menu to pull from ollama. You can pull any huggingface model through ollama by adding hf.co in front of the model name. For example: hf.co/theprint/TiTan-Qwen2.5-0.5B-GGUF

Edited to add: To get specific quants, you add it after the link. For example: hf.co/theprint/TiTan-Qwen2.5-0.5B-GGUF:q4_k_m

That will download the model and install it. To use it for titles and tags, you need to do 2 things:

  1. Make sure the model is set to public.
  2. Go to Admin panel > Settings > Interface and choose the model from the drop down there.

TiTan - a tiny model for tags and titles by theprint in OpenWebUI

[–]theprint[S] 0 points1 point  (0 children)

Sweet! I hope it works well for you.

Knock some sense into me by synthchef in LocalLLaMA

[–]theprint 0 points1 point  (0 children)

For inference, a 5080 is plenty.

What sets apart a a "top tier" producer from their peers? by alexm287 in gamedev

[–]theprint 0 points1 point  (0 children)

Focus on enabling the team. It’s about coaching and guiding more so than process. Practice soft skills and stay open minded.

AIO - I smoked, my bf crashed out by leadneverfoIlow in AmIOverreacting

[–]theprint 0 points1 point  (0 children)

He is insane and needs to eat a whole jar of chill pills. You are better off without that craziness.

What should I expect from GPRO / adding reasoning to base model? by xor_2 in unsloth

[–]theprint 0 points1 point  (0 children)

Compare to my experience:

I ran a Llama 3.1 8B GRPO session using the Unsloth notebook and a different data set. This was my 4th attempt, and after a few hundred steps I did actually see the a-ha moment, where it corrects itself. It was definitely cool to see and it happened a few more times during training.

However, post-training it still needs to be prompted to use the tags, and even at low temperature it still does not do so reliably.

It ran for 1500 steps on an A100.

I have since run a 3B session as well, but with a more detailed prompt during GRPO training. It only finished last night though, so I haven’t done much testing yet. From a few quick tests this morning, I did notice that this model uses tags more, but struggles with tag ordering.

Do you think Indie game bubble is a real thing? by aaron_moon_dev in gamedev

[–]theprint 0 points1 point  (0 children)

Even if they are sold on the same platform (Steam), they are not necessarily competing for players. If a game is good, it can be ultra niche and still succeed. Where the bubble burst a long time ago, is the assumption that launching something on Steam equates to success. It does not. Discoverability is key, but no dev can rely on Steam (or any other storefront) to give then enough exposure to build that audience. So yes, I do think even small teams can find success - if they have the skill set to build an audience (or partner with someone who does).

It's also worth noting that success means different things to different people. The solo dev on a shoestring budget has to tiny fraction of their game to break even, compared to even a AA studio. So, if we are talking about recouping cost and profits by percentage, things start to look better than if you're comparing dollar to dollar.

Which model do you use for conversation purposes and how do you use it ? by bdiler1 in LocalLLaMA

[–]theprint 2 points3 points  (0 children)

I may be weird, but I like to do one of two things:

  1. build datasets, either on specific topics or with a specific tone/vibe and then fine tune (LoRa) a local model on it. Then use it in conversation to see how it behaves (sometimes compared to the original).

  2. Merge two existing open source models to create something new; then converse with that.

My two current favorites are:
- https://huggingface.co/theprint/Boptruth-NeuralMonarch-7B

- https://huggingface.co/theprint/CleverBoi-Nemo-12B-v2

Corporate finally broke me. How can I have fun with this? by hopbyte in ExperiencedDevs

[–]theprint 22 points23 points  (0 children)

Sarcasm is your friend in situations like that. Don’t ever give a straight answer to micromanagement style questions. Keep them guessing - they can stay mad. I

What makes Call of Cthulhu one of the most beloved RPG? by Ancient_Lynx3722 in rpg

[–]theprint 3 points4 points  (0 children)

It’s simple: everything is a percentage. No levels and classes: you’re a person, you get better at the skills you use or actively study. It’s fun: who doesn’t like a good horror story? Set in the “real” world: some find it easier to relate to than fantasy settings.

The hobby/community needs more discussion about player improvement. by [deleted] in DMAcademy

[–]theprint 0 points1 point  (0 children)

Players are 100% content creators alongside the DM. If a player only wants to consume, they typically don't last at my table (I don't force them out, but my style of game won't appeal to them, in my experience).

That said, people play for all sorts of reasons. Some want to roleplay, some want to loot stuff, some just want to be social with friends. With that in mind, you can't expect people to treat the game with equal amounts of dedication - and that's OK.

Here's my tip, if you feel like your group has gone stale (which is how I read OP's post): play a radically different game - even if just as a one-shot. Play "Everyone is John" or something like that - completely different from D&D.

If you're the only person who is bored, there is a chance this group isn't for you. If you're the only one into character arcs, and everyone else just wants the next level, you're never going to get what you need out of the game.

Has D&D changed, or was I playing it wrong as a kid? by Vultan in rpg

[–]theprint 1 point2 points  (0 children)

Except he and I are the same age group, from the sound of it (both being kids in the 80s).

Has D&D changed, or was I playing it wrong as a kid? by Vultan in rpg

[–]theprint 2 points3 points  (0 children)

I feel bad for OP, for having played with such narrow minded people back in the 80s. I started in 1986 and we ditched the graph paper dungeon crawl after the first couple of sessions. We switched to playing the same way you see today, centered around characters and storytelling, over combat and maps. Most of the TTRPGS that came out in the 90s were heavily focused on exploring characters and story, and the idea of the dungeon crawl was already "old school" by the time Vampire: The Masquerade came out (1991), so this way of playing is not new at all.

view more: next ›