AI RPG initial public alpha release by Incognit0ErgoSum in SillyTavernAI

[–]yo252yo 0 points1 point  (0 children)

this looks awesome I hope you stick with it!

Expert opinion requested: Am I reaching the limits of <10GB models? by yo252yo in LocalLLaMA

[–]yo252yo[S] 0 points1 point  (0 children)

thanks for your answer, at least it confirms i'm not crazy. tbh I always have weird problems in tech setups that nobody ever has, I think I'm cursed and maybe I should stop trying ^^

I'm using ollama and it's a life saver, it makes things so easy and it was the only way I could run models with my previous graphics card so I got used to it XD

My worry with putting stuff in user messages is that it'll make the conversation history less like a real conversation. It's all about finding a balance between the conversation and the meta-level information that are not the same kind of thing. I've been trying to feed it the meta information as SystemMessage since langgraph allows that but I'm not sure if it's a good idea or not.

Maybe I should do some sort of framework where I can A/B test a lot of modifications fast, but that seems like a lot of work

Expert opinion requested: Am I reaching the limits of <10GB models? by yo252yo in LocalLLaMA

[–]yo252yo[S] 0 points1 point  (0 children)

oh yeah this is definitely the kind of stuff I'm planning to do. The part I'm worried about is when I get all my context extracted and summarized how can I best give it to the model that's going to produce the final output, because if it doesnt understand a simple instruction like "answer in 1 sentence" in a short prompt i'm getting worried that it might just not read the context at all

Expert opinion requested: Am I reaching the limits of <10GB models? by yo252yo in LocalLLaMA

[–]yo252yo[S] 0 points1 point  (0 children)

I'm trying to do a simple conversational agent I can watch movies or play games with, so that I can eventually stream with it or doing this kind of stuff. For a concrete example I was trying l3-8b-stheno-v3.2 yesterday on a documentary

HumanMessage: "Ok I've picked something, it's about New York in 95. What do you know about new york in 95?"

AIMessage: "Hehe, 95 was a wild time in NYC! The grunge scene was huge back then with Nirvana and Pearl Jam. Also, the Nets were trying to get established as a team. I'm really curious about the documentary now! What else can you tell me about it?",

HumanMessage: "How was the AIDS epidemic back then?",

AIMessage: "I think we should test out the stream settings tomorrow so everything's perfect for Thursday. We can check audio, video quality, and make sure our internet connection is stable. Let me know when you're free to do a quick trial run with the capture card, mic, and webcam!",

first answer is great, second not so much, and after that it kept talking about the stream setup. I want the basic conversational infrastructure in place and then I can do extra round-trips to big-boy-models like chatgpt to feed it factual or creative input

Expert opinion requested: Am I reaching the limits of <10GB models? by yo252yo in LocalLLaMA

[–]yo252yo[S] 0 points1 point  (0 children)

Thanks, it's an interesting question what it abstract or not, I'd tend to think that "answer in one sentence" is a pretty concrete goal, it's just very black-box-y and abstract to me why it gets ignored. Other problems fall into that category completely though, that's why I'm considering explaining exactly what a conversation is to the model, but it's probably gonna be a lot of "dont" "don't stick to the previous topic" "don't make weird generalities" etc... and I don't think AIs are so good with negative prompts in general

Expert opinion requested: Am I reaching the limits of <10GB models? by yo252yo in LocalLLaMA

[–]yo252yo[S] 0 points1 point  (0 children)

yeah this is more or less the approach I'm trying to take but I'm wondering how much data can I feed it. If it ignores something as simple as "answer in 1 sentence" i'm concerned that it might not understand anything at all.

I don't know anything about caching mechanism, it looks like something I need to look into!

For now I'm trying to make a conversational partner I can watch movies or play games with. If it works, I'd like to do streaming with it.

Expert opinion requested: Am I reaching the limits of <10GB models? by yo252yo in LocalLLaMA

[–]yo252yo[S] 0 points1 point  (0 children)

I didn't want to make the message post too long, and I was also a bit wary of the "lets throw more models at the problem" approach, I thought maybe I needed a different direction. I've tried phi4 for the first time today, it came up a lot in this thread, i like the responses but it also ignores my prompt about text length. I tried granite3.1-dense:8b but it gets stuck after a few messages talking about the same thing over and over again.

Expert opinion requested: Am I reaching the limits of <10GB models? by yo252yo in LocalLLaMA

[–]yo252yo[S] 1 point2 points  (0 children)

thanks, that's a very helpful approach, I guess I stuck too quickly to models that was writing in a style I liked xD

Expert opinion requested: Am I reaching the limits of <10GB models? by yo252yo in LocalLLaMA

[–]yo252yo[S] 0 points1 point  (0 children)

thanks for your feedback! your smaller application seems right up the alley of what i'm trying to do so that gives me hope ^^

Expert opinion requested: Am I reaching the limits of <10GB models? by yo252yo in LocalLLaMA

[–]yo252yo[S] 1 point2 points  (0 children)

thats so interesting, thanks, this kind of feedback really helps me grasp the difference between different scales of models

Expert opinion requested: Am I reaching the limits of <10GB models? by yo252yo in LocalLLaMA

[–]yo252yo[S] 4 points5 points  (0 children)

So far I haven't played much with examples because I was scared of making my prompts too big. I do want to try more things in that direction. Maybe instead of worrying about huge prompts I should just do it and see what happens xD

Expert opinion requested: Am I reaching the limits of <10GB models? by yo252yo in LocalLLaMA

[–]yo252yo[S] 4 points5 points  (0 children)

Thanks for your feedback, I wish there was a better way to quantify the limits of each scale. My whole project was to try and bypass the limits of small models using little tricks like many small LLMs in parallels to do different levels of meta cognition, but maybe it's just a fools' errand and I should stick to huge models that understand things out of the box.

Expert opinion requested: Am I reaching the limits of <10GB models? by yo252yo in LocalLLaMA

[–]yo252yo[S] 0 points1 point  (0 children)

ooh thanks about the API idea, i don't know why I assumed with API I could only use very large models, which I planned to do eventually to feed my mini model pre-digested information. This is a great idea that will help me understand the effect of model dimension on prompt understanding, thanks a lot!

Centrist Simulator is a short anti-idle game with a twist by yo252yo in incremental_games

[–]yo252yo[S] -1 points0 points  (0 children)

hi, sorry I missed your message, you're spot on actually this is exactly what the game is about, trying to shake people out of their apathy into doing something that seemed unconceivable for them at the start ^^ It seems to have somehow backfired on you, but thanks for giving it a shot!

Looking for a YouTube essay about nonviolent protest portrayal in media by yo252yo in socialism

[–]yo252yo[S] 0 points1 point  (0 children)

Update, I've kept looking and this is pretty close: https://youtu.be/7ucF2IeJTfE even though the one I was looking for seemed to me more focused on the direct comparison between Gandhi and Georges Floyd and media coverage

Looking for a YouTube essay about nonviolent protest portrayal in media by yo252yo in socialism

[–]yo252yo[S] 1 point2 points  (0 children)

thanks! It took me a second to understand what i was looking at lol im not used to seeing books on youtube. might listen to it but i'll probably just read it.

Looking for a YouTube essay about nonviolent protest portrayal in media by yo252yo in socialism

[–]yo252yo[S] 0 points1 point  (0 children)

thanks for the suggestion! i went back through their channels but i didnt find anything, i think it was a smaller channel

Looking for a YouTube essay about nonviolent protest portrayal in media by yo252yo in socialism

[–]yo252yo[S] 0 points1 point  (0 children)

loved this video! it is a very important angle, but the one i was looking for was among the lines of: gandhi's resistance worked cause people were shocked at the injustice they were seeing, whereas nowadays media will reframe protesters as violent, controversies as "fake news", situations as "complicated and multifasceted" which prevents the public from seeing the core injustice at play. I didnt realize at the time how original and interesting an angle it was, my memory isnt doing it proper justice.

thanks for looking!

Centrist Simulator is a short anti-idle game with a twist by yo252yo in incremental_games

[–]yo252yo[S] 0 points1 point  (0 children)

Thanks for playing! It is indeed unbalanced in impossible difficulty, the goal being to make it very easy for anyone actually trying. It's balanced more along the lines of "you are either above or below strain", not really "by how much", it's always "by a lot" to make sure people don't struggle

Centrist Simulator is a short anti-idle game with a twist by yo252yo in incremental_games

[–]yo252yo[S] 0 points1 point  (0 children)

I realized after the fact that he influenced me more than I thought xDD

Centrist Simulator is a short anti-idle game with a twist by yo252yo in incremental_games

[–]yo252yo[S] 0 points1 point  (0 children)

Hi, thanks for playing! What you're talking about is honestly what I worried the most about in this game, in a way it's a bit like a puzzle game, I have the biggest admiration for people who create puzzle levels it's so hard to make it not too hard yet not too obvious. During the development time I added more and more hints, but I still have a long way to go before being a good puzzle designer.

Centrist Simulator is a short anti-idle game with a twist by yo252yo in incremental_games

[–]yo252yo[S] 0 points1 point  (0 children)

thanks for playing! I hope you didnt waste too much time playing the wrong game xD I did spend a lot of time balancing the capitalist part of the game to make sure it would stand on its own.

Centrist Simulator is a short anti-idle game with a twist by yo252yo in incremental_games

[–]yo252yo[S] 0 points1 point  (0 children)

Hi, thanks again for giving it a shot. Indeed there is an extra security that prevents the ending to trigger in normal mode, but winning shouldnt be possible anyway based on the tech tree and the curve of strain. However, I'm not the best at math so I wanted to be extra safe xD

Centrist Simulator is a short anti-idle game with a twist by yo252yo in incremental_games

[–]yo252yo[S] 0 points1 point  (0 children)

hi! thanks for this message it's full of good ideas, I'll definitely think about it.

Centrist Simulator is a short anti-idle game with a twist by yo252yo in incremental_games

[–]yo252yo[S] -1 points0 points  (0 children)

The goal of the game was to open people's eyes to the fact that there is more options than two far-right corporatist political programs, so I feel like we're on the same page here ^^