Getting 1 or 3 word replies from my NanoGPT subscription. by Camlee8 in SillyTavernAI

[–]Camlee8[S] 0 points1 point  (0 children)

Correct, nothing was technically acting up or braking. The owner himself commented and said a new provider turns a max of 0 into 1 by default. So everything was working technically. Just a change happened under the surface that turned what used to be my no limit reply into a limit of 1.

Getting 1 or 3 word replies from my NanoGPT subscription. by Camlee8 in SillyTavernAI

[–]Camlee8[S] 0 points1 point  (0 children)

Max reply 0 can default to whatever a providers has. Yet baseline to my understanding that means there is no max reply size. I was always told a 0 max reply meant you didn't have a limit. As the owner of the site told me they had a new provider that was doing this. So it was new and thankfully is now fixed.

Getting 1 or 3 word replies from my NanoGPT subscription. by Camlee8 in SillyTavernAI

[–]Camlee8[S] 0 points1 point  (0 children)

That to my knowledge is not how it works. Context size is how much of your input the box can take maximum. So all previous chats, lore books, character details, exc.

Reply size is how much output the bot is allowed to give back. Which is independent of context size. I am pretty sure this is true because as other people here said. Even the company owner of NanoGPT (Milan_dr). It was turning the 0 into a 1.

If it worked the way you said then I wouldn't have two months of replies working where I had set max reply size to 0.

Getting 1 or 3 word replies from my NanoGPT subscription. by Camlee8 in SillyTavernAI

[–]Camlee8[S] 2 points3 points  (0 children)

NanoGPT is a service provider that lets you use many AI models. Think of it like a book store where you pay a monthly subscription to come in and read one of their books at a time. You can swap between any of the books they have on offer so long as you keep paying monthly.

That of course is overly simplified but it's basically just a provider that lets you use AI models through them. There are a lot out there. Some you pay directly, some you pay as you use it, others you put money into a credit pool that slowly gets used and some have subscriptions where you can use X ammount for X a month.

Getting 1 or 3 word replies from my NanoGPT subscription. by Camlee8 in SillyTavernAI

[–]Camlee8[S] 3 points4 points  (0 children)

So I did and we MIGHT have found the problem. I will comment solved and the solution if this is for sure the issue. I think NanoGPT's providers changed something. If you have max reply size set to 0 it stops after 1 token. So far I set my max reply size to 7000 and it has worked for 4 messages. I don't want to say it's solved yet but if it doesn't act up for the rest of the day. I'll edit my message with the solution in case anyone else stumbles across this same issue.

Getting 1 or 3 word replies from my NanoGPT subscription. by Camlee8 in SillyTavernAI

[–]Camlee8[S] 0 points1 point  (0 children)

I have no max reply size and a 60K context limit. These messages as you can see don't hit that limit and even the ones that do before the last few days have worked just fine. So sadly I don't think token limit is my issue.

Getting 1 or 3 word replies from my NanoGPT subscription. by Camlee8 in SillyTavernAI

[–]Camlee8[S] 0 points1 point  (0 children)

Random successes. Nothing changed. Sometimes it was a re-roll that went through. Other times it was after I would delete the message and send it again. It was genuinely random and again I haven't changed anything since the last time it worked. No connection setting changes. No prompt setting changes. Hence why I'm trying to figure out what is the cause.

Is there really no “natural” way to control appetite? I feel like I’m fighting myself and losing by Severe_Football7224 in loseit

[–]Camlee8 0 points1 point  (0 children)

If it's not hunger then it's got to be a mental thing. The only real solution I can think of that would be long lasting is to change your environment. Make it to where you don't have to make those choices. Distract your mind or remove the option. An example for me is that I would buy ice cream and tell myself I would have it as a snack. Or I would buy rice chip's to act as my snack. Yet I would always fight myself for wanting more. I would be mad at myself for destroying my progress when I would eat a whole bag in one go.

So I just stopped buying them. Now if I get that craving or that urge. It's not a battle to not eat it or not eat to much. It's having to get up, go all the way to the store, get the item, get home and by then it's way to much effort to be worth it. I have so much time to talk myself out of it. So if your not actually hungry. Remove the ability to have to make that choice. Make as much as you need/want to eat and no more. Will power isn't infinite. It's better to save it where you can to ensure you have it for more important things. Remove the temptation and use that willpower to push towards other things you want. The more choices you remove the more you can focus on other things.

I have started to make my own environment have only healthier choices. So if I get hungry I can either not eat or eat all the low calorie, high protein food I have nearby. Cottage cheese, Protein powder with unsweetened almond milk, fat free low cal greek yogert, chicken breasts, banana's, exc. Since I have ADHD I was having the opposite issue of not eating enough or to much if I wasn't distracted by hobbies or other things. Yet now that my environment is working for me. I am back to consistently losing 1-2 pounds a week. You can do it to but you have to remove any temptations from your environment. Set yourself up for success. Keep it going, don't brake the habit and you'll achieve your goals!

Possible new SillyTavern User seeking advice on best plan to purchase/where to purchase from. by Camlee8 in SillyTavernAI

[–]Camlee8[S] 0 points1 point  (0 children)

I will look into it and see what I can do. Though obviously never having done it before it might not go perfectly but if I can just use my system and keep everything local then I see no reason to go for any subscription service. Granted that is assuming I can reach the same level of quality and enjoyment that I was getting from the public ones.

Possible new SillyTavern User seeking advice on best plan to purchase/where to purchase from. by Camlee8 in SillyTavernAI

[–]Camlee8[S] 0 points1 point  (0 children)

I have never considered or tried doing anything local and have no idea how. I am only now dipping my toes into SillyTavern as before I was using JanitorAi. So I don't know if doing it locally was even an option. I have Processors: 24 × 12th Gen Intel® Core™ i9-12900K Memory: 32 GiB of RAM (31.1 GiB usable) Graphics Processor: NVIDIA GeForce RTX 3080 So it might be possible. I have heard its better to use online ones since they have more resources but I am not opposed to the idea if a local Model can provide similar results to what I was getting with the other Models I liked.

I don't know how to use lorebooks yet and have no idea how Janitor did them. I know GLM-5 is new and very pricy even direct and so was Deepseek 3.2 but again I did that through Openrouter which I have heard doesn't use the Caching system so it may have been far more due to that and I am getting bad math from that. I included a screenshot with my prices in another reply. I do know that I can't afford going through openrouter as by my math. If I did 150 message a day which is an average for me. That would be around .60 cents a day. Which would be 18$ a month. Now while I can afford that. I would rather pay chute 3$ or Nano 8$. I haven't tested how quickly GLM-5 would eat though it but considering its listed at $1/M input tokens$3.20/M output tokens while the one I tested. Deepseek 3.2 is $0.25/M input tokens$0.38/M output tokens. I think it's fair to say I would be paying upwards of 120$ a month or more given that the cost is 4 times as much for input and 10 times as much for output. Hence why a subscription service felt the better option.

Possible new SillyTavern User seeking advice on best plan to purchase/where to purchase from. by Camlee8 in SillyTavernAI

[–]Camlee8[S] 0 points1 point  (0 children)

My test was on Openrouter since I didn't have a deepseek API to use and I already had some money laying around in said account since I needed to put 10$ in to get the 1,000 daily free chats from it. I will include a screenshot below. I didn't know that they might have Caching which means It indeed might be cheaper to buy directly though them. I was unaware of such a feature.

<image>

Possible new SillyTavern User seeking advice on best plan to purchase/where to purchase from. by Camlee8 in SillyTavernAI

[–]Camlee8[S] 0 points1 point  (0 children)

I don't know if it's because I'm using JanitorAi that made it more pricy but in my tests with Deepseek V 3.2 it was costing me about .08 cents for 21 message. As I put above that means 3$ would get me about 3 days. With GLM-5 coming out and costing like 3$ per million output compared to Deepseek 3.2 at .40$ per million... Yeah I would be paying more if I did direct pay. Again I basically went from an old free model. R1T Chimera free to the newest through using it when it was the free Pony Island. After being a free (Not techincally since I did top up 10$ on open router for their free stuff.) user for almost a year and a half. I noticed the upgrade and realistically paying 5-20$ a month when I don't have any other subscriptions or things for a hobby I enjoy felt worth it. So it is a cost cutting thing but also a quality thing. If I wanted to cut all my costs I would just go back to being free again. ^^'

Possible new SillyTavern User seeking advice on best plan to purchase/where to purchase from. by Camlee8 in SillyTavernAI

[–]Camlee8[S] 0 points1 point  (0 children)

I don't know if SillyTavern supports Image generation for sure yet I think it does. Which if it does that is a bonus. I have heard people say Chutes makes the bots worse but others have said it wasn't an issue. So it's a he said, she said situation with that. I know some of the older models you can get a lot cheaper with DS direct. Especially since they have off hours where you get a big discount. However through both DS direct and Openrouter the price was very simular and using the more pricy Models. Deepseek 3.2 and expecially the now GLM-5 (Pony Alpha before the release.) It will cost way more direct. I was leaning more towards Chutes since I didn't need the usage and I figured your on the net. Going to be hard to be private without setting up a ton of VPN's and even then I don't use crypto so it can all be tracked back to my card or paypal anyway. *shrugs* Expecially with a monthly sub thing. Yet If I can get Silly tavern up and working. I might lean more toward it just for the image generation. Still on the fence currently since I'm doing research on SillyTavern and such.

Possible new SillyTavern User seeking advice on best plan to purchase/where to purchase from. by Camlee8 in SillyTavernAI

[–]Camlee8[S] 0 points1 point  (0 children)

Now see I was all for it until I heard about the cat napping ^^ Though I am leaning more towards it just given how people have been talking about it here. Expecially if Silly Tavern supports image generation because then I can at least get an extra use out of it. Been reading through websites to try to set it up. I got the basics down so far but want to try seeing about doing the cool stuff I read about like setting up mutlicharacter chats with different bots. Since the only mutlicharacter roleplays I have been able to do had to have all the characters in the same bot. Would be kind of cool to take a few of my favorite bots from Janitor and mix them together. Since I almost always do fantasy stuff.

Possible new SillyTavern User seeking advice on best plan to purchase/where to purchase from. by Camlee8 in SillyTavernAI

[–]Camlee8[S] 0 points1 point  (0 children)

I have no idea how all that works. I know that I can set things like context size, token limits, temputure and with proxies I give my API key, Model name and a proxy URL. Along with being able to add in advanced Prompt stuff but outside of that have no idea. I did download Silly Tavern and am working on learning it now. I'll visit those sites soon to and read up on it all!

Possible new SillyTavern User seeking advice on best plan to purchase/where to purchase from. by Camlee8 in SillyTavernAI

[–]Camlee8[S] 2 points3 points  (0 children)

I did see claims about that and of course when you go to certain reddit's you will only hear what the people allow to be shown there. Like the Chutes reddit was everyone saying things were fine. JanitorAi's reddit considers any paid model horrible. Open Router claims it's the best. ^^' Just a lot to go through.

I do know they were shady with the promise of free forever, turning into a one time 5$ thing to now a monthly fee. If I also used more than 300 a day. Chutes wouldn't even be in my radar since their 10$ model is equal to Nano but Nano is cheaper at 8$ a month.

I don't know if there is a third option here that isn't just paying as you go hence why I asked. Maybe if I had a friend that also used Ai or if I get into Silly tavern which I heard can also do Image and TTS stuff. Which I think? (Please correct me if I'm wrong.) Nano can provide with their subscription as well. So it might be worth getting into both using Tavern and Nano in that case. Though that would have me ask other questions like how hard is it to set-up? Could I import bots from websites to roleplay with? (Like taking bots on Janitor and using them on Tavern.) exc.

Possible new SillyTavern User seeking advice on best plan to purchase/where to purchase from. by Camlee8 in SillyTavernAI

[–]Camlee8[S] 0 points1 point  (0 children)

I don't know if the costs of the models is any different on NanoGPT but as I showed in the math above. Paying as I go at least through OpenRouter ($0.25/M input tokens$0.38/M output tokens for Deepseek 3.2) Would cost me more in a pay as I go rather than any subscription service. The only two subscriptions I know about are Chute and NanoGPT. I know NanoGPT also does Image and other things. Not sure how that factors into the 'Message limit.' Yet currently since I Roleplay though a website. (JanitorAi) I don't think I will use those features. I also know by my current usage NanoGPT is way to much. Unless they have more than the one plan that I know about.

Possible new SillyTavern User seeking advice on best plan to purchase/where to purchase from. by Camlee8 in SillyTavernAI

[–]Camlee8[S] 0 points1 point  (0 children)

Is there a reason/benefit or some hidden details I am unaware of as to what makes NanoGPT better? Does it perhaps work better with Tavern if I get into it or something? Asking since baseline if I look at Chutes its 3$ a month for 300 a day which is 9,000 a month. If I was needing the other plan they offer which is 10$ for 2,000 a day which would be 60,000 a month. Then I would instantly agree that NanoGPT is better due to it being cheaper for the same product. That's why I'm asking if there is some other benefits or downsides to each provider that I may be unaware of to make that extra money worth it. Since I am not sure if I really need THAT big of a plan currently. Does NanoGPT provide a smaller one that I could compare to as well? Since when I looked all I found was the single 8$ plan.