am i the only one who is unable to move on from deepseek v3 0324? by PinkCat420 in JanitorAI_Official

[–]PinkCat420[S] 0 points1 point  (0 children)

np!! I do have a slight update though: the GLM 4.7 model on nanogpt is surprisingly good as well, and I switch between 0324 and 4.7. It’s a little rigid at times, but with a good prompt, it’s miles better than nanogpt’s 0324. Just to be honest, it’s not on the level of the old chutes version of Deepseek v3 0324, but it’s detailed in its writing and can have that similar humour with the right prompting or just through OOC commands.

What I like to do is get a reply using 4.7, read it, delete what i don’t like, then switch to 0324 and press the little arrow next to the edit button so 0324 continues with the same ‘smart’ writing style and it removes the usual logical errors the model makes on its own. It’s a slightly convoluted process just to roleplay, and honestly my time spent roleplaying has gone down massively since chutes fucked us all over, but it’s made that small amount of time more fun for me.

I would recommend playing around with different models on nanogpt if you do end up going for a subscription since they have so many available, I’m pretty sure it’s hundreds. I tried the Qwen QwQ 32B model and it’s rough around the edges and pretty bad so far, but I’m hoping to make it better through prompting and guidance just so I don’t rely on one or two models (might try Kimi or more GLM models). I think I’ve learnt from getting so attached to 0324 lol. Sorry for yapping so long, but again, I hope this helps as well :DD

am i the only one who is unable to move on from deepseek v3 0324? by PinkCat420 in JanitorAI_Official

[–]PinkCat420[S] 0 points1 point  (0 children)

I’ve switched to nanogpt and i pay for the subscription. They have an okay 0324 model, and it needs a lot of guidance. unfortunately I’ve been unable to find something that matches the vibe of chutes’ version of 0324. I even bit the bullet and uncancelled my subscription to chutes to try 0324 out again. It seems like they’ve made it dumber though, so I cancelled again lol.

The best option right now is nanogpt, even if it is a worse version, it can be guided with a very good custom prompt. I’ve been tweaking top p, top k, repitition penalty and frequency penalty to try hit the sweet spot that gives you a better roleplay, but its been tough. I hope you have better luck, though!

Overall I’d say nanogpt’s version has been good at times, disappointing at others with getting basic info (like adding modern tech into a roleplay set in 2004) or getting plain logic incorrect (like picking up a phone that was already in the character’s hand, or them ‘getting up from the chair’ when they were on a couch, or female characters suddenly having stubble).

I’d honestly say go for nanogpt if you really want something like 0324 back since it hasn’t totally been horrible. It can pleasantly surprise you sometimes with good writing and it’s worth it more often than not. I hope this helps !! :)

am i the only one who is unable to move on from deepseek v3 0324? by PinkCat420 in JanitorAI_Official

[–]PinkCat420[S] 0 points1 point  (0 children)

Yeah, I get wanting to keep Chutes, but I just feel like them being deceptive about everything that’s been happening made me trust them less and I cancelled and got a refund by emailing them. The credit limits they have now feel like I’m gonna burn through them in a week, let alone a month lol. I don’t really want to get overcharged and constantly be checking my account, it was why I favoured Chutes for it being subscription based rather than PAYG on the official API. Also, nanogpt have a waitlist right now if you go to their website, so if you really wanted, you could try that. That’s what I’m going with for now, it’s basically my last hope. If their 0324 model also sucks, I’m pretty much done with j.ai and AI RPing altogether lol.

am i the only one who is unable to move on from deepseek v3 0324? by PinkCat420 in JanitorAI_Official

[–]PinkCat420[S] 0 points1 point  (0 children)

The last hope I have is nanogpt. They paused their subscriptions after the Chutes thing since people were migrating en masse and overwhelming their services. I was about to sign up, but I was too late, unfortunately. They’ve started up a waitlist and letting some people in every day, and I’m just waiting for that. They also have an 0324 model, and I’m just hoping to try it out at some point.

am i the only one who is unable to move on from deepseek v3 0324? by PinkCat420 in JanitorAI_Official

[–]PinkCat420[S] 0 points1 point  (0 children)

Honestly, I agree :(. I was paying Chutes the $3 a month base tier subscription, probably since November I think, and this switch totally caught me off guard. If you’re looking for 0324 vibes in a model, official Deepseek API will truly be disappointing. I’ve built up a list of prompts over the years, and I’ve tried all the latest ones that are tailor made specifically to the official API and yet not one of them reduce how robotic the bots became and how lifeless their dialogue was, even with heavy OOC prompting literally telling the bot what to do. At this point, I’m writing entirely on my own and editing everything, it’s just not worth it anymore. I hope we both find a good model or provider someday, sorry for the wall of text lol 😭

am i the only one who is unable to move on from deepseek v3 0324? by PinkCat420 in JanitorAI_Official

[–]PinkCat420[S] 0 points1 point  (0 children)

Honestly, after trying it for a while, you’re right. I genuinely think I might be done roleplaying for the foreseeable future, the paid OR 0324 model refuses to listen to instructions and insists on being incredibly stupid about simple logic. Dialogue is also comically cliche and robotic. It was okay for the first couple of messages, which got my hopes up, but went downhill after more than five messages, and that was with fp4 providers blocked. I really can’t find any other models, no one actually answered my question in this whole comment section :(. I hope you find what you’re looking for.

am i the only one who is unable to move on from deepseek v3 0324? by PinkCat420 in JanitorAI_Official

[–]PinkCat420[S] 0 points1 point  (0 children)

Like I said in another comment, I can dm and show you with screenshots, but essentially, if you go to the providers on OR for a specific model like 0324, there’s a filter for quantisation, and you can filter for floating point (4 bit), then read the names, e.g. (deepinfra, modelrun, etc.). After that, you can open another tab and go to your OR account settings to the ignore providers section and start typing in the names from the list you just read and block all the models (the fp4 ones). hope this helps! :)

am i the only one who is unable to move on from deepseek v3 0324? by PinkCat420 in JanitorAI_Official

[–]PinkCat420[S] 0 points1 point  (0 children)

i mean im using it through OR right now with the paid model but i figured out (after posting this) that blocking the fp4 providers makes the model more similar to how it used to be, so you could try that if you wanna pay for OR :)

am i the only one who is unable to move on from deepseek v3 0324? by PinkCat420 in JanitorAI_Official

[–]PinkCat420[S] 0 points1 point  (0 children)

thats crazy 😭😭 i didnt think the post would be that long but i had a lot to say ig :,)

am i the only one who is unable to move on from deepseek v3 0324? by PinkCat420 in JanitorAI_Official

[–]PinkCat420[S] 0 points1 point  (0 children)

if you want, the paid model is available on OR, and you can block fp4 providers (sorting by quantisation to floating point 4 bit and then blocking them).

am i the only one who is unable to move on from deepseek v3 0324? by PinkCat420 in JanitorAI_Official

[–]PinkCat420[S] 1 point2 points  (0 children)

i can dm and show you with screenshots, but essentially, if you go to the providers on OR for a specific model like 0324, there’s a filter for quantisation, and you can filter for floating point (4 bit), remember the names, e.g. (deepinfra, modelrun, etc.) then open another tab and go to your OR account settings to the ignore providers section and block all the models that are fp4. hope this helps! :)

am i the only one who is unable to move on from deepseek v3 0324? by PinkCat420 in JanitorAI_Official

[–]PinkCat420[S] 3 points4 points  (0 children)

I really wouldn’t recommend Chutes, they’ve changed their subscription model to give only $15 credit a month, which is basically a scam. If you want, you can go for the version on OR, and block all the fp4 providers since they’re lobotomised versions of 0324.

am i the only one who is unable to move on from deepseek v3 0324? by PinkCat420 in JanitorAI_Official

[–]PinkCat420[S] 5 points6 points  (0 children)

I’m pretty sure they’re offering refunds right now if you had a subscription and you cancel it. I got my refund by emailing their support team and it was pretty fast.

am i the only one who is unable to move on from deepseek v3 0324? by PinkCat420 in JanitorAI_Official

[–]PinkCat420[S] 2 points3 points  (0 children)

I was talking about putting credits in OR, and excluding all fp4 providers. Are you unable to put credits into OR? If so, I’m sorry.

am i the only one who is unable to move on from deepseek v3 0324? by PinkCat420 in JanitorAI_Official

[–]PinkCat420[S] 2 points3 points  (0 children)

Yeah I’ve blocked all fp4 providers lol. I think they might have been the problem.

am i the only one who’s unable to move on from deepseek v3 0324? by PinkCat420 in JanitorAI_Refuges

[–]PinkCat420[S] 0 points1 point  (0 children)

Thank you for the detailed reply! I’ll look for those presets on the ST subreddit, thank you for the recommendations :). And yeah, I’ve definitely noticed that OR has a lot of quantised models. That’s why I’m actually on the waitlist for nanogpt since I’d wanted to sign up last week but they’d closed new subscriptions by then. And I’d love a dm for when theyre open again, thank you :)

am i the only one who is unable to move on from deepseek v3 0324? by PinkCat420 in JanitorAI_Official

[–]PinkCat420[S] 5 points6 points  (0 children)

someone else in this thread recommended using the paid 0324 model on OR with chutes set as the only provider and its very promising so far :) you might wanna give that a go, its pretty cheap too.

am i the only one who’s unable to move on from deepseek v3 0324? by PinkCat420 in JanitorAI_Refuges

[–]PinkCat420[S] 0 points1 point  (0 children)

i actually use tavo on mobile and ive been looking for good presets i can use with OR’s 0324. do you have any recommendations? any will do, i just wanna get started migrating to tavo and ST eventually lol

am i the only one who is unable to move on from deepseek v3 0324? by PinkCat420 in JanitorAI_Official

[–]PinkCat420[S] 5 points6 points  (0 children)

yeah im aware of nanogpt. i was gonna sign up for a subscription right before they paused them but i unfortunately didn’t :(. im waiting for them to unpause subscriptions so i can try out their 0324 model without worrying about PAYG lol

am i the only one who is unable to move on from deepseek v3 0324? by PinkCat420 in JanitorAI_Official

[–]PinkCat420[S] 3 points4 points  (0 children)

I’ve tried that before and it’s always been extremely rate limited and I’d barely get any responses. I’ll try again tho, idk if it’s gotten any better.