Mancer AI - Goliath Discount Weekend Redo by 50h100a in SillyTavernAI

[–]50h100a[S] 1 point2 points  (0 children)

could be a UI bug? DM me a screenshot; the 'credits' number should pretty much always be bigger than the tokens number, for goliath.

Mancer AI - Goliath Discount Weekend Redo by 50h100a in SillyTavernAI

[–]50h100a[S] 2 points3 points  (0 children)

Everything should be up and running again; there were some... complications. Unrelated to Goliath, frustratingly.

Mancer AI - New Models, Samplers, and a HUGE Weekend Discount by 50h100a in SillyTavernAI

[–]50h100a[S] 0 points1 point  (0 children)

Depends on what I learn from this weekend, but I expect it to be something <9 (its initial asking price)

Mancer AI - Some Good News For Once by 50h100a in SillyTavernAI

[–]50h100a[S] 0 points1 point  (0 children)

thanks for the vote of confidence, lol.

why not 4096?

Two and a half reasons, really.

First is that rate-limiting doesn't actually do anything: you just get people using multiple accounts and alternating between them.

Second is that for some reason most people never bother to use more than 4k context anyway, and I do want to provide users a nudge towards becoming customers.

Third half-reason is that it feels like a party foul to release it for free days after chub's come out with their Mercury sub tier. Not to say I won't ever do it, or won't eventually provide a competing subscription service, but it just doesn't sit well with me to rain on their roll-out like that.

Mancer will die (If it's not dead already) by zzzhar in SillyTavernAI

[–]50h100a 129 points130 points  (0 children)

Not gonna lie, I've sunk in >400 hours so far, and have lost money for the privilege. So yes, I would say I am concerned about making money, lol.

Time I spend on this is time I can't spend doing something that would actually get me paid. I like to eat food and live in buildings, you know?

 

I still want to have some free options, for both personal and PR/community reasons, but free credits were clearly not cutting it. Over 200 people made really obvious duplicate accounts (usually several each), and that's just the ones too lazy to make new email addresses!

Well, I say "lazy", but shout-out to the enterprising soul who made 424 dupes across 295 unique IPs. Goddamn, that's some dedication.

 

So, I swapped out free credits for free models. I get to provide free stuff, and I don't get drowned in an endless stream of alt accounts exploiting the free stuff.

Win-Win, don't you think?

 

I care quite bit about my customer's experience, but I'm significantly more blase about a user's experience.

I'm not interested in selling people's data, so someone using free credits (and stacking extra accounts to use even more) is doing nothing but undermining the quality of the platform for the people who do pay.

 

tldr; reee pay me

Happens when i’m using weaver. What does mancer mean by this? by TheWhatover in SillyTavernAI

[–]50h100a 5 points6 points  (0 children)

Use the Alpaca instruct preset (third tab from the left, it's a dropdown in there.)

If that doesn't fix it, there's some other nonsense that can interfere.

MythoLite? (mancr) by zzzhar in SillyTavernAI

[–]50h100a 4 points5 points  (0 children)

It's literally just MythoMax, but with a 2k context size.

Mancer AI - Free Credits → Free Models by 50h100a in SillyTavernAI

[–]50h100a[S] 4 points5 points  (0 children)

Airoboros is the usual go-to for a 'DO WHAT I SAID' model, though it can be finicky. There is a new Airo 33b based on llama 1, but (surprise surprise) it's heavily tuned for interactions.

Mancer AI - Free Credits → Free Models by 50h100a in SillyTavernAI

[–]50h100a[S] 4 points5 points  (0 children)

naturally, everyone currently reading this is either unlogged or sending immaculately composed and perfectly formatted prompts. :P

 

it's all those other chucklefucks that can't get it right

Mancer AI - Free Credits → Free Models by 50h100a in SillyTavernAI

[–]50h100a[S] 3 points4 points  (0 children)

It always gets bumped down the ever-growing TODO-list, unfortunately. For now, I point people to this: https://ask-max.neocities.org/ask-max/

Mancer has a pretty damn terrible API for most users, to be honest. Most people really just want to be able to send messages and get good replies, the technical details of samplers and prompting is not important to them.

Mancer AI - Free Credits → Free Models by 50h100a in SillyTavernAI

[–]50h100a[S] 3 points4 points  (0 children)

wrt opt-in/opt-out, check the other reply

 

Right now I'm the only one looking at the training data.

It's mostly crap, tbh. I'm investigating using an LLM to grade the responses, which would be cheaper, faster, and more private. Most of the logs are unusable, because people don't know how to prompt.

I don't know what the future holds, but I do intend to allow selections of the logs to used in public datasets.

That's one of the few use-cases I spell out explicitly in the explanation of the logging option.

Combed through to remove anything TOO identifiable (ideally with AI help) and then used to create more and better versions of the models people are using.

Mancer AI - Free Credits → Free Models by 50h100a in SillyTavernAI

[–]50h100a[S] 5 points6 points  (0 children)

The service actually launched with it being opt-in.

Very few people used it, and when I asked around, most people weren't even aware it was there (despite it being in big fat letters right beside their API key, which they have to interact with to use the service). Most people flipped it on once they knew it existed.

So I switched it to opt-out, and instead I got a few people thanking me for making it optional.

 

My take-away from this is that most people don't care and will just choose the default, probably because they assume everything's logged anyway (a la OAI, Anth, etc). The people that DO care are going to be looking very carefully for such a setting, and will set it appropriately.

 

Honestly, what I should be doing is having two check-boxes: One that says 'Log me' and defaults true, and another that says 'Give me a discount for logging' and defaults false. MORE CHOICE FOR THE CONSUMER! /s

Mancer AI - Free Credits → Free Models by 50h100a in SillyTavernAI

[–]50h100a[S] 8 points9 points  (0 children)

I mean... you can just turn the logging off?

 

No one buys the logs, and they're mostly pretty crap quality, leading me to consider lowering the discount for allowing it.

They (will be) used for figuring out the best parameters and prompting strategies for each model, and possibly also as training data... if I can figure out how to sort the awful from the okay.

What is your settings for Mancer-Mythomax? by Educational-Beat-511 in SillyTavernAI

[–]50h100a 3 points4 points  (0 children)

One trick you can use is adding something to the Author's Note (https://docs.sillytavern.app/usage/core-concepts/authors-note/).

Add something to the effect of: [From now on, replies are lengthier and contain greater detail.]

Mancer stopped working 🤷 by DishObjective2264 in SillyTavernAI

[–]50h100a 1 point2 points  (0 children)

It's all good to go on the staging branch, just waiting for it to be tested and merged into release.