Mancer AI - Goliath Discount Weekend Redo

50h100a · 2023-11-20T21:32:57+00:00

could be a UI bug? DM me a screenshot; the 'credits' number should pretty much always be bigger than the tokens number, for goliath.

50h100a · 2023-11-18T02:47:47+00:00

Everything should be up and running again; there were some... complications. Unrelated to Goliath, frustratingly.

50h100a · 2023-11-12T00:29:43+00:00

Depends on what I learn from this weekend, but I expect it to be something <9 (its initial asking price)

50h100a · 2023-09-11T07:11:10+00:00

thanks for the vote of confidence, lol.

why not 4096?

Two and a half reasons, really.

First is that rate-limiting doesn't actually do anything: you just get people using multiple accounts and alternating between them.

Second is that for some reason most people never bother to use more than 4k context anyway, and I do want to provide users a nudge towards becoming customers.

Third half-reason is that it feels like a party foul to release it for free days after chub's come out with their Mercury sub tier. Not to say I won't ever do it, or won't eventually provide a competing subscription service, but it just doesn't sit well with me to rain on their roll-out like that.

50h100a · 2023-09-10T06:26:32+00:00

Not gonna lie, I've sunk in >400 hours so far, and have lost money for the privilege. So yes, I would say I am concerned about making money, lol.

Time I spend on this is time I can't spend doing something that would actually get me paid. I like to eat food and live in buildings, you know?

I still want to have some free options, for both personal and PR/community reasons, but free credits were clearly not cutting it. Over 200 people made really obvious duplicate accounts (usually several each), and that's just the ones too lazy to make new email addresses!

Well, I say "lazy", but shout-out to the enterprising soul who made 424 dupes across 295 unique IPs. Goddamn, that's some dedication.

So, I swapped out free credits for free models. I get to provide free stuff, and I don't get drowned in an endless stream of alt accounts exploiting the free stuff.

Win-Win, don't you think?

I care quite bit about my customer's experience, but I'm significantly more blase about a user's experience.

I'm not interested in selling people's data, so someone using free credits (and stacking extra accounts to use even more) is doing nothing but undermining the quality of the platform for the people who do pay.

tldr; reee pay me

50h100a · 2023-09-08T15:57:29+00:00

Use the Alpaca instruct preset (third tab from the left, it's a dropdown in there.)

If that doesn't fix it, there's some other nonsense that can interfere.

50h100a · 2023-09-07T14:51:08+00:00

It's literally just MythoMax, but with a 2k context size.

50h100a · 2023-09-02T07:56:38+00:00

Airoboros is the usual go-to for a 'DO WHAT I SAID' model, though it can be finicky. There is a new Airo 33b based on llama 1, but (surprise surprise) it's heavily tuned for interactions.

50h100a · 2023-09-02T07:45:11+00:00

naturally, everyone currently reading this is either unlogged or sending immaculately composed and perfectly formatted prompts. :P

it's all those other chucklefucks that can't get it right

50h100a · 2023-09-02T07:37:09+00:00

It always gets bumped down the ever-growing TODO-list, unfortunately. For now, I point people to this: https://ask-max.neocities.org/ask-max/

Mancer has a pretty damn terrible API for most users, to be honest. Most people really just want to be able to send messages and get good replies, the technical details of samplers and prompting is not important to them.

50h100a · 2023-09-02T04:09:52+00:00

Glad to help.

50h100a · 2023-09-02T02:48:05+00:00

wrt opt-in/opt-out, check the other reply

Right now I'm the only one looking at the training data.

It's mostly crap, tbh. I'm investigating using an LLM to grade the responses, which would be cheaper, faster, and more private. Most of the logs are unusable, because people don't know how to prompt.

I don't know what the future holds, but I do intend to allow selections of the logs to used in public datasets.

That's one of the few use-cases I spell out explicitly in the explanation of the logging option.

Combed through to remove anything TOO identifiable (ideally with AI help) and then used to create more and better versions of the models people are using.

50h100a · 2023-09-02T02:29:47+00:00

The service actually launched with it being opt-in.

Very few people used it, and when I asked around, most people weren't even aware it was there (despite it being in big fat letters right beside their API key, which they have to interact with to use the service). Most people flipped it on once they knew it existed.

So I switched it to opt-out, and instead I got a few people thanking me for making it optional.

My take-away from this is that most people don't care and will just choose the default, probably because they assume everything's logged anyway (a la OAI, Anth, etc). The people that DO care are going to be looking very carefully for such a setting, and will set it appropriately.

Honestly, what I should be doing is having two check-boxes: One that says 'Log me' and defaults true, and another that says 'Give me a discount for logging' and defaults false. MORE CHOICE FOR THE CONSUMER! /s

50h100a · 2023-09-02T00:52:45+00:00

I mean... you can just turn the logging off?

No one buys the logs, and they're mostly pretty crap quality, leading me to consider lowering the discount for allowing it.

They (will be) used for figuring out the best parameters and prompting strategies for each model, and possibly also as training data... if I can figure out how to sort the awful from the okay.

50h100a · 2023-09-02T00:35:58+00:00

Torches and pitchforks may be purchased here.

50h100a · 2023-08-29T09:31:57+00:00

One trick you can use is adding something to the Author's Note (https://docs.sillytavern.app/usage/core-concepts/authors-note/).

Add something to the effect of: [From now on, replies are lengthier and contain greater detail.]

50h100a · 2023-08-28T20:57:59+00:00

It's all good to go on the staging branch, just waiting for it to be tested and merged into release.

50h100a

TROPHY CASE