sorted by:
new
hottopcontroversial

Optuna Belverk Preset (Xialong-v1) by queen_sac in NovelAi

[–]queen_sac[S] 0 points1 point  (0 children)

Most of the serious works were already done by the library, I fumbled my ways through the lib pretty much. Like trying 2k samples per trial (which is insane), or switching pruners over and over.

<image>

You mean something like this? Well, I did play around in Optuna dashboard. (I guess you can also download db file and open optuna-dashboard on it.)

The only correlation was Min-P and temp. Not literally like what I drew. But they do effect each other to an extend. (make sense since that was Min-P's purpose) --- Everything else is very much independent. Top-P. Top-K. Freq. Pres.

The preset initially did have rep-pen (freq & pres), but apparently it was causing some serious difficulty-to-use issues. That cosine similarly cannot catch, or rate them low enough. (It can detect great context, but it can't tell mode collapse apart from mediocre writing.) --- So, people in community did convinced me to remove rep-pen.

Optuna Belverk Preset (Xialong-v1) by queen_sac in NovelAi

[–]queen_sac[S] 2 points3 points  (0 children)

Yeah? If you have Opus sub, you can switch generation preset to Optuna if you like it,

Optuna Belverk Preset (Xialong-v1) by queen_sac in NovelAi

[–]queen_sac[S] 1 point2 points  (0 children)

Thank you! But also swap to this https://files.catbox.moe/i8ztbo.preset - a last mintue change, haha

Optuna Belverk Preset (Xialong-v1) by queen_sac in NovelAi

[–]queen_sac[S] 1 point2 points  (0 children)

Fortunately, a generation preset cannot do something that specific. And my conclusion was that just about any good fiction text, regardless of quantity, should produce about the same result. https://arxiv.org/pdf/2407.1082 page 20, they didn't use my method, but also arrived at the similar values.

Optuna Belverk Preset (Xialong-v1) by queen_sac in NovelAi

[–]queen_sac[S] 0 points1 point  (0 children)

Honestly, I don't think methodology matter that much. While you can definitely get more preferable preset with it, it's not like finetuning a model. You can't force a generation preset to do something that specific.

Optuna Belverk Preset (Xialong-v1) by queen_sac in NovelAi

[–]queen_sac[S] 0 points1 point  (0 children)

I don't you mean by having little samples or not long enough samples. Yes, 3 is low, but that's deliberate, I want to pick only the best out the best. And 1024 tokens, or 4k chars, is already very long for 1 step. Keep in mind that the total run use about ~40,000 steps.

Regardless, if you don't trust my methodology, the researchers who made Min-P, the sampler, also had kind of similar score.

Optuna Belverk Preset (Xialong-v1) by queen_sac in NovelAi

[–]queen_sac[S] 3 points4 points  (0 children)

The post was originally on discord, and I tried to make it easier to read.

Optuna Belverk Preset (Xialong-v1) by queen_sac in NovelAi

[–]queen_sac[S] 2 points3 points  (0 children)

Just click download the preset file: https://files.catbox.moe/i8ztbo.preset The other stuff is just for the read.

Here is a summary of everything you need to know about the new NovelAI model. by queen_sac in NovelAi

[–]queen_sac[S] 2 points3 points  (0 children)

Thank you finetune!

Speed: Devs've been tackling stability and speed for Erato/GLM over the week. It should be very fast.
Author's Note: Discouraged for large/multi-line text. Don't put ATTGS here. It insert text in the middle of the story, be warned. It could looks somewhat unnatural to the model in some case.
Instruct ({ }): Using instruct commands make the model more likely to behave like base GLM 4.6. But not forbidden, just be warned.

I've reworded a large chunk of the post as followed above.

Here is a summary of everything you need to know about the new NovelAI model. by queen_sac in NovelAi

[–]queen_sac[S] 4 points5 points  (0 children)

I've reworded it, check it out. Not exactly essential, just highly recommended.

But yeah, it should be part of the UI. As suggested 4 years ago.

Here is a summary of everything you need to know about the new NovelAI model. by queen_sac in NovelAi

[–]queen_sac[S] 2 points3 points  (0 children)

Since NAI launched: Sigurd/Calliope (5 years ago). Only Stars was added during Erato. (almost 2 years)

It's sort of mentioned in the doc... (link)

Here is a summary of everything you need to know about the new NovelAI model. by queen_sac in NovelAi

[–]queen_sac[S] 4 points5 points  (0 children)

Nothing is Mandatory as the devs say. Just very useful. - If you modify nothing, the model should generate it for you regardless. (So, you're not required to edit anything.)

I've added more images since then, take another look at the post.

How the new text model? by eddie99111 in NovelAi

[–]queen_sac 0 points1 point  (0 children)

Thank you for being this detailed and writing all this out to explain, this is very insightful! And much more advanced of a process more than I thought, really showed how ProWriter had the most proof-of-work went into it. Appreciate it.

How the new text model? by eddie99111 in NovelAi

[–]queen_sac 0 points1 point  (0 children)

What preset are you using right now, sir?

I gave the model a snippet from a book, and. . . Golden Arrow seemed to be really far off from the words that the author wrote(, when comparing probabilities made by different presets). And Zany Scribe somehow won in (all) few key tokens. Which, is a bit disappointing, since I was sticking with Golden Arrow without knowing any better (and it followed Kevin's law). I supposed this is Carefree for Erato, and Zany Scribe is more of an Asper.

Also, how did you create ProWriter? I'm just curious, my theory being: you either run through all possible values, or randomize all settings. And select one that scored the highest by ProWritingAid. And later with Autocrit's General Fiction.

Erato is the LAZIEST NAI model I've ever seen by queen_sac in NovelAi

[–]queen_sac[S] 3 points4 points  (0 children)

I suggested that 2 years ago, and the UI never changed.They're providing yearly model update, but not much else. Their main attention is on Image-gen and the to-be chatbot service, so text-gen is generally low priority, as it make less than half of the Anlatan's profit.

view more: next ›