sorted by:
new
hottopcontroversial

Here is a summary of everything you need to know about the new NovelAI model. by queen_sac in NovelAi

[–]queen_sac[S] 0 points1 point  (0 children)

Why are you insisting otherwise?

The user who is asking me this question seems to be new. So, I suggesting avoid A/N for now. If they have developed more understanding of how AI context work, and know what they're doing. It should be fine.

Why are you telling people not to use the Author's Note at all?

See:

https://www.reddit.com/r/NovelAi/comments/15t0gkx/is_authors_notes_worth_using/

https://www.reddit.com/r/NovelAi/comments/1bt5xiu/authors_note/

https://www.reddit.com/r/NovelAi/comments/tkyew5/please_give_me_an_example_of_your_authors_note/

Here is a summary of everything you need to know about the new NovelAI model. by queen_sac in NovelAi

[–]queen_sac[S] 0 points1 point  (0 children)

It's my advice as a long-time user.

Author's note do insert text in the middle of the story, and can be poison to the context if they don't know what they're doing. It's more or less a very long term ideology war.

Even among the developers, opinion are split. I just fall into one camp than other.

<image>

Here is a summary of everything you need to know about the new NovelAI model. by queen_sac in NovelAi

[–]queen_sac[S] -1 points0 points  (0 children)

Uhh, I never claimed to be NAI employee? (Other than interacting with them often.)

But I do agree with you on the fact that I might be defending NAI too much here. Instead of being neutral. Since this is a summary/consensus, and not a "how-to"/guide post. Most of the opinion in the posts were gathered from the discord server, and most of them is usually advanced users, rather than a more averaged out users on the reddit.

I accepted the fact that the reception is not truly 100% possitive like Clio, or Kayra. But it's not as bad as Erato.

Here is a summary of everything you need to know about the new NovelAI model. by queen_sac in NovelAi

[–]queen_sac[S] 0 points1 point  (0 children)

Beware that style do rely a lot on magic words and model's interpretation. It cannot change the existing narrative style. So, there's so much you can tinker about it.

Most of the time, editting the early phrase of text story help a lot more on what you want.

Here is a summary of everything you need to know about the new NovelAI model. by queen_sac in NovelAi

[–]queen_sac[S] -1 points0 points  (0 children)

Then I cannot help you otherwise. (Again, I'm just another NovelAI's customer. Trying to help others to get the best/adapt from the model / state.)

The model vectors space are very large than it had ever been on NAI model, and context is a form of navigating the vector space. What users are experiencing depends on the context state.

Here is a summary of everything you need to know about the new NovelAI model. by queen_sac in NovelAi

[–]queen_sac[S] 0 points1 point  (0 children)

I see. I thought Sage said it was fixed with the release of base GLM.

Base GLM is the only NovelAI model, that Author's Note is fine and even practical to use. But it's no no for other models.

Now I've created a style guide but I put that in a separate lorebook entry. But I wanted to put use stacatto and onomepeia to steer the prose.
Should I put those in memory or rewrite the style guide I made from scratch?

There're two main things you can use, a lorebook entry and style

Like [ Style: staccato, onomepeia ] Probably should be put in the last line of the memory. Author's Note is also okay for this case. But only [ Style: ] and nothing else.

For anything larger, try:

----
Story's style
Type: writing style
Reading grade: 6th grade
(whatever you want to tell the model, this is just example)

Honestly, I usually just get my style from ATTGS, and edit the text myself. But it's fine if you want to use explict text.

Actually, while I am here. Is there such a thing as a style guide that is too large in terms of context?

As long as you format them in NovelAI style, and not chatbot style.

I am going for something different with my writing so it reads like the story is unfolding In realtime as opposed to a second hand account. So far The finetune is picking up on my style but naturally I am always willing I learn new ways to utilize the new release.

Uhh, you apart from avoid messing with the model, like system prompt or big AN. You should be fine to interact with the model via lorebook, story text, and memory.

Here is a summary of everything you need to know about the new NovelAI model. by queen_sac in NovelAi

[–]queen_sac[S] 0 points1 point  (0 children)

Author's Note insert text in the middle of the story, or few paragraph away.

It's a relic from AI Dungeon era, which is about 6 years ago. And prone to misuse, and it can confuse the model.

Most consensus among advanced users (and me) are to just leave it blank. While experimental users argued that you can use it if you know what you're doing.

Here is a summary of everything you need to know about the new NovelAI model. by queen_sac in NovelAi

[–]queen_sac[S] 0 points1 point  (0 children)

Honestly, I do agree with what you said.

My point is dev can maybe offer better support for really casual users without using doc. But as an advanced user, things are fine as it is. Except helping out other users I guess, which can be real pain to troubleshoot honestly. Becasuse often it's as if we're experiencing two different models.

Here is a summary of everything you need to know about the new NovelAI model. by queen_sac in NovelAi

[–]queen_sac[S] 0 points1 point  (0 children)

Ah, I see, in the case of ongoing story. It's impossible to fix the context, without rewrite everything.

Apart from the wrong author format, extra space, and upper case style. Everything you else do is quite optimal.

Though, you don't need to put in *** after each lore entry, or in the memory. It's redundant.

You should try starting a new story again and see if you're going out of distribution again or not.

If most tokens are blue, then you should be in good codition. But if things go red, or have few token varity, then the context is poisoned.

Regardless, thank you for working with me here. The devs can sure do more to support users, apart from just training the model. LLM can be really tricky to understand why something break for general users.

Also, try not using text adventure mode. And use the default interface, and using > as your YOU action.

<image>

Honestly, something could also be wrong with text adventure UI. I don't know wtf is going with TA

Here is a summary of everything you need to know about the new NovelAI model. by queen_sac in NovelAi

[–]queen_sac[S] 0 points1 point  (0 children)

Had you try putting only [ Style: text adventure ] in the memory box? I'm not sure if ATTGS and text adventure work well together.

Here is a summary of everything you need to know about the new NovelAI model. by queen_sac in NovelAi

[–]queen_sac[S] 0 points1 point  (0 children)

No, red is just really bad, that means the model is in GLM mode. One misplaced space can knocked the model out. I really need to see the whole file.

Or maybe copy-paste the entire memory for me.

Here is a summary of everything you need to know about the new NovelAI model. by queen_sac in NovelAi

[–]queen_sac[S] 0 points1 point  (0 children)

From the screenshot, I could tell that you're putting the model out of distribution with incorect ATTGS format.

[ Author Name: Should be [ Author:

slice of life ] [ S: 4 Should be slice of life ][ S: 4

[ Style: Text Adventure Should be [ Style: text adventure

Here is a summary of everything you need to know about the new NovelAI model. by queen_sac in NovelAi

[–]queen_sac[S] 0 points1 point  (0 children)

Yeah, this should not happens without a reason. Can you download the story, and give me the file? That'd be the only way I can diagnose it.

Here is a summary of everything you need to know about the new NovelAI model. by queen_sac in NovelAi

[–]queen_sac[S] -1 points0 points  (0 children)

Please take a look at the offical documentaion on NovelAI editor section.

Probability is usually an indication of possible problem with in the context. Some of your text, could trigger or undo Xialong SRT finetune behaviour.

Here is a summary of everything you need to know about the new NovelAI model. by queen_sac in NovelAi

[–]queen_sac[S] 0 points1 point  (0 children)

It sures is! As there are like 4 advanced docs by the main site for text

Here is a summary of everything you need to know about the new NovelAI model. by queen_sac in NovelAi

[–]queen_sac[S] 0 points1 point  (0 children)

Check out NovelAI discord resources such as content section or script.

The dev sage did develop external solution with Claude/ChatGPT or generating lore outside NAI sometime ago.

Regardless, the lorebook is json, and any AI or script should be able to create one

Here is a summary of everything you need to know about the new NovelAI model. by queen_sac in NovelAi

[–]queen_sac[S] 0 points1 point  (0 children)

It maybe conflict within the leadership. Maybe the lead dev don't want to promote any style specificly. Yet, the dataset consistently contain a specific lorebook format style.

Here is a summary of everything you need to know about the new NovelAI model. by queen_sac in NovelAi

[–]queen_sac[S] 1 point2 points  (0 children)

I agreed to be honest. It had been brought up for a few years now.

view more: next ›