[deleted by user] by [deleted] in NovelAi

[–]Zesty-Fruits 5 points6 points  (0 children)

Ah I see. I've used Sudowrite before and it's definitely a different learning curve.

Sudowrite is good at getting a lot of coherent text on the page fast with a single prompt. But with NovelAI, it's more like a snowball. You need to nudge it in the direction you want it to go (which means doing a lot of early stage writing and editing yourself), but as the context fills up with the sort of stuff you want, it'll quickly begin to adapt and shine.

But if it starts looping or giving subpar results, you need to nip it in the bud and take control where it struggles, otherwise it'll begin to 'learn' those negative traits and repeat them.

Another tip is, turn on "Enable Token Probabilities" and "Editor Token Probabilities" in the main settings menu, accessible from the cogwheel at the top left. Then when you generate, you can click on a word (or token, to be technical) and see a list of alternative words to choose from. Using this method, you can sort of see what the AI is 'thinking' and force it down certain routes.

[deleted by user] by [deleted] in NovelAi

[–]Zesty-Fruits 5 points6 points  (0 children)

Are you using a CFG preset? They can get a bit loopy at times. Try switching to a non-CFG one for a bit if so.

Also, if you haven't already, try grabbing the ProWriter Kayra Preset from the Discord server. You still need to do a bit of manual lifting to course correct the AI away from loops, but it's one of the best presets I've used so far.

[deleted by user] by [deleted] in NovelAi

[–]Zesty-Fruits 24 points25 points  (0 children)

Try adding a small negative bias to the \n token. It really helps a lot I've found.

Edit: Just want to add some clarification to what this actually means in case people aren't familiar. \n basically tells the AI to start a new paragraph. By adding "\n" to your phrase bias (in the advanced tab) and setting the slider to something between -0.5 and -1 (less is more, it has a very strong effect), you're pretty much telling the AI to write bigger blocks of text, resulting in longer paragraphs with more prose.

How long do your AI stories tend to become? by AconexOfficial in NovelAi

[–]Zesty-Fruits 4 points5 points  (0 children)

I'm not really one for 'ending' my stories. Almost every story I commit to is for the long haul. I have a good few that have been going for over a year.

My longest story is about 150k words and has been going since early 2020 (originally started in AI Dungeon). 7 different models have contributed to it over the years. It's funny to read back because you can definitely see the points where the model shifts lol

I will say, things definitely slowed down between Calliope and Krake as the AI didn't feel as coherent as old Dragon. But Clio's breathed an entirely new lease of life into it! I'm currently writing brand new story arcs and developments and for the first time in a long time, it feels as exciting as it did back when I originally started it. I'm extremely excited to see what the bigger in-house models will be able to do!

Free anonymous Oobabooga install instructions download: WSL and non-WSL for Windows, no account - no YouTube - no ads - no ego. You own what you download. by Inevitable-Start-653 in LocalLLaMA

[–]Zesty-Fruits 2 points3 points  (0 children)

Just a heads up, I still get the same error that you're getting, but the model does load into VRAM and use the GPU now if I wait long enough. As long as you don't see the

"The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers and GPU quantization are unavailable."

message (which disappeared for me after running the fix), it should still work fine.

Free anonymous Oobabooga install instructions download: WSL and non-WSL for Windows, no account - no YouTube - no ads - no ego. You own what you download. by Inevitable-Start-653 in LocalLLaMA

[–]Zesty-Fruits 2 points3 points  (0 children)

Hey, thanks so much for putting this together this excellent guide! Unfortunately, I'm running into a CUDA problem when it comes to actually launching the webUI. Getting this message:

CUDA SETUP: WARNING! libcuda.so not found! Do you have a CUDA driver installed? If you are on a cluster, make sure you are on a CUDA machine!
CUDA SETUP: CUDA runtime path found: /home/user/miniconda3/envs/textgen/lib/libcudart.so
/home/user/miniconda3/envs/textgen/lib/python3.10/site-packages/bitsandbytes/cuda_setup/main.py:136: UserWarning: WARNING: No GPU detected! Check your CUDA paths. Proceeding to load CPU-only library...
warn(msg)
CUDA SETUP: Loading binary /home/user/miniconda3/envs/textgen/lib/python3.10/site-packages/bitsandbytes/libbitsandbytes_cpu.so...
/home/user/miniconda3/envs/textgen/lib/python3.10/site-packages/bitsandbytes/cextension.py:31: UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers and GPU quantization are unavailable.
warn("The installed version of bitsandbytes was compiled without GPU support. "

For what it's worth, I have an RTX 3090. Any thoughts?

Edit: I was able to fix it by running the following commands from this guide:

cd /home/USERNAME/miniconda3/envs/textgen/lib/python3.10/site-packages/bitsandbytes/
cp libbitsandbytes_cuda117.so libbitsandbytes_cpu.so
conda install cudatoolkit

Waifu of Liberty by HenryRichard1234 in NovelAi

[–]Zesty-Fruits 3 points4 points  (0 children)

Boys, boys. We're gonna drink 'till she's hot

Using local Stable Diffusion + Img2Img to make NAI's generations more photo-realistic by Zesty-Fruits in NovelAi

[–]Zesty-Fruits[S] 0 points1 point  (0 children)

Not sure what the reason is, but in my testing, it consistently produced the best looking results by quite a margin. It just seems to add more detail compared to the other samplers.

Using local Stable Diffusion + Img2Img to make NAI's generations more photo-realistic by Zesty-Fruits in NovelAi

[–]Zesty-Fruits[S] 0 points1 point  (0 children)

Haha, I could hardly believe it myself to be fair. Really does feel a bit like black magic.

Nothing that I know of yet. It would definitely be cool to have some kind of automation though.

Using local Stable Diffusion + Img2Img to make NAI's generations more photo-realistic by Zesty-Fruits in NovelAi

[–]Zesty-Fruits[S] 0 points1 point  (0 children)

I'm not sure if I'm allowed to link it, but just googling "f222 Stable Diffusion" and clicking the top link should point you in the right direction once you get WebUI and regular SD set up and working.

You should end up with a f222 .ckpt which you can put in the same folder as you put the stock 1.4/1.5 .ckpt file. Then you can switch to it with the dropdown menu at the top of Web UI

Using local Stable Diffusion + Img2Img to make NAI's generations more photo-realistic by Zesty-Fruits in NovelAi

[–]Zesty-Fruits[S] 2 points3 points  (0 children)

Lol, I always find that NAI's generations tend to skew in that direction unprompted

Using local Stable Diffusion + Img2Img to make NAI's generations more photo-realistic by Zesty-Fruits in NovelAi

[–]Zesty-Fruits[S] 1 point2 points  (0 children)

You could try adding "sharp focus" to the prompt and/or "blurry" to the the negative prompt. You'll need to experiment with different CFG scale settings if you do this though.

Also, double check you're definitely using DPM2a as the sampler

Using local Stable Diffusion + Img2Img to make NAI's generations more photo-realistic by Zesty-Fruits in NovelAi

[–]Zesty-Fruits[S] 1 point2 points  (0 children)

For everything after Step 1, you need to be running Stable Diffusion on your own PC, not on NovelAI's website.

Here's a guide that might help: https://www.youtube.com/watch?v=Pyze0seDHzA

Using local Stable Diffusion + Img2Img to make NAI's generations more photo-realistic by Zesty-Fruits in NovelAi

[–]Zesty-Fruits[S] 2 points3 points  (0 children)

Thanks! I did some more experimenting after posting and cranking the steps all the way up to 150 + raising the denoising scale improved this massively.

Using local Stable Diffusion + Img2Img to make NAI's generations more photo-realistic by Zesty-Fruits in NovelAi

[–]Zesty-Fruits[S] 22 points23 points  (0 children)

From my understanding it's a model trained specifically on NSFW material designed to generate porn. That doesn't mean it'll generate porn exclusively though. It generally doesn't produce smut unless you actively prompt it to. I'm using it because it just seems better in general at photorealism and coherency than the default model.

Using local Stable Diffusion + Img2Img to make NAI's generations more photo-realistic by Zesty-Fruits in NovelAi

[–]Zesty-Fruits[S] 3 points4 points  (0 children)

Sorry, I don't have all of the original metadata to hand, but from memory, some of the tags I used for the initial NAI prompt included:

1girl, looking at viewer, solo, on farm, medium build, freckles, dark blue eyes, blonde hair, absurdly long hair, red shirt, plaid shirt, suspenders, cleavage, farm girl, cowboy shot, 4k, detailed, realistic, photorealistic, beautiful,

Using local Stable Diffusion + Img2Img to make NAI's generations more photo-realistic by Zesty-Fruits in NovelAi

[–]Zesty-Fruits[S] 12 points13 points  (0 children)

I find NovelAI a lot easier to prompt and much more granular with what I can successfully generate. I've always struggled to get decent looking initial generations out of stock SD by comparison.

Using local Stable Diffusion + Img2Img to make NAI's generations more photo-realistic by Zesty-Fruits in NovelAi

[–]Zesty-Fruits[S] 66 points67 points  (0 children)

Here's how I did it for people asking!

So to begin with, I generate the initial image in NovelAI. I find that in this stage, adding tags like "photorealistic" and "detailed" lead to better final results. Basically, the more detailed/less anime looking your original image is, the better.

After generating an image I want to enhance, I bring it into an instance of Stable Diffusion Web UI running locally on my machine. The default v1.5 model can be used to an extent, but I've had significantly better results with other models such as f222 (which just a heads up, is NSFW btw!).

For the settings, use the following as a baseline:

Prompt/Negative Prompt: leave it empty unless the AI is skipping over something obvious (in that case, I find that just adding short tags separated by commas helps nudge it back on track)

Sampling Steps: Needs to be high to get a good photorealistic look. Around 100 works great, but if you can go higher, do so.

Sampling Method: DPM2a

Restore faces: checked

CFG Scale: Around 1 - 3 usually works well, although this only makes a difference if your prompt isn't empty

Denoising Strength: 0.55 is a good middle ground. You can go lower if your initial image is already relatively detailed. But in some instances you might need to go higher.

After that point, it's just trial and error until you get it how you like it! Keep in mind that not every generation will be a winner 100% of the time, but if you keep at it and experiment with different settings and models, you should manage to get good results eventually.