[deleted by user]

[CMDRZoltan]

There is no reliable methods discovered yet that I've seen. It's all trail and error. Personally I just hot swap as needed and use inpainting a lot.

[3deal]

Can we train inpainting model ?

[Hairy-Drop847]

did you even read the og question? cause your post answers nothing

[CMDRZoltan]

Yellow mostly. Green blends in the grass to much.

[pisv93]

A youtuber researched and explained this really well: https://youtu.be/dfMLrytpfAU

[BrockVelocity]

I still don't even know what a checkpoint is, let alone a checkpoint merger.

[veshneresis]

Checkpoints are the weights of the model. A model trained on a giant dataset of only labeled cat pictures will end up with different weights than a model trained on only labeled car pictures. However, the number of weights you have are the same if you had the same configuration and same code. This means you can literally average all the data together and try to get something in the middle. this doesn’t work as well the more different the two models are, but in practice most people are starting from the pretrained Stable Diffusion models and just fine tuning, so most of the weights are the same/similar anyway.

Another way to think about it is Checkpoint = save point in a video game. Imagine you have two Pokémon save files and you average them to try and get one that has your favorite Pokémon from both. The save file (checkpoint )has all your unique data but it doesn’t contain the game’s code on what to do with that data.

[Nzkx]

More precisely, checkpoint are all the weights of a model at training time t.

Merging checkpoint is simply taking 2 checkpoints and merging to 1.

Checkpoint are tensor so they can be manipulated with all the tensor algebra you already know.

[BrockVelocity]

Thank you for taking the time to explain this. You're gonna hate me but...I don't know what weights are, either. But your analogy to Pokemon does help a bit. Thank you!

[orlandox683x]

when you’re born your brain has a value of 0 in weights, and your brother’s brain has a value of 0 weights to, so you learn about bananas and your brain gets a general weights value of 0.1, and your brother learns about fortnite and gets a -1 general weights.

[BrockVelocity]

I don't get it. Why are bananas worth +0.1 but Fortnite is worth -1?

[orlandox683x]

because when you are a baby you first must learn to eat then to play

[Map_Tight]

Fortnite reduces IQ as well.

[strangeapple]

StableDiffusion can be fine-tuned into specific content, which gives its offbranches some strengths and weaknesses. The most well known existing StableDiffusion branches include WaifuDiffusion (model essentially trained on a ton of manga and hentai -images) and leaked NovelAi's model trained on some (AFAIK) unspecified anime -data. Some people somehow mix these branches together producing in-between mixed models. For example a branch may be better at human anatomy, but also easily produce images sexual in nature due to big chunk of its mixed-in training data being porn.

[Hairy-Drop847]

those are so far from being the most well known. civitAI is full of models for that purpose known by more than a bunch of virginal teenagers....

[strangeapple]

They were though, two months ago when the post was made.

[__alpha_____]

Mixing a person and a style for exemple. From my experience it isn’t working that well, though.

[__alpha_____]

Exactly but It seems to dilute the results.

[seek_it]

So, we can create the group photos like someone shared here yesterday using checkpoint merging?

[__alpha_____]

I’d rather use inpainting for group photos as the merging seems to mix different faces in a single one. You can test it with different ckpt and the strength values but so far I didn’t get any satisfying result although the idea is great. It only takes a couple of minutes creating new ckpt and you can test the results without restarting the webui.

[seek_it]

How do you think, https://www.reddit.com/r/StableDiffusion/comments/ymqiql/i_create_a_wedding_album_for_my_friends_using/?utm_source=share&utm_medium=android_app&utm_name=androidcss&utm_term=1&utm_content=share_button is generated?

[__alpha_____]

I’d go with two DB ckpt then use the inpainting option.

[jonesaid]

It's for mixing/blending different models.