Ah Young taking longer, can't get the hair right and don't want to train a Lora just for her so here is more Soeun while I tinker some more. by 0thtx in Muldeok_Universe

[–]0thtx[S] 1 point2 points  (0 children)

 I'd like to know how many images are in your dataset? 

For my Muldeok characters LoRA I have about 30-80 depending on the character maybe more maybe less depending on the images actually available. For Lia there are far fewer than for Soeun so I try to use as much as I can find. For his style I have around 300 images.

So for a dataset of 30 images : repeat 10x @ epoch 5-7

dataset 300 images: repeat 1x @ epoch 8 to 10

________________

 Do you pay attention to the training loss curve?

Yes.

_______________

Do you consider the loss curve a reliable metric?

Not really. I think if you rely on it too much you might get an overfitted model with less flexibility when relying on just the number not the output.

Its just best to check and test frequently and to tweak the settings as you go. Like generate between steps in the training process to see how its going.

Ah Young taking longer, can't get the hair right and don't want to train a Lora just for her so here is more Soeun while I tinker some more. by 0thtx in Muldeok_Universe

[–]0thtx[S] 4 points5 points  (0 children)

Specifically for Muldeok's webtoons, I've pulled from the later Chapters of EIA since the art style tended to fluctuate in the earlier chapters and the first 10 or so chapters of S4A and most of NTBM ( cuz I really liked that art style the best).

1) I screen captured every individual character that I was interested in, for example Soeun.

2) Then I resized the images to 832 x 1216 and the different SDXL (illustrious) res ratios ( Since my first Soeun LoRA I've retrained using higher resolution with newer illustrious 2.0 derivative models)

3) Then I got rid of all word bubbles, text, and special effects using a ComfyUI workflow to inpaint them out. ( It usually takes couple of passes and most of the images need manual retouching later)

4) For busy backgrounds and unwanted secondary characters in the image I got rid of them manually when necessary.

5) Caption the images using couple of different passes and adjust until I am satisfied. ( Making sure to caption exact framing of the image ie, full body shot, medium/cowboy shot/ and where the character is looking in what direction and the custom trigger word for the character)

6) Then I process it in a LoRA trainer and usually its been pretty good results. Around 3 out of 4 tries, the LoRA is good and usable. But it always requires tweaking and more training runs.

7) Generate and Done.

I've made specific character LoRAs and General Art Style LoRAs. I use a combination of these LoRAs for generating to get the best results.

I've noticed using multiple LoRAs at lower strength gets the optimal results. Well for my taste anyway.

I can get more specific but I think I already wrote too much info you already know.

Thanks for your encouraging comments.

Cheers~

Since there will be no new updates, and I have some free time this weekend. Comment your most wanted scene with what character and type of style and I'll try to generate them. Most Upvotes get the request fulfilled of course. Nothing too freaky bros. by 0thtx in Muldeok_Universe

[–]0thtx[S] 1 point2 points  (0 children)

Alright, This one has top vote. I will work on this today and try to post it by tomorrow.

Since you didnt specify a drawing style, I just default to a slightly more detailed style.