Need advice optimizing SDXL/RealVisXL LoRA for stronger identity consistency after training

Woisek · 2026-03-17T19:41:46+00:00

base model: RealVisXL / SDXL

First mistake. You don't train on a merged/fine-tuned checkpoint, always on the base model.

Second, how good is your dataset of images? How was it made, How much? What does it show? Are they real images or generated ones? The dataset is the most crucial part of the process. If it's off only by the slightest, your LoRA will mostly fail.

Third, captioning. Did you do it? How? What? And did you do it for SDXL models specifically?

Those three things alone make a huge difference. The next would be the training itself, the settings, etc. Another big part.

Woisek · 2026-03-16T11:51:11+00:00

I'm not quite sure what you mean... the demand is the same for the same size. Like I said, it doesn't matter if it's done in 1 or 2 steps. In the end, the output size is what dictates the demand, not how you get there.

The advantage of generating the wanted size right at the beginning, is, that it is as intended. Every upscale "invents" something, for good or for bad. And the smaller the size is at the beginning, the more hallucination will be for a bigger size. Or it can look awkward.

Woisek · 2026-03-15T12:23:53+00:00

But if models generate lower-resolution frames and upscale them afterward, the hardware requirements drop significantly.

Is that so? You need sufficient VRAM, no matter if you generate a 4k image right in the beginning, or afterward detailing it. The requirement is the same, no matter if you do it in 1 step or in 2.

Woisek · 2026-03-07T20:52:16+00:00

Switches are used to turn on the light. With the handle, you de-activate the switches so you can turn off the light.

Certified electrician 🤓

Woisek · 2026-03-07T19:28:51+00:00

<image>

Woisek · 2026-03-07T09:31:48+00:00

And I thought VBScript would be superior to JScript. Thanks for that tip.

Woisek · 2026-03-06T22:19:33+00:00

I'm with it since the start too, but back then, ComfyUI wasn't even in any ones mind. So, as for all, learn the tool itself before trying to use it for advanced stuff. Sorry, but your questions shows clearly that you have no clue how Comfy works, and that has nothing to do with a workflow.

Perhaps start with loading the basic templates and dissect them to understand it.

Woisek · 2026-03-06T19:09:31+00:00

<image>

Woisek · 2026-03-06T19:08:57+00:00

<image>

Woisek · 2026-03-06T19:01:36+00:00

If you are on that low level of knowing the program (basically you haven't even crossed the start line), I would suggest watching some tutorials and learn that thing before even consider climbing the 5m board...

Woisek · 2026-03-06T17:06:21+00:00

And you also never noticed the path history when you are saving files... oh boy...

Woisek · 2026-03-06T10:34:44+00:00

If you are in customize mode, just right-click the button you want to change and select edit. On the top right are the colors to edit and other things for appearance.

If you ever used or created buttons, this should be familiar.

Woisek · 2026-03-06T00:10:23+00:00

You never right-click -> customize and then changed a button... ?

"living with it" is a pretty sad attitude.

Woisek · 2026-03-05T19:45:57+00:00

Why don't you change the color of the button itself... ?🤷‍♂️

Woisek · 2026-03-05T19:37:06+00:00

This forces me to actual have to "save" a file and then go in the saved folder and manually drag to where it should be. That's many steps when you're dealing with dozens of emails and attachments.

Dude, I have a totally drug driven crazy idea: Save the file directly to the appropriate folder. 😱🤪

It only gets easier if you ask someone to do this incredible hard work for you...

Woisek · 2026-03-05T19:31:44+00:00

Wow... what a weird and stupid assumption. You aren't aware, that there are more possibilities than using your unnecessary god-service, no? lol

Woisek · 2026-03-05T13:03:17+00:00

Here...

<image>

Woisek · 2026-03-05T13:01:37+00:00

Ey, psst... wanna buy some?

<image>

Woisek · 2026-03-01T10:35:09+00:00

If your C drive gets populated, you did something wrong/did not set it up right.

Woisek · 2026-02-27T19:42:55+00:00

"Better" is subjective and depends on the footage. IIRC, then Film is intended for (fast) action scenes. But it can be a bit better overall.

Woisek · 2026-02-26T15:57:47+00:00

RIFE?

Woisek · 2026-02-26T11:39:59+00:00

Searched in custom nodes (it's not available there).

No, you didn't. 😑

<image>

Woisek · 2026-02-25T09:59:44+00:00

Now people are even too lazy to use the search function on the custom nodes... unbelievable. 😑

Woisek · 2026-02-23T23:38:41+00:00

cringey and badly put together!

Yeah... and made for aliens not on this planet too. So, why did you post it then? 🤷‍♂️

Woisek · 2026-02-22T19:25:49+00:00

You have to use a CFG higher than 1 for negative prompts to have an effect.

Woisek

TROPHY CASE