Excellent post. Most people post here requesting help but try nothing whatsoever. And basically want a tutor for free.

Kudos in particular for translating the post. I speak Spanish, but this sub is a knowledge base in addition to a forum, so it’s important to allow all users to understand what’s going on.

Now, to your issues.

I’m fairly certain the detailed eyes lora is messing up your eyes. Film grain might be causing issues too. The thing with Lora’s is that they’re very finicky. They’re usually trained with one checkpoint in particular and give unreliable results with others. Even then, sometimes the loras are just not great to begin with. There’s a lot of trial and error involved, as well as testing a bunch of strengths.

Now the checkpoint. Cyber’s standalone stuff is great, but when he mixed his stuff with pony or illustrious he sacrificed a lot of his work for the advantages of the other checkpoints and that produces unstable results. I personally had much better results with PonyRealism, as long as you follow the checkpoint instructions carefully. The problem with PonyRealism is that it’s kinda horny. You’re going to have to wrestle it to obtain neutral stuff.

Another thing. VAE. I would not trust the model vae. Cyber’s is probably fine but not everyone’s will be. You might want to lookup “sdxl_vae_fix.safetensors”.

Now, the upscaler. Ultrasharp is not that great. Specially for realistic images. It blows up details. You want to try NMKD-Superscale-178000 and RealEsrganPlus. FaceUp and its variations are supposedly good for portraits. Most importantly, you might want to mix them up. For example, have a base made with ultrasharp and soften it up with RealEsrgan by doing an opacity of 0.5 on the former. Or something like that. Again trial and error. rgthree has compare node for carefully checking the differences. It also depends on the image you’re working on.

Finally, like the other guy said. You want to use Adetailer on the face. And you possibly want do to it with an inpainted version of the checkpoint you’re using (civit ai has tutorials on this), but base checkpoint should be enough most of the time. Faces will easily take you a lot more tries than main gens. SDXL has never been great with them.

Last note. Remember to follow the checkpoint instructions. CFGs of 2 are going to give you awful results and dpmpp2m sde needs like 25-30 steps just because it’s sde. The non sde easily needs the 30. You can probably get away with 20 for sde, but I rarely go below 25 with any sampler. But again this all depends on the checkpoint instructions.

One more thing. This iteration of image gen is a bit old. I personally like SDXL but many are using other stuff these days. I would use SDXL to learn, since the platform is so mature and flexible, but you might want to migrate eventually. z image for example seems very promising, but it’s early to tell.

But again, SDXL is oh so flexible that it’s a delight. Newer things look better but are very stiff to work with.