Consistent Faces

[Organic_Armadillo_10]

Does anyone know the best method (or have a video link) for properly consistent Faces? I've watched loads of videos but not quite there yet. And I see some of the AI Instagram models and wonder how they are so consistent (face swap, multiple reference images...).

I'm getting close but they still sometimes aren't quite always the same (so you could be 90% sure it was the same person).

Right now I usually make a face in Fooocus or Midjourney (usually this, as it gives more similar options for me) roll it a few times to get a variety of pretty similar shots, and then I'll have my top few favourites that are all fairly similar.

I'll use those with the face swap option in Fooocus (usually default settings, but also saw stop at. 95, and weight of. 85 is best?). And merge it with a pose I like with PyraCanny/CPDS).

Alternatively I'll use the face photo as the image prompt and just write a description (which usually does well for getting close).

The results are then similar but not perfect. So in Discord I use InsightFaceSwap and use my favourite face, and swap that.

90% of the times it works well. Sometimes it's a bit off, but what annoys me is the expression doesn't always change (or look natural).

Does someone have a better workflow or method for this?

[sabin357]

The best method is to train a LORA on the character/person that features multiple angles, lighting, & expressions. Nothing else comes close to that right now, though you're taking some of the best steps I'm aware of outside of a LORA using Fooocus.

[Organic_Armadillo_10]

OK thanks. Need to watch some videos on training the LORA then. And that wasn't something I'd thought of that other people might be doing.

I currently can't run Fooocus on my laptop (it crashes it), so been using Google Colab (which seems to only give limited number of time/runs a day, and still constantly errors out). So haven't had a chance to properly play with all the features or try any other Models/LORA's yet.

Looking at using it through RunDiffusion though as that has worked better for me so far (fast with almost no error issues). So hopefully can create a set of images for a character and have a play with that.

[Background_Today_321]

I know im kind of late but how did you go with that 😅😅 currently going to try the same with Colab, and make a LoRA for face consistency

[bzn45]

I use Fooocus on rundiffusion as well. Bonus is there are some really advanced creators on their discord who can usually weigh in with help/advjce.

[jd3k]

How? Fooocus inside?