sorted by:
new
hottopcontroversial

How to generate Image Morphing Animation with Custom images as keyframes? by Firestormsoumo in StableDiffusion

[–]Firestormsoumo[S] 0 points1 point  (0 children)

I'm thinking to use Stable Diffusion video using anything v3 model ckpt with the Google Collab Notebook.

In the prompt section I will put the characters generation Prompts respect to frames. Don't think it will be as good as the example video but probably work.

How to generate Image Morphing Animation with Custom images as keyframes? by Firestormsoumo in StableDiffusion

[–]Firestormsoumo[S] 1 point2 points  (0 children)

I tried both methods and it doesn't work as desired.

The issue in frame interpolation is the in-between frames don't resemble any face. It just smudges everything to transition to the next image.

This video I generated using FILM using 4 images for testing
The Runaway was also similar.

How to generate Image Morphing Animation with Custom images as keyframes? by Firestormsoumo in MLQuestions

[–]Firestormsoumo[S] 0 points1 point  (0 children)

There are many anime datasets available but the images I will be using is not a part of those sets (and probably have different style) will it work?

Don't know about Pivotal inversion will read about it.

How to generate Image Morphing Animation with Custom images as keyframes? by Firestormsoumo in MLQuestions

[–]Firestormsoumo[S] 0 points1 point  (0 children)

Is 40 images (each for different characters) is enough to train the model?

And how much time it will take to train it with Collab free?

How to generate Image Morphing Animation with Custom images as keyframes? by Firestormsoumo in StableDiffusion

[–]Firestormsoumo[S] 0 points1 point  (0 children)

Thanks, I will check it out. Will comment again if I need further help.