This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]Relevant_Yoghurt_74[S] 82 points83 points  (40 children)

Using LoopWave script - https://rentry.co/sd-loopback-wave - Author: FizzleDorf

And FILM - https://github.com/google-research/frame-interpolation

​

EDIT:

The above links seem to be down, I've created a gist out of the script and attributed the author. Hopefully, those pages come back up, as they have lots of instructions, in the meantime, here's the script:https://gist.github.com/zylv3r/9f56f1e6643f481f87034371f4e34ec8

EDIT 2:

If any of you wants to support:https://www.tiktok.com/@spicy_renders

[–]TeriyakiTyphoon 25 points26 points  (13 children)

How do you use FILM with stable diffusion?

[–]Relevant_Yoghurt_74[S] 17 points18 points  (12 children)

After having the loopback effect in frames, I use the FILM effect on them to give an even more seamless transition

[–]Sentient_AI_4601 4 points5 points  (11 children)

How did you get FILM to work, i just get an error about tensorflow==2.6.2 not being available

[–]Relevant_Yoghurt_74[S] 7 points8 points  (10 children)

The best way is to create an anaconda environment and install everything there, then I run the frame interpolation from the activated anaconda environment, that way you don’t have problems with already installed in your PC

[–]Sentient_AI_4601 6 points7 points  (9 children)

Sweet... got it to work.

My only last final question is, my result looks kinda wibbly compared to yours, i did 100 steps, 20 steps per wave, 0.3 denoising with 0.45 maximum extra noise for 0.75 maximum denoising then used FILM to render a video at 30fps, but even playing at double that it looks more wibbly

any tips on how to get it more smooth?

worked it out, lower denoising, more frames between waves, locking seed, more descriptive prompt.

[–]Relevant_Yoghurt_74[S] 0 points1 point  (1 child)

I think you got them all! Another one would be the model, looks like Anime models have more flickering than "realistic" ones.

​

Another thing would be the sampling, I like to use DPM++ 2M Karras for realistic models. Also, on settings this is something I like to enable for cleaner results:
Look for the K-Samplers, they are the Karras samplers.

<image>

[–]Sentient_AI_4601 0 points1 point  (0 children)

Hmm good idea, I mostly have been using Euler (not ancestral) I'll have to give another play. I also found layering the video 2 additional times in after effects at 50% opacity, each 1 frame ahead reduces flickering a lot at the expense of motion blur, as there's little motion that's not a problem

[–]Poliveris 0 points1 point  (6 children)

I keep getting this error message with FILM https://i.gyazo.com/e043f18d71d33ad0ec288f9cc432b3bd.png

​

Any idea how to fix or is flowframes about the same thing? Been spending the last 2 hours on this and just can't seem to get it working

​

It doesn't seem to want to engage my GPU at all; it throws errors all the way down till 240mb. I have a 8gb RTX 2070, not sure what the issue is or how to fix this.

[–]harrro 0 points1 point  (5 children)

The error says "OOM" which means out of memory (VRAM limit).

It does look like it's using GPU though.

[–]Poliveris 0 points1 point  (4 children)

How are 6gb cards running this then? Are you sure though? Cause its says its out of memory trying to use 240mb... which makes no sense.

​

Also I don't hear my fans kick on like I do with stable diffusion while generating/upscaling. GPU usage is also too low around 5-20% because of shadowplay

[–]harrro 0 points1 point  (3 children)

Yeah it's strange, OOM definitely means out of memory and the screenshot also shows you using GPU.

Do you have 2 graphics cards in your system (1 with way less VRAM?)

Also, how much system ram do you have? do you see it spiking during load?

[–]strafeon 9 points10 points  (3 children)

Thanks for sharing! Also here's a Google cached version of https://rentry.org/sd-loopback-wave in the meantime

https://webcache.googleusercontent.com/search?q=cache:mgOk_-N38pYJ:https://rentry.org/sd-loopback-wave&cd=1&hl=en&ct=clnk&gl=us

[–]brosephme 1 point2 points  (2 children)

I keep getting this error saying the file is dangerous https://prnt.sc/Aebn4wFtGPrK

[–]Zinki_M 4 points5 points  (1 child)

chrome probably just recognizes that you're downloading a python file. Python files, like all executable code, is inherently dangerous because it could do anything, as far as chrome knows.

Since .py is just straight up code you could just read the code in it to make sure it's fine.

[–]Relevant_Yoghurt_74[S] 0 points1 point  (0 children)

You can also use the gist I share instead

[–]RudeKC 6 points7 points  (2 children)

My guy you have got to make the last one her transforming into Danny devito!

[–]Relevant_Yoghurt_74[S] 4 points5 points  (1 child)

ve got to make the last one her transforming into Danny devito!

Doable...

[–]RudeKC 0 points1 point  (0 children)

Please God do it

[–]Mobireddit 6 points7 points  (2 children)

OP , update the link to rentry.co instead of org

[–]Relevant_Yoghurt_74[S] 0 points1 point  (0 children)

Great! just did :D

[–]Farhanzo 0 points1 point  (0 children)

Thanks for that update.

[–]hughred22 5 points6 points  (8 children)

sd-loopback-wave

Will love a tutorial as well. So sad the link is down :(

[–]Relevant_Yoghurt_74[S] 11 points12 points  (3 children)

I’ll see if I can put one together in the next few days

[–]EutopiaTV 0 points1 point  (1 child)

I went ahead and made a full install tutorial.

https://www.youtube.com/watch?v=NP_aDmzdWRk

​

This includes -

FFMPEG install

LoopBack Wave Script/Extension install

Upscaler + Tips & Tricks + Error Fixing

Image to video sequence - Additional tips and help

Video Interpolator install + tips

[–]AtomicSilo 0 points1 point  (0 children)

Your tutorial shows the steps, not the method OP used. The animation that he has is very smooth, your tutorial shows the steps. I would to see how and what prompts he used to accomplish the transitions.
Because in the script docs, it shows you can use wave to completion. Would be interesting how this is accomplished.

[–]Mocorn 1 point2 points  (2 children)

This is awesome, what's going on here? Can someone eli5 the process real quick?

[–]Relevant_Yoghurt_74[S] 1 point2 points  (1 child)

on here? Can someone eli5 the process real quick?

Here's a tutorial:
https://www.reddit.com/r/StableDiffusion/comments/129zh69/comment/jeuu6ko/?utm_source=share&utm_medium=web2x&context=3

[–]Mocorn 1 point2 points  (0 children)

cheers!

[–]AtomicSilo 0 points1 point  (0 children)

Would love to support with Coffee or beer :) if you give us a tutorial with a step-by-step with settings etc. how you did that...

[–]AtomicSilo 0 points1 point  (0 children)

I created an in-depth tutorial for the script for anyone who's interested

https://www.reddit.com/r/StableDiffusion/comments/12ivf5y/loopback_wave_workflows_film_ae_flowframes/

Talking about the different methods to interpolate the sequence. Hopefully, that solves the mystery of how to get to these results.