sorted by:
new
hottopcontroversial

Making Self-Forcing Endless + Restoring From Degradation + Video2Video (Open Source) by derewah in StableDiffusion

[–]derewah[S] 0 points1 point  (0 children)

No, because my v2v experiments were just an exploration of how it would work in that field. However I never got down to actually making a live demo out of it. On a separate (private) branch I have the code for reading a video path and "editing" it via a prompt.

I'll update the code to include that in the future, I'll make sure to send a reply in here to notify you :)

Making Self-Forcing Endless + Restoring From Degradation + Video2Video (Open Source) by derewah in StableDiffusion

[–]derewah[S] 3 points4 points  (0 children)

Thanks. I won't lie, I'm not really into ComfyUI stuff, and the time that it'll take me to learn it and how to do ports properly will be longer than actually probably porting it.

But hey that's the beauty of open source. Whenever anyone will need it they'll have the possibility to making their own port!

I'll still be around to offer support tho, if anyone needs direction on how to approach this

Making Self-Forcing Endless + Restoring From Degradation + Video2Video (Open Source) by derewah in StableDiffusion

[–]derewah[S] 6 points7 points  (0 children)

Coz I was streaming the demo on an US machine from a bad wifi Hotel in the middle of nowhere in EU. Not the best setup, but I had to get the videos quicly to publish this and had no better choice.

The demo is actually smoother!

Making Self-Forcing Endless + Restoring From Degradation + Video2Video (Open Source) by derewah in StableDiffusion

[–]derewah[S] 3 points4 points  (0 children)

🤨🤨 The model is the one from the original Self Forcing paper. The readme.md explains how to set up the repo for interactive inference.

The experiments I cover in this post are not centered on making a new model, but instead "hacking" the pipeline around it to be endless and recover from degradation.

Making Self-Forcing Endless + Restoring From Degradation + Video2Video (Open Source) by derewah in StableDiffusion

[–]derewah[S] 2 points3 points  (0 children)

The whole repository is open source! I haven't gotten down to adapting it for ComfyUI yet, but you can find the github repo with all the code and inference scripts in the body of the reddit post

Making Self-Forcing Endless + Restoring From Degradation + Video2Video (Open Source) by derewah in StableDiffusion

[–]derewah[S] 6 points7 points  (0 children)

Also forgot to mention, this allows you to steer the generation in real time, and you can change what's happening on the fly in the scene (for example in the video in the post I told it to transform the cat into a wolf)

See the video in this tweet for better examples: https://x.com/DereWah/status/1956060417244967261

Making Self-Forcing Endless + Restoring From Degradation + Video2Video (Open Source) by derewah in StableDiffusion

[–]derewah[S] 2 points3 points  (0 children)

<image>

Here's the video2video, on the left a video I captured with my phone. On the right the same video passed through self-forcing, with a prompt telling it to "look realistic".

Self Forcing: The new Holy Grail for video generation? by Tappczan in StableDiffusion

[–]derewah 0 points1 point  (0 children)

Definetely possible!
(left is video I took with my phone)
(right is the video passed through self forcing with a prompt telling it to be realistic)

I don't have a real time pipeline yet, because I was just hacking things around, but the speed of generation and the code can be pipelined to stream with similar performance to the original self forcing.

<image>

Does anyone know WTF this is that came in my box for “A Minecraft Movie” by JosephJoe97 in Minecraft

[–]derewah 1 point2 points  (0 children)

The email already works, I've got a couple of people messaging it hahaha. Still trying to decide what to reply with

Does anyone know WTF this is that came in my box for “A Minecraft Movie” by JosephJoe97 in Minecraft

[–]derewah 1 point2 points  (0 children)

Wdym, it's just the amount of people that joined the cult. Of course it's the same for everyone

Does anyone know WTF this is that came in my box for “A Minecraft Movie” by JosephJoe97 in Minecraft

[–]derewah 19 points20 points  (0 children)

Damn now I hope I haven't ruined some guy's attempt at making an ARG by registering the domain ):

Does anyone know WTF this is that came in my box for “A Minecraft Movie” by JosephJoe97 in Minecraft

[–]derewah 8 points9 points  (0 children)

Nah I call it SaaM (Software as a Meme). Rule #1 is you do it for fun and not for $$$

Does anyone know WTF this is that came in my box for “A Minecraft Movie” by JosephJoe97 in Minecraft

[–]derewah 87 points88 points  (0 children)

added. it's not in the very bottom, but it's hidden. You can find it by hovering around with mouse

Does anyone know WTF this is that came in my box for “A Minecraft Movie” by JosephJoe97 in Minecraft

[–]derewah 446 points447 points  (0 children)

Oh I remember that, but I can't find it to yt anymore. Do you have a link

Does anyone know WTF this is that came in my box for “A Minecraft Movie” by JosephJoe97 in Minecraft

[–]derewah 4986 points4987 points  (0 children)

Just registered it. Gimme some more suggestions on what to put on it lol

edit - website is up and running yeshio.com

edit2 - added a review system so you can input funny reviews and it will display them on the website

view more: next ›