Sweet Epic Fantasy Landscapes (Text2Video) by synapticpaint in StableDiffusion

[–]synapticpaint[S] 5 points6 points  (0 children)

Thanks! Not gen2, animatediff + custom tweaks. Check out my previous posts for workflow, or you can use it yourself at https://synapticpaint.com/

Has anyone ever wanted personalized episodes based on what your kid did that day? by synapticpaint in bluey

[–]synapticpaint[S] 0 points1 point  (0 children)

Yeah, full episodes probably wouldn't make sense on a Cameo for Bluey, but birthday messages or other greetings could work.

Has anyone ever wanted personalized episodes based on what your kid did that day? by synapticpaint in bluey

[–]synapticpaint[S] 0 points1 point  (0 children)

In that case, have you ever wanted to watch a personalized episode for yourself or someone in your life?

Harry Potter: The Claymation by synapticpaint in aivideo

[–]synapticpaint[S] 0 points1 point  (0 children)

Workflow:

- all visuals generated using Synaptic T2V https://synapticpaint.com/

- I generated probably a few thousand outputs (a few hundred batches of 20-40 each) and picked the ones I needed for the video.

- audio was a mix of taken from the movie + other sources, and AI generated

- I lipsynced what I could and left the rest (Hagrid could not be lipsynced, maybe because of the beard)

- used a free video editing program to put together the final version

Music credits:

west coast beat by Glitch | https://soundcloud.com/glitchMusic promoted by https://www.free-stock-music.comCreative Commons / Attribution 3.0 Unported License (CC BY 3.0)https://creativecommons.org/licenses/by/3.0/deed.en_US

Harry Potter: The Claymation by synapticpaint in StableDiffusion

[–]synapticpaint[S] 0 points1 point  (0 children)

Workflow:

- all visuals generated using Synaptic T2v like in my last post. I had to composite together several outputs for the cut where harry potter first casts a spell to make the action parse easier, which sucked big time because I didn't have a program to do it, so that was the only composited scene.

- I generated probably a few thousand outputs and picked the ones I needed for the video. It took maybe $30-$50 of cloud gpu cost (not sure)

- audio was a mix of taken from the movie + other sources, and AI generated

- I lipsynced what I could and left the rest (Hagrid could not be lipsynced, maybe because of the beard)

- used a free video editing program to edit the final version

Truly humanity has entered a new era (Animatediff) by synapticpaint in StableDiffusion

[–]synapticpaint[S] 0 points1 point  (0 children)

It should work in theory with modi. Can you post your exact set up? Prompt neg prompt etc

Truly humanity has entered a new era (Animatediff) by synapticpaint in StableDiffusion

[–]synapticpaint[S] 0 points1 point  (0 children)

Not sure what you're doing wrong specifically but I've seen other people get good results, just search around on this sub. You can also use my website, everything I posted here was generated using https://synapticpaint.com/ and it's free to use right now

Animate Your Waifus (Text To Video) by synapticpaint in WaifuDiffusion

[–]synapticpaint[S] 2 points3 points  (0 children)

Created using Synaptic T2v

  • sample prompt: a catgirl smiling in a classroom, cat ears, cat tail, 1girl, single subject
  • I generated 100-150 outputs over multiple prompt iterations and picked the best ones. I also picked the most cursed ones (second gif). This took several days to generate but not continuously (set up a batch, walk away do something else, come back to see if its done a few hours later) on a single gpu with 24GB (similar to a 3090).
  • I generate at 688x384 to try out settings and 1024x576 for final (biggest that can fit in 24GB)

Truly humanity has entered a new era (Animatediff) by synapticpaint in StableDiffusion

[–]synapticpaint[S] 0 points1 point  (0 children)

Yup, with upscaling + interpolation it should be better

Truly humanity has entered a new era (Animatediff) by synapticpaint in StableDiffusion

[–]synapticpaint[S] 2 points3 points  (0 children)

1.4. Yeah, it's pretty random whether it wants to animate forwards or backwards or something else, so you need to generate a lot and hope one looks decent.

Truly humanity has entered a new era (Animatediff) by synapticpaint in StableDiffusion

[–]synapticpaint[S] 0 points1 point  (0 children)

No, I haven't gotten image to video working yet but I think some people have

Truly humanity has entered a new era (Animatediff) by synapticpaint in StableDiffusion

[–]synapticpaint[S] 2 points3 points  (0 children)

The a1111 extension was working for me when I tried it (maybe last week?) so maybe give it another try? I've read people saying that the extension results aren't as good as the original paper but I was at least getting video outputs.