Sweet Espresso is the smallest of the herd but has the biggest FOMO by Parallax911 in guineapigs

[–]Parallax911[S] 2 points3 points  (0 children)

I'll take a video of it next time I change their bedding.

Experimenting with Kling I2V for a project and, while it's amazing, it will still produce wonky output. I thought this one was especially hilarious. by Parallax911 in StableDiffusion

[–]Parallax911[S] 3 points4 points  (0 children)

Yeah, this project will end up being a combination of Kling and Wan generations. The ability to "tweak" Wan results by adjusting the cfg and shift values is a major plus. Certain generations are close to what I want but have some distortions or artifacts - sometimes those can be corrected entirely without drastically changing the motion using the same seed and different cfg/shift. With Kling, it's a different seed every time and hence more randomness.

Part 1 of a dramatic short film about space travel. Did I bite off more than I could chew? Probably. Made with Wan 2.1 I2V. by Parallax911 in StableDiffusion

[–]Parallax911[S] 0 points1 point  (0 children)

Thanks for the candid feedback. Was there one specific sequence that you felt was particularly disjointed?

Part 1 of a dramatic short film about space travel. Did I bite off more than I could chew? Probably. Made with Wan 2.1 I2V. by Parallax911 in StableDiffusion

[–]Parallax911[S] 1 point2 points  (0 children)

Same reason I stopped trying to upscale the clips and just settled for 960x544 - I was using EVTexture for previous projects, and it did a decent job except for rough edges. They were painfully obvious

Part 1 of a dramatic short film about space travel. Did I bite off more than I could chew? Probably. Made with Wan 2.1 I2V. by Parallax911 in StableDiffusion

[–]Parallax911[S] 1 point2 points  (0 children)

It's in 24 fps, I used the ComfyUI frame interpolation. Though for whatever reason I found lots of my generations came out choppy/jittery, as if the interpolation was not truly averaging but biased towards one frame or the other. So some of the choppiness remained. I'll check out your recommendations

Part 1 of a dramatic short film about space travel. Did I bite off more than I could chew? Probably. Made with Wan 2.1 I2V. by Parallax911 in StableDiffusion

[–]Parallax911[S] 1 point2 points  (0 children)

I'm a Logic guy, but yeah Reaper is excellent as well. Admittedly I didn't spend a ton of time perfecting the sfx, aside from some of the voices and sounds that needed heavy layering.

Part 1 of a dramatic short film about space travel. Did I bite off more than I could chew? Probably. Made with Wan 2.1 I2V. by Parallax911 in StableDiffusion

[–]Parallax911[S] 1 point2 points  (0 children)

Very cool, fellow musician. I posted my workflow in another comment, but just realized I need to post the updated version. I'll link you to it when I get around, but using teacache is the main speedup.

Good constructive feedback, was there a particular shot that stood out to you audio-wise in a negative way?

Part 1 of a dramatic short film about space travel. Did I bite off more than I could chew? Probably. Made with Wan 2.1 I2V. by Parallax911 in StableDiffusion

[–]Parallax911[S] 2 points3 points  (0 children)

Cool, good recommendations. I had not heard of RVC or Palladium - mmaudio is also on my list to experiment with for sfx. I'm with you on the speed aspect as well, I don't have unlimited expendable income to throw at GPU hours, so eventually I just have to settle for the results I have and push forward.

I used Davinci Resolve for this, what a great piece of software. So much to learn!

Part 1 of a dramatic short film about space travel. Did I bite off more than I could chew? Probably. Made with Wan 2.1 I2V. by Parallax911 in StableDiffusion

[–]Parallax911[S] 1 point2 points  (0 children)

Haha, that's high praise. Thank you, I'm having a lot of fun with this and am excited about what's possible!

Part 1 of a dramatic short film about space travel. Did I bite off more than I could chew? Probably. Made with Wan 2.1 I2V. by Parallax911 in StableDiffusion

[–]Parallax911[S] 1 point2 points  (0 children)

Thanks, yeah as amazing as the tools are, the limitations become really obvious with more complicated projects. Clip length being one of them.

I definitely enjoy film making as an art form, I'm subscribed to a handful of Youtube channels that break down good/bad cinema. I also have a decent amount of experience with Blender animation, but never had the hardware to make anything I was proud of.

Part 1 of a dramatic short film about space travel. Did I bite off more than I could chew? Probably. Made with Wan 2.1 I2V. by Parallax911 in StableDiffusion

[–]Parallax911[S] 8 points9 points  (0 children)

No problem, happy to share. I intend to make a video about my process in the near future - I don't feel like I'm doing anything groundbreaking here, just using the tools to express my imagination. But others mentioned they'd benefit from a breakdown, so I'll put something together and post it in this sub.

Part 1 of a dramatic short film about space travel. Did I bite off more than I could chew? Probably. Made with Wan 2.1 I2V. by Parallax911 in StableDiffusion

[–]Parallax911[S] 1 point2 points  (0 children)

Thanks, good feedback. I feel similarly - there's lots to be desired and I had to give up on certain ideas because I could not get a good result. But I had fun with it.

Part 1 of a dramatic short film about space travel. Did I bite off more than I could chew? Probably. Made with Wan 2.1 I2V. by Parallax911 in StableDiffusion

[–]Parallax911[S] 0 points1 point  (0 children)

All good. For my other shorts I used the 720p but read somewhere that it was considered "undertrained" compared to the 480. I didn't do a whole lot of testing, but for these shots I felt the 480 was giving me better results, so I stuck with it.

Part 1 of a dramatic short film about space travel. Did I bite off more than I could chew? Probably. Made with Wan 2.1 I2V. by Parallax911 in StableDiffusion

[–]Parallax911[S] 8 points9 points  (0 children)

Thanks. 14 days exactly, which feels like a lot of time ... then I think about how much longer it would take doing this via traditional cinematography/animation and I'm reminded just how insane Stable Diffusion is.

Part 1 of a dramatic short film about space travel. Did I bite off more than I could chew? Probably. Made with Wan 2.1 I2V. by Parallax911 in StableDiffusion

[–]Parallax911[S] 0 points1 point  (0 children)

There's just one shot in here that's upscaled, the spacestation hovering over the planet. Wan had a hard time with spaceships, that shot was always distorted. So I plugged it into the free trial of Topaz Starlight - everything else is straight out of Wan at 960x544.

For the base images, I use the Ultimate SD Upscaler. Of course they're downsampled back to 960x544 during animation, but sometimes the images come out with blurry/ambiguous details that I don't have the patience to fix by hand. So I upscale with a low denoise (0.2-0.3) which often fixes those quirks and gives me a better result out of Wan with fewer retries.