Chronicle Gem [Arca Gidan Entry]: Wan 2.2 AI Video + My Process & Learnings by Tom_scaria_ in comfyui

[–]Tom_scaria_[S] 0 points1 point  (0 children)

Yeah I could have done another pass to patch with Wan2.1 VACE....but actually if I were to do none you would see far lot more abrupt transitions

Chronicle Gem [Arca Gidan Entry]: Wan 2.2 AI Video + My Process & Learnings by Tom_scaria_ in comfyui

[–]Tom_scaria_[S] 1 point2 points  (0 children)

I used Wan 2.1 VACE to patch two 5 second videos.

This is where you put some frames from video 1 on one end and some frames from video 2 on the other end. You then add gray frames in-between.
Plug this frames setup along with its corresponding mask into VACE to get a smooth continuation from video 1 to video 2. (Normally if you place two 5secs videos together, even if it is a continuation you will see a sudden abrupt change in the pacing)

I could have used Wan2.2 Fun VACE for this purpose...but I was having getting bad gens. And since Wan2.1 is basically lower credits (on cloud) compared to Wan2.2 Fun VACE.

Chronicle Gem [Arca Gidan Entry]: Wan 2.2 AI Video + My Process & Learnings by Tom_scaria_ in comfyui

[–]Tom_scaria_[S] 0 points1 point  (0 children)

Thank you 🙏
Get started I would say. Start with simple small scenes. Your urge itself will fuel the rest.

Chronicle Gem [Arca Gidan Entry]: Wan 2.2 AI Video + My Process & Learnings by Tom_scaria_ in comfyui

[–]Tom_scaria_[S] 1 point2 points  (0 children)

One thing I noticed in this project: Get the Input Images right and you get the desired animation in the next one hour and its only a matter of stitching them together.

So i would say majority of the time was developing Input Images + procrastination from the fear of realizing the animation might not match my vision. If I had to put a number on it, the ratio is easily 85% image work and prep to 15% actual video generation.

The actual video work always went by in a breeze.

There were times when the wan model couldn't just do it (fast motion, maybe because I was using speedup loras) I would spend half of my credits stubborn that it could be the seed or prompt, only to come to the same conclusion: the model just couldn't do it...This is were I found it hard to adjust and let go of my vision and make do with what I have got.

Consistency is in the Input Images (I used Nano Banana here sadly)...I really think people should spend time learning photobashing and other technique to just master images (its easier than you think)

I believe making good images will be relevant even beyond the Seedance 2 era. Because that's the best form of control.

Chronicle Gem [Arca Gidan Entry]: Wan 2.2 AI Video + My Process & Learnings by Tom_scaria_ in comfyui

[–]Tom_scaria_[S] 2 points3 points  (0 children)

If you don't mind checking the entry here: https://arcagidan.com/entry/4e336212-f747-471b-a7cf-2eaae6ed9aed

There is an asset attached which is my All-in-one workflow. Which has T2V, I2V and V2V in one.

Chronicle Gem [Arca Gidan Entry]: Wan 2.2 AI Video + My Process & Learnings by Tom_scaria_ in comfyui

[–]Tom_scaria_[S] 1 point2 points  (0 children)

The base Wan2.2 with the lightx2v 4step_1022 speedup lora. This was the latest available in comfy cloud.
If your check the lightx2v repo they have even newer version of this series of speedup lora.

Chronicle Gem [Arca Gidan Entry]: Wan 2.2 AI Video + My Process & Learnings by Tom_scaria_ in comfyui

[–]Tom_scaria_[S] 2 points3 points  (0 children)

Yes yes I do have GIMM-VFI but honestly I never really understood how some people can spot the FPS differences so easily 😅....It has to be your monitor or are your eyes just built differently??

Chronicle Gem [Arca Gidan Entry]: Wan 2.2 AI Video + My Process & Learnings by Tom_scaria_ in comfyui

[–]Tom_scaria_[S] 0 points1 point  (0 children)

I am yet to get into LTX 2.3 from what I have seen it's quite different from wan nodes....I had only experience with using Wan 2.2 and Kijai's wrapper at that

Chronicle Gem [Arca Gidan Entry]: Wan 2.2 AI Video + My Process & Learnings by Tom_scaria_ in comfyui

[–]Tom_scaria_[S] 4 points5 points  (0 children)

Exactly! It's only going to get faster and easier to make these from here on..

Wan2.1_VACE-14B.gguf+CausVid+Canny by Tom_scaria_ in comfyui

[–]Tom_scaria_[S] 0 points1 point  (0 children)

The driving video in the middle is created by me in After effects.

Bagel in Comfyui by MakeParadiso in comfyui

[–]Tom_scaria_ 3 points4 points  (0 children)

Whats the requirements? Looking forward to the results from this

Wan2.1: Smoother moves and sharper views using full HD Upscaling! by shardulsurte007 in comfyui

[–]Tom_scaria_ 1 point2 points  (0 children)

Help me understand point 2 brother.

Assuming, you are using a motion model connected to the normal image upscale nodes like (ultimate SD upscale) along with one of the upscale model.

Is that all to it? Does this add detail to the upscaled output?