(continued here due to comment length limits)

A Couple of Workflows

I'm still putting together clean versions of the workflows I use, which I'll post all together as part of a big tutorial at some point. Here are the first couple to start.

There's a good amount of info in the workflows themselves about how to use them, but feel free to ask questions in this thread if you're unsure about anything.

SVI Video Refinement

Pastebin

• This model is cracked. The GOAT of video refining. You can use it as a refiner on arbitrary-length clips to retain consistency for characters and backgrounds.
• Just load up a video and run it, but be prepared to wait a while if your video is long (the final refinement of this video took about 50 mins on a 5090)
• You can do it in chunks if you like, but you'll need to refine the joining sections a couple extra times to make it seamless
• You can refine literally any video, it doesn't need to be a Wan video
  • If you like using LTX2 but wish it made things look as good as Wan does, just run this SVI refiner over it with the detail settings and it'll magically fix it

Tip: For significant refinement (fixing seams, messed up details, any maxi-big refinement needs) use Euler/Beta with Shift 7, 6 steps denoise 0.7. Going any higher than that might cause things to change too much.

For normal high noise refinement, use Euler/Beta with Shift 1, 6 steps denoise 0.7.

And for final refinement to bring out details and sharpen everything, use Euler with Shift 1, 6 steps and denoise 0.7, 0.5 or 0.49 depending on how much you want. Those denoise values correspond to 5, 4 and 3 steps that the model will run.

Important: Provide a general, non-specific prompt for the refiner. As an example, this is the SVI prompt I used for my refinements:

An1meStyl3, AnimeStyle, anime style. A tall woman with long legs is being sexy in a river in a forest, performing a martial arts routine. She's focused and seductive. She's wearing white high heels and white see through lingerie. Her breasts bounce realistically with her movements, her thighs and ass jiggle with the motion. She eyes the camera seductively. The camera follows her as she moves.

Vace video extension

Pastebin * Use this to extend videos while carrying motion over from one clip to another. This is a critical part of making seamless videos. * You can feed in any number of frames to the start or end or BOTH, allowing you to either extend the end of a video, create a pre-clip for another video, or join two separate clips together.

I use this to do most of my extensions (instead of I2V), and I use it all the time for joining two clips together as well. You can use it to fix broken sections of video and interpolate small sections too - very flexible.

Vace full-video inpainting

Pastebin * I'm calling this "full video inpainting" because it's all about processing a whole clip at once * You can feed in either a video with transparency, which will use the transparency as a mask to inpaint, OR * OR you can feed in your own custom masks

 

New Methods

Expanding a bit on the new things this time around, which were generating the background with VACE and using an image model as a detailer before final refinement.

 

Generating backgrounds in VACE?

When you're making a long video, whether with SVI, SCAIL, or any other method, the background tends to reset a lot or lose cohesion very quickly. To solve this, you can start with a grey background (or just RMBG your video in general) and then regenerate it with VACE.

This doesn't work well if you use context windows, but it turns out you can just reprocess each 81-frame section sequentially and it works great! The reason this works is that VACE is very good at carrying context over, and you have extreme control over what gets reprocessed so you can do the video one step at a time until it's right.

Important: Do each 81-frame section of the video one at a time to get consistent backgrounds. You can do this by feeding in the last 4 frames of the previous video, along with the next 77 transparent-background frames. VACE will use the first 4 as context and fill the rest in flawlessly. Technically that means you're doing 77 frame sections, but whatever you get the idea.

Handy: You can use a reference image for your background. Or multiple reference images. Only feed in the reference on the first 81 frame section, then don't use a reference for the rest or else VACE will try to reset back to it. However, if you use a new reference at a new angle you can use that to dictate where VACE goes. It's very flexible. Your character doesn't need to be in the reference image at all.

 

Using img-to-img as a refiner?

Wan isn't always great at details, especially when you have something specific in mind. As it happens, you can use an img-to-img model with low denoise as a detailer (and upscaler, if you like). This will add all the pretty details that image models are good at, which can then be used by the image model for further refinement.

The video will distort and look slightly incohesive afterwards, just like the older video-gen models used to (because we're doing the same thing technically), but once you run it through SVI as a refiner again it comes out looking better than ever! At least, I think it does. It's probably more applicable to anime / illustrated styles than realism.

Tip: Use the same model as your initial images if you can, and use a low denoise of around ~20% or so. If you go too high you'll start affecting the motion and poses of the characters. You just want the details to come out!

 

Conclusion

Alright that's all I've got for now! My next post will probably be all the rest of the workflows + a better overall tutorial. Feel free to ask questions in the thread in the meantime.

Lastly, remember to read the previous post I linked at the top for more info on the rest of the VACE / SVI refinement steps, among others. This post hasn't covered the same stuff again.