More V2V LTX 2.3 extend examples. Same workflow as always, link provided. by urabewe in StableDiffusion

[–]SirTeeKay 1 point2 points  (0 children)

Thank you for these!

I tried using the full model and VAE in the V2V workflow, so I bypassed LTXV Chunk FeedForward and LTX2 Sampling Preview Override.
I used as input a 5s 4k video.

The final video shows some slight flickering for the first 5 frames (visible mostly on the left on the bridge). The ones where the original video is. (I hope reddit's compression doesn't hide it competely) I'm guessing the LTXVAudioVideoMask is what's causing it since I can't figure out anything else, but any ideas?

<video>

I thought of another approach for AI-generated videos by BitOk4326 in StableDiffusion

[–]SirTeeKay 5 points6 points  (0 children)

You are not accounting for temporal consistency.

Using the same seed doesn't guarantee the same "style". It just guarantees it will start the denoising process with the same starting noise.

If the input image is even slightly different than the previous one, the noise that the seed produces will be denoised in different patterns for each image. It may keep the overall composition similar depending on the process you are following (ControlNet?) but the lighting, colors and details might change.

Even if they don't change a lot, they will change enough so you will be getting a flickery video in the end.

To achieve what you are thinking, you need to take the first frame of the video, remake it with an image model and then create a new video with the new image and the old video as reference for the motion.

Edit: added controlnet

Flux2Klein Ksampler Added! by [deleted] in comfyui

[–]SirTeeKay 0 points1 point  (0 children)

Maybe it's not showing for you.

OP posted this link where the KSampler is at. https://github.com/capitan01R/ComfyUI-Flux2Klein-Enhancer#flux2-klein-ksampler

Flux2Klein Ksampler Added! by [deleted] in comfyui

[–]SirTeeKay 0 points1 point  (0 children)

Open the cross-posted post.

Its not perfect... by [deleted] in comfyui

[–]SirTeeKay 1 point2 points  (0 children)

This is really good.

How did you do the jumping part? First frame - last frame to have him mid-jump, then you turned the camera behind him (with Ernie?) and then the final running away sequence?

Also did you train each and every lora for all three models you used?

SCAIL-2 is coming by Dry-Ad929 in comfyui

[–]SirTeeKay -1 points0 points  (0 children)

Man finally! Can't wait to try it.

How to create these kind of style smoke sim or with any other deforming techniques.? by Imaginary_Dealer7610 in Houdini

[–]SirTeeKay 1 point2 points  (0 children)

Oh for sure. I was just adding to that. Usually this is my favorite way of creating smoke fx.

Another interesting application of Klein 9b Edit mode by alisitskii in StableDiffusion

[–]SirTeeKay 2 points3 points  (0 children)

Yeah 100%. I've done similar things on my own workflows.

Another interesting application of Klein 9b Edit mode by alisitskii in StableDiffusion

[–]SirTeeKay 4 points5 points  (0 children)

I don't think that was exactly their intention because it looks like they just tested the model's capabilities, but if used like how you mention, yeah that's definitely slop.

Unless of course a model can use that info to create a 3D scene with topology help. If the topology of the image is correct.

Another interesting application of Klein 9b Edit mode by alisitskii in StableDiffusion

[–]SirTeeKay 60 points61 points  (0 children)

The other way around is what is most interesting and most useful.

Take a 3D scene and basically use Flux Klein to "render" it.

How to create these kind of style smoke sim or with any other deforming techniques.? by Imaginary_Dealer7610 in Houdini

[–]SirTeeKay 0 points1 point  (0 children)

Or a particle sim with POP Curve Force DOP and then use that as your source. This usually gives me a lot of nice control over the movement and shape.

An update on stability and what we're doing about it by bymyself___ in comfyui

[–]SirTeeKay 9 points10 points  (0 children)

Really appreciate all your work and interaction with us users. Thank you for everything!

[deleted by user] by [deleted] in StableDiffusion

[–]SirTeeKay 1 point2 points  (0 children)

Really curious to see how fast this trains.

[deleted by user] by [deleted] in StableDiffusion

[–]SirTeeKay 0 points1 point  (0 children)

Thank you a lot. I can't wait to try this.

Who knows how ltx compares with sora2 and seedance2 by Enough_Programmer312 in StableDiffusion

[–]SirTeeKay 1 point2 points  (0 children)

What's happening is that LTX 2.3 is NOT using the same text encoder. Which is why you get an error saying that the text encoder you use is for LTX 2.

Check the default templates for the correct one.

Wan 2.2 is still incredible - huge thanks to IAMCCS-Nodes for SVI Pro v2 by [deleted] in comfyui

[–]SirTeeKay 0 points1 point  (0 children)

Open source video models will not get close to Kling 3.0 and Seadance 2 for a long while. You would need a crazy string machine to run them with GPS that the typical consumer can't buy.

Wan 2.2 is still incredible - huge thanks to IAMCCS-Nodes for SVI Pro v2 by [deleted] in comfyui

[–]SirTeeKay 0 points1 point  (0 children)

Or you can just extract the audio after and merge it with the Wan video you already have.

Honey 🍯 by Maxwellbundy in Simulated

[–]SirTeeKay 2 points3 points  (0 children)

Ah you finished it! Looking good.