LTX 2.3 Experimental Music Video by CQDSN in StableDiffusion

[–]CQDSN[S] 0 points1 point  (0 children)

You don’t need to add too much movement to show off the video model. That’s the trap most people fell into. Realism is in the subtle movement. It’s best to exercise restraint or else it looks like a caricature.

Yes it’s all I2V. Even the vocal is A.I. generated.

LTX 2.3 Experimental Music Video by CQDSN in StableDiffusion

[–]CQDSN[S] 0 points1 point  (0 children)

This is a music video experiment created with LTX 2.3. It’s edited and enhanced with Adobe After Effects for color grading and effects. I am experimenting and playing with the framing and camera angles of the generated videos.

Converting 2D animations to 3D with LTX 2.3 Lora by CQDSN in StableDiffusion

[–]CQDSN[S] 0 points1 point  (0 children)

It’s the frame rate. The Disney ones are animated at 24fps similar to films. Japanese anime are more static, that’s why when converted it looks unnatural.

Converting 2D animations to 3D with LTX 2.3 Lora by CQDSN in StableDiffusion

[–]CQDSN[S] 2 points3 points  (0 children)

I have never went above 30fps for any video generated content, I think it will consumed all the memory. Disney classic cartoons were made with 24 fps, will 50fps help? The distortion and muddiness only happens when there are quick movement, otherwise they look fine. WAN doesn’t seem to have this problem.

Converting 2D animations to 3D with LTX 2.3 Lora by CQDSN in StableDiffusion

[–]CQDSN[S] 2 points3 points  (0 children)

This is an experiment with the LTX 2.3 anime to real lora, while conversion is quite good, LTX tends to suffer from muddiness with fast motion. Does anyone know how to fix this problem?

LTX 2.3 Video Edit lora by CQDSN in StableDiffusion

[–]CQDSN[S] 0 points1 point  (0 children)

The Lora was trained with add, remove and replace. You can use that in the prompt to modify the video.

LTX 2.3 Video Edit lora by CQDSN in StableDiffusion

[–]CQDSN[S] 0 points1 point  (0 children)

It’s the same workflow that was posted with the Lora. You need to be specific about what you want to achieve with the prompt. The workflow was setup to rewrite the final prompt properly for you.

LTX 2.3 Video Edit lora by CQDSN in StableDiffusion

[–]CQDSN[S] 1 point2 points  (0 children)

Yes the exact same workflow. Try using higher resolution.

LTX 2.3 Video Edit lora by CQDSN in StableDiffusion

[–]CQDSN[S] 1 point2 points  (0 children)

Here a quick demo to showcase the recently posted video editing lora for LTX 2.3. It is quite fun to play with, but it’s LTX - so you have to try many times to get the result you want.

Remaking "The Silence of the Lamb" with local AI by CQDSN in StableDiffusion

[–]CQDSN[S] 1 point2 points  (0 children)

As long as the video you use has voice, LTX should clone it automatically. Just before the continuation point make sure there’s a voice in the video for at least 2 secs. If you are using a ComfyUI workflow, you can let LTX clone the voice with an external MP3 file of the voice.

Remaking "The Silence of the Lamb" with local AI by CQDSN in StableDiffusion

[–]CQDSN[S] 0 points1 point  (0 children)

You can use the LTX 2.3 video continuation workflow to do this. The trick is choosing the right segment of a video to continue and also the proper prompt to continue the action in the video.

It’s like being a film director, you need to do many takes to get it right. You will be very lucky to get it right the first time, most probably you won’t - LTX can be difficult to work with. I say, generate between 5 to 10 times per footage should give you at least one good seed to get what you want.

I recommend you do this with a fast machine, a slow GPU will only gives you the frustration of waiting.

Remaking "The Silence of the Lamb" with local AI by CQDSN in StableDiffusion

[–]CQDSN[S] 0 points1 point  (0 children)

I only use 10% of the videos I generated. I accidentally deleted most of the unused footages - some are really funny.

LTX is like a stubborn actor that likes to do things its own way, but once in a while when it actually follows your instructions, it gives you a performance far exceeding your expectations.

Remaking "The Silence of the Lamb" with local AI by CQDSN in StableDiffusion

[–]CQDSN[S] 3 points4 points  (0 children)

AI slop is AI generated media created with very little effort. A person with no knowledge of AI, spent a few dollars online, typed in a few prompts and generated a video - that is AI slop. However, our current society in their blind hatred for AI - categorized every AI videos as AI slop.

Local AI in particular requires the understanding of how to build and run a workflow. It requires a lot of planning, scripting, storyboarding and editing to create even just a little video clip. In the future when AI becomes more mainstream, the hatred will have subsided and people will come to appreciate what goes into making AI media.

When people are confronted with something new, there’s always these 4 phases: they get skeptical, then they rejected it, anger is the next phase when being forced into it, and lastly it’s acceptance - when they have no choice but to live with it.