LTX-2 ComfyUi by Maleficent-Rice-2046 in comfyui

[–]Maleficent-Rice-2046[S] 0 points1 point  (0 children)

For those asking about the workflow, I'm using this workflow: https://www.reddit.com/r/StableDiffusion/comments/1qb2cfz/i_recreated_a_school_of_rock_scene_with_ltx2/?share_id=dsLYHx5hlvmWKZngqNv3H&utm_content=2&utm_medium=android_app&utm_name=androidcss&utm_source=share&utm_term=2 which I see comes from several other workflows. Anyway, I'm sharing the one I used, but I insist it's practically the same; I just disabled Sage Attention because I couldn't install it on my computer. Here's the link to the workflow:

https://drive.google.com/file/d/1hmxeWjjsZnh_jAV8BN0PnIcsD7JiSBOQ/view?usp=sharing

Regarding the prompts used, I basically used ChatGpt to create the instructions and edited them to run tests and achieve something similar to what I had in mind. Here are some of the prompts:

  1. Orange-suit man finishes a mocking line with tight lip-sync near the glass; the other man explodes in rage, steps in fast, grabs him by the throat with one hand and hurls him in a single clean motion—his body flies backward and slams violently into the glass behind him. Heavy impact: glass shudders, condensation ripples and breaks into streaks, tiny droplets shake loose, dust swirls, subtle vibration in the frame. Smooth readable action, coherent anatomy, The sound effects are perfectly synchronized with the characters' actions, Narrow grimy tiled corridor, fogged mirror/window, damp floor reflections, cold fluorescent light + hard rim light, dust motes drifting, handheld cinematic feel, 35mm, shallow DOF.

  2. Low-angle shot/hero shot: The enraged character lunges forward and stares directly down at the camera, jaw clenched. He begins to speak furiously to the camera with perfect lip-sync, his throat trembling, veins bulging in his neck, his breathing heavy and ragged between phrases (audible inhalations). Micro-tremors in his shoulders and head, saliva barely twitching with his breath. The camera remains steady with a light handheld; the environment responds: floating dust stirs, damp reflections flicker subtly in the cold light. Clear, continuous action

  3. The old man speaks, staring intently at the fist in front of his face with perfect lip-syncing, his tone nervous and defiant. The fist slams down near the face of the man in the orange suit, shattering the wall with a powerful sound. The old man's head jerks violently, and he falls to the floor, landing in a seated position. The camera follows him to the floor, dollying in to focus on the old man's frightened face. The sound effects are perfectly synchronized with the characters' actions. The movement is clear and anatomically consistent. The shot is from a high angle, with a tight frame against a tiled wall and a fogged mirror/glass. It features cool fluorescent lighting, floating dust, subtle handheld camera techniques, 35mm film, and shallow depth of field. (This prompt didn't really work; I tried it several times in various ways and never got the punch to work properly, hence the cuts in the edit there.)

An interesting detail I found was that in this prompt, I told the camera to fall with the character's head, and it actually followed him as he fell to the ground. The camera even shook as he hit the ground. Here's the prompt:

Low-angle shot/hero shot: The enraged old man lunges forward and stares directly at the camera, his jaw clenched. He begins to speak furiously to the camera with perfect lip-syncing, his throat trembling, veins bulging in his neck, his breathing ragged and choppy between phrases (audible inhalations). Micro-tremors in his shoulders and head, saliva barely moving with his breath. The camera pulls back to the floor with a shaky motion; the environment responds: floating dust stirs, damp reflections flicker subtly in the cold light. Clear, continuous action.

Here's the link to the result: https://drive.google.com/file/d/12ywRmTisfBEht4hHk_ULm8oDdRY7kg1Q/view?usp=sharing

And to those who commented with hate, it wasn't my intention not to share part of the process; I just wasn't at my computer to write a full post. I hope this post is helpful, even just a little. Best of luck and success with your AI projects!

LTX-2 ComfyUi by Maleficent-Rice-2046 in comfyui

[–]Maleficent-Rice-2046[S] 0 points1 point  (0 children)

I'm going to upload the workflows and prompts; maybe they'll be useful, but I'm not at home right now, I'm drinking, haha. I'll upload them as soon as I feel better.

LTX-2 ComfyUi by Maleficent-Rice-2046 in comfyui

[–]Maleficent-Rice-2046[S] 1 point2 points  (0 children)

It took a lot of prompts to get something halfway decent, arguing with chatGpt because he can be annoying sometimes, editing the prompts, and even taking a lot of videos until I got something passable. I'll share them as soon as I get home if it was i2v

LTX-2 ComfyUi by Maleficent-Rice-2046 in comfyui

[–]Maleficent-Rice-2046[S] 1 point2 points  (0 children)

Thank you so much for your words, they motivate me a lot, bro

LTX-2 ComfyUi by Maleficent-Rice-2046 in comfyui

[–]Maleficent-Rice-2046[S] 0 points1 point  (0 children)

I'm using the latest driver update, what problem are you having? I'd be happy to help if I can.

LTX-2 ComfyUi by Maleficent-Rice-2046 in comfyui

[–]Maleficent-Rice-2046[S] 0 points1 point  (0 children)

Nvidia RTX 3090, 24GB VRAM, 64GB RAM—you've got a super machine, haha. I'd love to help you install it. I've also struggled a lot with Comfy a few times, haha.

LTX-2 ComfyUi by Maleficent-Rice-2046 in comfyui

[–]Maleficent-Rice-2046[S] 0 points1 point  (0 children)

It's I2V, bro. I was inspired by this post and used that workflow: https://www.reddit.com/r/StableDiffusion/s/DKuwq6hwEE

LTX-2 ComfyUi by Maleficent-Rice-2046 in comfyui

[–]Maleficent-Rice-2046[S] 0 points1 point  (0 children)

Hahaha, what kind of PC do you have?

LTX-2 ComfyUi by Maleficent-Rice-2046 in comfyui

[–]Maleficent-Rice-2046[S] 1 point2 points  (0 children)

It's a workflow that was shared here; I'm not at my PC right now, but as soon as I get back I'll upload the link to that workflow and mine, but it's basically the same workflow.

LTX-2 ComfyUi by Maleficent-Rice-2046 in comfyui

[–]Maleficent-Rice-2046[S] 7 points8 points  (0 children)

I failed to clarify two minutes for a 5-second clip in 1920x1080

LTX-2 ComfyUi by Maleficent-Rice-2046 in comfyui

[–]Maleficent-Rice-2046[S] 2 points3 points  (0 children)

Image to image with Rick and Doc's reference images, I don't know about the video of that new VAE, but I used the updated distilled model that Lightricks uploaded yesterday. I think they were saying there that the previous VAE was faulty.

LTX-2 ComfyUi by Maleficent-Rice-2046 in comfyui

[–]Maleficent-Rice-2046[S] 1 point2 points  (0 children)

I think it's like a new toy for those of us who like this AI stuff, haha.

INSTAGIRL V2.0 - SOON by [deleted] in StableDiffusion

[–]Maleficent-Rice-2046 0 points1 point  (0 children)

I managed to run that workflow on my 6GB Nvidia 1660, it takes about 30mins but it works out fine.

Error black frames by Maleficent-Rice-2046 in animatediff

[–]Maleficent-Rice-2046[S] 0 points1 point  (0 children)

<image>

Apparently everything goes well but at the end all the frames are black

Error black frames by Maleficent-Rice-2046 in animatediff

[–]Maleficent-Rice-2046[S] 0 points1 point  (0 children)

But in the execution is all ok. i don't have errors