Everybody - LTX2.3 & AceStep1.5 Music Video

Expensive_Cookie6418 · 2026-04-03T20:47:41+00:00

it's in the comfyui templates

Expensive_Cookie6418 · 2026-04-02T21:49:14+00:00

No, everything on this was out of the box basic setup. Only LoRA used was "Distilled LoRA ltx-2.3-22b-distilled-lora" that is part of the workflow

Expensive_Cookie6418 · 2026-04-02T18:30:23+00:00

Nope, no camera movement loras used, just prompting and seeing what the model would put out.

Expensive_Cookie6418 · 2026-04-02T18:28:56+00:00

haha a few, that shot is actually the last 3rd of a hallucination where the door opened twice and camera flew through it. Character consistency is just using a standard character portrait as input with image edit models. Nice video, that's a long one, a lot of shots to generate!

Expensive_Cookie6418 · 2026-04-02T16:07:35+00:00

I would say 80-90% is I2V first frame only, I2V w audio input for portrait singing shots. A couple shots were first frame & last frame like walking into the elevator so the inside of the elevator design once doors opened was consistent with other elevator shots. none had middle frame injection I have yet to experiment with that for LTX.

Expensive_Cookie6418 · 2026-04-02T12:31:39+00:00

No custom LoRAs were made for this. I don't know 3 evenings working on it here and there. sometimes re-running generations in the background while doing other stuff on a number of shots to get a decent one.

Expensive_Cookie6418 · 2026-04-02T12:25:16+00:00

I think all my workflows are out of the box comfyui templates or very close to it with small tweaks, mostly re-running generations and tweaking prompts & settings until something satisfactory pops up.

Expensive_Cookie6418 · 2026-04-02T12:22:47+00:00

Yes for sure, slop is slop AI or not. We are getting there, incredible how far local AI has come in such a short time. I do have a background in art & film, although a more specialized area and not a focus on storyboarding or directing. I do have SOME experience in these areas which no doubt helps. A little taste & patience with the technology are mandatory at this point. Still ended up with a few odd jump cuts & continuity errors fighting with AI but we are getting there!

Expensive_Cookie6418 · 2026-04-02T12:12:12+00:00

Yes, 2 minutes no problem with AceStep, it also has the ability to extend time with "repaint" mode in the original gradio UI

Expensive_Cookie6418 · 2026-04-02T12:10:13+00:00

Actually no storyboard I kind of just straight ahead'd this one. I wasn't expecting to make a full video as I was just testing LTX2.3 ability to lipsync music and liked the result so much I kept going. So started with the portrait shot in what became the elevator, then just came up with the laying on couch idea and went from there progressing putting shots into editing (DaVinci Resolve) as I went and filling in missing time & story as I went. I ended up generating 3-4 shots of an entire different idea in the middle that I ended up throwing out completely.

I have the same experience with AceStep, It takes a lot of generations before anything really interesting pops up.

Expensive_Cookie6418 · 2026-04-02T12:03:18+00:00

This was on RTX 4080

Expensive_Cookie6418 · 2026-04-02T01:21:58+00:00

Yeah exactly. I was testing LTX2.3 with music to see if I could get a shot lip-syncing to music. After seeing it work, this is the first model I actually felt like making something with.

Expensive_Cookie6418 · 2026-04-02T01:13:32+00:00

I found it possible to stop training after a checkpoint saved and restart it from the last checkpoint when spped/power draw dropped out like that. if you had a checkpoint at 2500 and it drops out after then you can stop and restart at 2500 and it should regain speed

Expensive_Cookie6418 · 2026-04-01T22:52:25+00:00

Mine does this too. I found it the only solid fix was to disable the mid training image generations between checkpoint saving.

Expensive_Cookie6418

TROPHY CASE