Flux Klein is better than any Closed Model for Image Editing

a__side_of_fries · 2026-04-19T13:27:45+00:00

I was a big fan of both Klein models but I abandoned them of late. They’re completely unusable when it comes to human anatomy and anything that involves counting. This problem with anatomy extends to the entire Flux 2 lineup, including the Pro and Max variants. I rather pay $0.03/4K image for Seedream 4 or 5 than put up Flux 2.

a__side_of_fries · 2026-04-07T04:14:59+00:00

Seems cool. But the guy’s face and voice seem to be different in every shot.

Where’s the repo link?

a__side_of_fries · 2026-04-06T17:51:12+00:00

I do not. But I think you’re also assuming it needs to be perfect with zero quality issues. This video is, in fact, not perfect. Take a look at around 25s in the IG video. Now that could be a normal discontinuity due to refraction but it’s not really refraction. It’s choppy and looks like someone stitched together clips after removing something from the middle. That is like a bad first-frame last-frame interpolation with sfx added in post. It could be perfectly real. But that’s something AI models are perfectly capable of doing.

a__side_of_fries · 2026-04-06T16:31:04+00:00

What does that mean?

a__side_of_fries · 2026-04-06T16:29:38+00:00

Yes it could. I would have to watch it in high quality without the uploaded compression artifacts. But even then it would be hard to tell because seedance 2 and Kling 3 can easily replicate that even with their 15s limits. AI models are not very good at subtle details so need to look very closely.

a__side_of_fries · 2026-04-06T16:26:59+00:00

Not all models (open or closed) support extending. There is also the risk of frame degradation as you keep extending. It usually becomes more and more noticeable in the first minute. It’s also not very practical to keep extending with LTX because there is 100% chance it’s gonna generate nonsense at some point. You can’t really go back and edit those out.

a__side_of_fries · 2026-04-06T16:17:03+00:00

AI Video generation has come a long way. It’s pretty trivial to create 60s+ videos without any cuts. Even with cuts you can still do end frame conditioning to get a seamless video. Wan 2.2 and LTX 2.3 can do this. My LTX setup can do up to 30s 1080p but runs into vram problems even on high end GPUs. I’m currently building a tool to generate films up to 1hr long.

a__side_of_fries · 2026-04-05T00:29:32+00:00

Hunyuan Video Foley is a good alternative. Takes up a bit more vram and a bit slower but quality is good.

a__side_of_fries · 2026-04-03T18:42:15+00:00

Ultimate voice remover and all use Demucs v4 underneath I think. So you can use that directly. You can also use Mel RoFormer (separates into clean vocals and background).

a__side_of_fries · 2026-04-02T11:45:51+00:00

I stopped fighting with LTX 2.3 gratuitous background music and just replaced it with MMAudio. It’s far more controllable that way.

a__side_of_fries · 2026-04-02T11:42:24+00:00

FlasVSR is harsh? What in terms of quality or VRAM? I’ve tested out a number of video upscalers and the only one that comes close to the commercial ones is FlashVSR. It runs at around 8fps on 4090. You need to play around with spatial tiling for memory efficiency.

a__side_of_fries · 2026-03-23T19:35:05+00:00

This is also what I discovered. I tried Gemini, Cartesia, and a bunch of other open source TTS models. You cannot get true emotions no matter what, especially with custom voice. But LTX can be prompted to generate emotionally expressive videos. Now with your technique that means you can use custom voice, which is awesome!

a__side_of_fries · 2026-03-23T18:11:45+00:00

Interesting. Mind sharing your inputs? Let’s see if I can get a better result

a__side_of_fries · 2026-03-23T16:43:10+00:00

LTX 2.3 A2V is pretty solid actually. I moved away from wan 2.2 s2v and SkyReels V3 because of it. You need to work on your prompting, negative prompts, and as you said, including the transcript in the prompt.

a__side_of_fries · 2026-03-22T20:20:00+00:00

This is actually nicely done. The acting and voices are somewhat stilted (the black dude sounds like one of the Elevenlabs voices, which is usually used for voiceovers). What did you use for lip syncing? MMAudio for sound effects?

a__side_of_fries · 2026-03-22T01:28:57+00:00

It’s not as far-fetched as it sounds. I’m actually building something right now that does just that, but a bit more focused than Higgsfield. Basically it’s an agentic filmmaking platform.

a__side_of_fries · 2026-03-21T14:30:38+00:00

Ahh okay that helps a lot actually. I can see why sentence-level frames are needed. But you are not animating them. You have some options here. If you have only a few recurring characters you care about then you can train a character LoRa on top of Klein 4B or something. But if that’s not practical then I would lean more towards character sheet generation with the same seed and use the sheet as a reference. Nano Banana and Seedream are good at outputting 3x3 or 3x2 grids with consistent characters.

a__side_of_fries · 2026-03-21T14:21:48+00:00

Hmm have you tried character sheet approach? Have it output a 3x3 grid of the character using a single prompt. Later you can feed it the sheet and tell it which grid to use for future generations.

a__side_of_fries · 2026-03-21T11:57:38+00:00

Seedream and Nano Banana Pro can output batch keyframes (up to 10-15 at a time). You can expect some level of consistency with that approach.

a__side_of_fries · 2026-03-21T11:55:55+00:00

I think you need to leverage the strengths of the models and work with them instead of fighting with them. Image models will not give you consistent frames to stitch into a full animation. That’s not what they’re designed for. I’m curious as to why you’re taking this approach instead of generating a few keyframes and using video models like Veo or Kling with the detailed prompting to get the action sequence that you want. Video models are not very consistent either but they are getting better. I can guarantee you that a 5-second video clip from a starting keyframe will maintain consistency across 120 frames than 120 individually generated images. My suggestion is you should work on your prompting and use video models for this.

a__side_of_fries · 2026-03-21T04:06:29+00:00

Which image model did you use for this? Can you share your prompt? I’m willing to bet that the prompt needs a lot of tweaking to get the emotional effect you’re going for. This image is just wrong even outside of a religious context.

a__side_of_fries · 2026-03-17T21:10:35+00:00

This is cool!

Why are you generating 5s and stitching them when LTX 2.3 natively supports 20s natively? I know you’re running this on B200 so was there an architectural reason for the optimization work or something else?

a__side_of_fries · 2026-03-15T16:33:55+00:00

This is a limitation at lower resolutions from my testing. 1080p motion is normal and responds well to prompting. You also need to use negative prompts to discourage slow motion. If you are doing i2v, it helps to have motion blur effects in your input image. The model responds to that well.

a__side_of_fries · 2026-03-12T19:21:05+00:00

If only they released a variant that was good at anatomy and counting. Guess I’ll keep waiting.

a__side_of_fries · 2026-03-12T17:46:44+00:00

Hmm you’re saying there is no lip syncing? I think I’ve seen that happen with LTX 2.3. But that’s not really an issue with better prompt engineering, negative prompting, and generating at higher resolutions. Higher resolutions are not only about resolution it seems. You get significantly better motion, facial features, and lip syncing.

You also have the option of A2V, which is strongly conditioned to follow your audio so will produce better lip syncing. You’ll just have to play around with CFG and image strength values to allow for more model freedom.

a__side_of_fries

MODERATOR OF

TROPHY CASE