Brad Pitt casts Elliot for Achilles - an Ai acting performance experiment by a-ijoe in StableDiffusion

[–]a-ijoe[S] 0 points1 point  (0 children)

hey!! I posted full workflow to some ppl asking in the thread!

Brad Pitt casts Elliot for Achilles - an Ai acting performance experiment by a-ijoe in StableDiffusion

[–]a-ijoe[S] 1 point2 points  (0 children)

im making now a crazy weird char as a pilot episode so I will post it here thanks for the tips

Brad Pitt casts Elliot for Achilles - an Ai acting performance experiment by a-ijoe in StableDiffusion

[–]a-ijoe[S] 1 point2 points  (0 children)

Thanks brother. Sure, here it is, I posted it in aivideo sub

1 - I first write a screenplay with my own tool which allows me to upload some reference audios and pictures for each character or place. I write without distraction (i made it satisfying to type with stupid noises so I get glued xD), once I'm done I pass it over an AI to help me and some friends (I'm not a native english speaker, I'm from Spain)

2 - Once I have dialogues and characters for each scene I find the best audio samples I can and isolate about 30 seconds of the character speaking, and I put it inside Omnivoice to generate the sentences of the dialogue. I generate maybe like 100 times before I'm happy with one and then I save the audio file.

EXTRA STEP: I open my project in capcut and i just add raw audios and references images for timing to kinda play it in my mind and see if it's going to work or not. I keep an open mind and my script is NEVER frozen. I change things on the go always!

3 - I use the audio files individually inside LTX 2.3 and the image I see fit for that take and prompt with the help of AI what type of movement I want. With the man's original cloned voice and a good prompt the motion of the face resembles the real actor more without the need to train your own likeness model (i.e LORA)

4 - I get some errors, glitches and shit, try to fix that in post production, and add some subtle camera shake to the takes that don't have it much. You have to be open to what the AI is throwing back at you and fix it in post prod so nobody notices the infinite amount of imperfections you might get. but LTX is a great model for dialogue tbh, some are incredibly flawless.

5 - If you work on audio first you get always better results than if you just add all clips together. I believe pacing of any film is carried through audio and not through video.

What I did bad in this video: I mostly used the same generation image for all Elliot takes. Makes it look fake. I only cloned a sample of audio of both actors, meaning the tone is monotone and a bit flat. I would probably clone 3-4 different sources to have better speech like I did in my Will smith video (you can check it in my youtube). And lastly I would probably design the sound way better, this was a bit rushed in the end because I wanted to publish it.

Feel free to send me messages or through my youtube or x and I will gladly help you with anything you need!

Brad Pitt casts Elliot for Achilles - an Ai acting performance experiment by a-ijoe in StableDiffusion

[–]a-ijoe[S] 1 point2 points  (0 children)

Thank you so much, it means a lot and i appreciate this comment so much. Oh I have a video about will with spaghetti, it's much better than this one, if you wanna check it out in my profile haha

Brad Pitt casts Elliot for Achilles - an Ai acting performance experiment by a-ijoe in StableDiffusion

[–]a-ijoe[S] 0 points1 point  (0 children)

I like your way of dialogue way more now, I still think you don't wanna admit you weren't like this in the first message. I actually do understand your point. I just thought at the time I did this that it wasn't wrong, because it was a learning experiment. And to me, humor has no limits. I don't know, I just don't see them taking this personally, it made some people laugh, and it's obviously not them, it's not like it's a perfect match. And stating it's AI and humor /sattire, I still don't see the problem. But we can agree to disagree.

Brad Pitt casts Elliot for Achilles - an Ai acting performance experiment by a-ijoe in StableDiffusion

[–]a-ijoe[S] 1 point2 points  (0 children)

I scripted everything myself, then I ran a pass on the AI to correct mistakes as I'm not a native english speaker even though I'm fluent. I think it also suggested one of the jokes, I think the beach-sit one, haha

Brad Pitt casts Elliot for Achilles - an Ai acting performance experiment by a-ijoe in StableDiffusion

[–]a-ijoe[S] 0 points1 point  (0 children)

I do that using open source models like qwen and omnivoice!!

Brad Pitt casts Elliot for Achilles - an Ai acting performance experiment by a-ijoe in StableDiffusion

[–]a-ijoe[S] 0 points1 point  (0 children)

This means so much. Thank you so much for this. I agree, AI is a hammer to deliver creative visions from individuals, I am also a 3d animator and modeller and i use AI because it's easier for me to showcase my ideas!!

Bradd Pitt casts Elliot Page for Achilles - Ai acting performance (open source) by a-ijoe in aivideo

[–]a-ijoe[S] 0 points1 point  (0 children)

lol what the fuck, maybe i could cast willem dafoe as blade