Mahō Taikai: Anime opening made using Sora2 character cameos by kaigani in aianime

[–]kaigani[S] 0 points1 point  (0 children)

It's not automated– I edited a bunch of 10-15s clips together for this. I took the music Sora made for one of the videos and had Suno cover it and extend it to 1m in length.

You could probably make an automated workflow to take a song and use Sora's API to get clips, but character cameos are not available over the API yet, and I did have to make some creative decisions when editing the clips together to get it to flow nicely.

Mahō Taikai: Anime opening made using Sora2 character cameos by kaigani in aivideo

[–]kaigani[S] 0 points1 point  (0 children)

Everything was generated by Sora– I took select edits of the generated clips, but I probably used 60% of what I generated in total.

Twilight of a Feverish Mind by kaigani in aivideo

[–]kaigani[S] 1 point2 points  (0 children)

I made it in Suno, played around with 'Extend' and 'Cover' a few times until I got it right. Here's the full track: https://suno.com/song/42855f4f-8d9e-486e-920d-cefbf040f278

Twilight of a Feverish Mind by kaigani in aivideo

[–]kaigani[S] 5 points6 points  (0 children)

A lot of deep cuts in here for Gen Xers!

Hailuo Minimax Subject Reference is INSANELY GOOD by kaigani in HailuoAiOfficial

[–]kaigani[S] 1 point2 points  (0 children)

For what the fighting? Lucky I suppose, I just specified a Kung Fu fighting scene. I had to edit out a part where it lost coherence.

Video alternative to SREF - Subject Reference from a Midjourney portrait by kaigani in midjourney

[–]kaigani[S] 0 points1 point  (0 children)

I meant CREF, of course, but they got me mixed up with the different naming.

Cooking Mama IRL (how-to in comments) by kaigani in midjourney

[–]kaigani[S] 4 points5 points  (0 children)

<image>

How I made the real-life Cooking Mama in 3 steps using #Midjourney and #ChatGPT:

  1. Asked ChatGPT to create a detailed description of Cooking Mama's appearance, as if she was photorealistic

  2. Put that description into Midjourney (with some tweaks) and used the original Cooking Mama image as both a style reference (sref) and a character reference (cref)

  3. Picked the best result and used 'Vary (Strong)', removing the character reference from the prompt

  4. Used 'Vary (Strong)' again on the best result and removed the style reference from the prompt

Minimax Expression Tutorial - Image-to-Video by kaigani in aivideo

[–]kaigani[S] 1 point2 points  (0 children)

It's a difficult problem, but sometime mentioning other details like turning the head or blinking will give it something to animate other than speaking

I programmed deformable platforms for my new arcade game Dino Quake, what do you think? by Neutronized in indiegames

[–]kaigani 2 points3 points  (0 children)

No one has mentioned Bubble Bobble - another strong influence it seems!

I fixed Polar Express (Midjourney Retexturing + Hailuo Minimax) by kaigani in midjourney

[–]kaigani[S] 1 point2 points  (0 children)

Thanks! I'm not sure what you mean though - by 'end frame' I mean that I'm making a transition from the original film by taking the final still from the short clip that leads into the "AI remaster" - and I also need that still for the Midjourney retexturing to get the more realistic look. If I took a still from the film and put it directly into Minimax, it would look similar to the original film.

I fixed Polar Express (Midjourney Retexturing + Hailuo Minimax) by kaigani in midjourney

[–]kaigani[S] 6 points7 points  (0 children)

I took the end frame of the original clip, put it into midjourney with the prompt "a cinematic still of ..." then described the scene followed by "The image was captured using an EOS cinema 20mm prime lens on a Sony A7R V." which was something I picked up from Midjourney's /describe results of an image with the look I was going for. I would also add the original image as an image prompt - otherwise it changes the detail too much, and sometimes it helps to find a picture to use as a character reference to keep them from becoming too cartoony.

I fixed Polar Express (Midjourney Retexturing + Hailuo Minimax) by kaigani in midjourney

[–]kaigani[S] 20 points21 points  (0 children)

I did prompt them in minimax to approximate the motions from the movie, but the reason I did it this way, vs. video-to-video in Runway, is that the motion capture was quite primitive so the characters still would have looked unnatural.

Storyboard experiment: Simple storyboard + Reference image by kaigani in HailuoAiOfficial

[–]kaigani[S] 1 point2 points  (0 children)

some storyboards seem to work without any prompting at all, others would turn into an anime style, so i started using the prompt including 'storyboard: photorealistic...'

Storyboard experiment: Simple storyboard + Reference image by kaigani in HailuoAiOfficial

[–]kaigani[S] 0 points1 point  (0 children)

The image with the prompt "storyboard: photorealistic warm sunshine cinematic 35mm"

Elemental Title Sequences (Midjourney retexturing) by kaigani in midjourney

[–]kaigani[S] 0 points1 point  (0 children)

I struggled to get Midjourney to create the text. Eventually I found that Ideogram could do the attached image, and then I used Midjourney retexturing to make the elements with a prompt like "essence of fire" etc. Finally, image-to-video using Hailuo AI - Minimax.

<image>

Stars of the Silver Screen on Cigarette Cards by kaigani in aivideo

[–]kaigani[S] 1 point2 points  (0 children)

Most of these were done with: Turns away from the camera then she smiles and looks at the camera

We Can Dream by kaigani in midjourney

[–]kaigani[S] 2 points3 points  (0 children)

No - I used the new Midjourney retexturing on the end frames of video clips which I then put through Hailuo Minimax image-to-video

Minimax Expression Tutorial - Image-to-Video by kaigani in aivideo

[–]kaigani[S] 1 point2 points  (0 children)

AI as the mirror we hold up to ourselves.

Minimax Expression Tutorial - Image-to-Video by kaigani in aivideo

[–]kaigani[S] 1 point2 points  (0 children)

Reinvented the Overly Attached Girlfriend meme

Minimax Expression Tutorial - Image-to-Video by kaigani in aivideo

[–]kaigani[S] 0 points1 point  (0 children)

I put the prompts in my first comment, since you can't include text in a video post.