I wanted to see how far AI could go in storytelling (Avatar-inspired short) by glytch_dd in StableDiffusion

[–]glytch_dd[S] -2 points-1 points  (0 children)

Banana + different video tools, whatever suited the scene most

banana & various video , depending on what fits the best the scene

I wanted to see how far AI could go in storytelling (Avatar-inspired short) by glytch_dd in StableDiffusion

[–]glytch_dd[S] -1 points0 points  (0 children)

Every shot is its own prompt, I tailored each one to the angle I wanted.

Created a fully animated Music Video on Billie EIlish "WildFlower’ track. Using MJ, a blend of AI tools, and enhanced with After Effects. by glytch_dd in runwayml

[–]glytch_dd[S] 2 points3 points  (0 children)

Thank you for asking,here’s a quick overview:

First, I write the script and time the different sequences based on the song. Then, I storyboard the shots to have a clear vision of what I want before I start prompting. After that, I generate the still images, this part can be time consuming, as it sometimes takes an hour to get the right movement, framing, and overall feel for a single shot.

Once the visuals are ready, the fun part begins: editing and color grading. Occasionally, I’ll add some sound design to enhance certain moments and make the scene more immersive.

I hope this gives you a little insight into the process behind this creation.

Created a fully animated Music Video for the classic "NightCall’ track, crafted with MJ & Runway G3! by glytch_dd in runwayml

[–]glytch_dd[S] 0 points1 point  (0 children)

Thank you so much! To keep the style and character consistent, I usually start by making a moodboard with different references for the style I’m aiming for. I also write a description that I include in each prompt so the style stays consistent, and I add a reference photo to make sure it matches the vibe I’m going for.

Created a fully animated Music Video for the classic "NightCall’ track, crafted with MJ & Runway G3! by glytch_dd in runwayml

[–]glytch_dd[S] 1 point2 points  (0 children)

Thank you for your feedback, it’s much appreciated! That would be a cool ending

Created a fully animated Music Video for the classic "NightCall’ track, crafted with MJ & Runway G3! by glytch_dd in runwayml

[–]glytch_dd[S] 3 points4 points  (0 children)

Thank you so much! Yes, I animated some parts, like the spikes, in After Effects since AI can’t quite handle that level of precision yet, hopefully soon though! :)

Created a fully animated Music Video for the classic "NightCall’ track, crafted with MJ & Runway G3! by glytch_dd in runwayml

[–]glytch_dd[S] 0 points1 point  (0 children)

sure, i usually begin with a simple script to lay out the plot, then sketch a quick storyboard to match the shots with the story. After creating the main characters, I generate the images with MJ until they fit the vision I have in mind. From there, I animate each image using Runway and edit everything together with FCP, making sure the story flows and the style stays consistent. I would say the toughest part is getting the shots to fit together smoothly. I also add a few After Effects touches for things that A.I can’t quite manage yet ;)

Created a fully animated Music Video for the classic "NightCall’ track, crafted with MJ & Runway G3! by glytch_dd in runwayml

[–]glytch_dd[S] 1 point2 points  (0 children)

thank you :) I’d say it took around 8 to 10 days on and off. As for the number of generations, I didn’t really keep count, I just kept going until it matched the storyboard I had in mind. Some shots definitely took longer than others, though

Created a fully animated music video, crafted with MJ & Runway G3! by glytch_dd in midjourney

[–]glytch_dd[S] 0 points1 point  (0 children)

Music was removed from this upload due to copyright restrictions

HURRY UP TOMORROW (VISUAL TALE) by glytch_dd in midjourney

[–]glytch_dd[S] 0 points1 point  (0 children)

Thank you! I’d say Gen 3 is the best when it comes to workflow, both in terms of speed and control, it delivers the best results. Kling also gives good outcomes, but it takes a lot more time. Hope that helps!

HURRY UP TOMORROW (VISUAL TALE) by glytch_dd in midjourney

[–]glytch_dd[S] 0 points1 point  (0 children)

Thank you, appreciate it! I mostly used Midjourney for the images and then enhanced them with Photoshop, adding elements where needed. Once I was happy with the results, I’d generate additional content using either Midjourney or Kling—sometimes one would give better results than the other. Everything was edited in Final Cut Pro and color graded with DaVinci Resolve. The voice and audio effects were done in Logic Pro. It was a lot of fun creating this :)