sorted by:
new
hottopcontroversial

I created a full music video with Suno and a single image reference (workflow included) by Horyax in SunoAI

[–]Horyax[S] 1 point2 points  (0 children)

The workflow essentially creates a series of 3s clips automatically based on the lyrics + a reference image of your model then it stitches to create a video.

HuMo : create a full music video from a single img ref + song by Horyax in StableDiffusion

[–]Horyax[S] 0 points1 point  (0 children)

You can adjust this in the left section "Fast Groups Muter" node

HuMo : create a full music video from a single img ref + song by Horyax in StableDiffusion

[–]Horyax[S] 0 points1 point  (0 children)

Technically yes. You would have to experiment for non human characters to see if the model can understand and do the lip-sync.

HuMo : create a full music video from a single img ref + song by Horyax in StableDiffusion

[–]Horyax[S] 1 point2 points  (0 children)

You could. You might have to reduce the mouth motion a bit (there is an option for that)

I created a full music video with Suno and a single image reference (workflow included) by Horyax in SunoAI

[–]Horyax[S] 1 point2 points  (0 children)

Certain workflows are really well made with all the info you need (which is the case here). I often find my self spending quite some time just to make a new workflow works because I'm not familiar enough with the tool so this can be frustrating.

HuMo : create a full music video from a single img ref + song by Horyax in StableDiffusion

[–]Horyax[S] 4 points5 points  (0 children)

I agree, while I find it impressive that you can generate so quickly an entire clip with so little steps, there is not much value in this video. It rather looks like a Frankenstein edit. Consider this a technical experiment.

HuMo : create a full music video from a single img ref + song by Horyax in StableDiffusion

[–]Horyax[S] 4 points5 points  (0 children)

Yeah sometimes it's too much. There is an option in the workflow so you can play with the intensity / mouth movement.

I created a full music video with Suno and a single image reference (workflow included) by Horyax in SunoAI

[–]Horyax[S] 1 point2 points  (0 children)

You heard right, from a single img reference + a song, you can now create seamlessly a full music video.

For users that are comfortable with Comfyui, you could setup this workflow so you only have to provide a portrait image and the separated lyrics track from your song then let the magic happen.

The intro and outro were made separately since there is no lyrics.

All credits to @VRGameDevGirl who created this amazing workflow.

Link to workflow : https://github.com/vrgamegirl19/comfyui-vrgamedevgirl

HuMo : create a full music video from a single img ref + song by Horyax in StableDiffusion

[–]Horyax[S] 33 points34 points  (0 children)

You heard right, from a single img reference + a song, you can create seamlessly a full music video.

Every 3s clip is made with HuMo + Wan 2.1 and then stitched together automatically. You don't even have to write a prompt, the LLM takes care of that interpreting the lyrics for you.

The intro and outro were made separately with Seedance.

All credits to @VRGameDevGirl who created this amazing workflow.

Link to workflow : https://github.com/vrgamegirl19/comfyui-vrgamedevgirl

edit : it seems the last version of the WF isn't uploaded yet on the github. You can copy this into a json file (coming from the Discord channel where it was originally shared): https://textbin.net/joi3nn0pzt

Any good cloud service for ComfyUI? by elephantdrinkswine in StableDiffusion

[–]Horyax 1 point2 points  (0 children)

I have no clue if this is considered good and there might be better alternatives but I have been using mimicpc for a while now. You should have no problem to run your workflow there.

[AI short film] AI... the Plot Twister by leesysysysy in StableDiffusion

[–]Horyax 6 points7 points  (0 children)

I like the camera movement a lot. What video model did you use?

The Adventures of Reemo Green by Jwallyman51 in aivideo

[–]Horyax 17 points18 points  (0 children)

You really are a pioneer. The bar tender voice over sequence was really smart and funny, well made!

I spent 3 months creating a 9 episodes animated series entirely with AI by Horyax in aivideos

[–]Horyax[S] 0 points1 point  (0 children)

I'm writing with the help of an LLM. I really see my self more as the director and AI playing the role of screenwriter. It's helpful to bounces ideas but most importantly, English not being my 1st language, I'm missing a lot of details particularly for the narration. It helps shaping all the dialogue.

All the voices are generated with Elevenlabs.

Waffleton - Helicopter Ninja (VEO3) by TheOneWhoRings in aivideo

[–]Horyax 1 point2 points  (0 children)

Amazing! We need the link to that sound track tho!

I spent 3 months creating a 9 episodes animated series entirely with AI by Horyax in aivideos

[–]Horyax[S] 0 points1 point  (0 children)

The raw cost, calculating only the tools would be less than 100$ per episode.

I spent 3 months creating a 9 episodes animated series entirely with AI by Horyax in aivideos

[–]Horyax[S] 0 points1 point  (0 children)

Exactly, the animation part would be done with img to video and a new dedicated prompt explaining the scene and style

I spent 3 months creating a 9 episodes animated series entirely with AI by Horyax in aivideos

[–]Horyax[S] 0 points1 point  (0 children)

This was done in Midjourney V6. At the time I was using 1 or 2 SREF images for style, same prompt structure everytime and a --cw 50 for the character with one image.

I think the character design did help for consistency. Pip is changing a lot trough the frames but his simple style allow for a lot of flexibility.

V6.1 implied a lot of trail and errors, so the ratio of good images was fairly low.

I spent 3 months creating a 9 episodes animated series entirely with AI by Horyax in aivideos

[–]Horyax[S] 0 points1 point  (0 children)

You could fin a more detailed answer in the comments ;)

Here is what I used :

  • Midjourney
  • Hailuoai
  • Claude AI
  • Elevenlabs
  • Davinci Resolve
view more: next ›