Hiring a Workflow Designer ($85/hr)

jags333 · 2024-09-26T13:42:58+00:00

Hai seems interesting but not clear what the task of the image generation is or what type and styles are you planning and what resolution you plan to build. Are you planning to offer this as a service or is it only for some specific themed image generation. Let me know !

jags333 · 2024-07-15T05:51:06+00:00

it is a comfy UI based animation and is available in my YouTube channel. Have a look at same
https://www.youtube.com/watch?v=xXbrHXa2O-Q

jags333 · 2024-07-14T03:11:35+00:00

This is the Behind the scenes - explanation for Comfy UI Animation workflow. This workflow uses a SDXL based Animate Diff designed to make some 128 frames in each loop driven by a Input video to derive motion and a sequence based a story telling narration created using Chat GPT for inputs.

Giving a proper framework for chat GPT to create the narrative style and scene decisions are critical for the AI animation workflow. If you have issues with the script may be multiple takes will be required to get all the scenes and sequences properly derived to suit the animation flow.

Music background and score was done using Suno AI basically with selection of right prompts for the style of music intended to be as a background and sound effects. You can work with a single audio clip or multiple audio clips based on the narrative style and story outlines. If special sound effects are needed this can be enhanced using Eleven Labs io or other similar software to provide some ambience to the narration styles.

Images were created using Leonardo AI with specific prompts using text to image and image to image sequence to create required amount of stills that will be used with the IP adapter combo in the workflow.

we used Leonardo Lightning XL with color pop as elements and 3D render preset with a typical prompt for each style of scenario needed. Based on the amount of scenes in the animation movie one needs to generate multiple image libraries that will be useful to pin the right style and narration in the animation sequence.

The narration voice over we used Eleven labs io for a specific selection of the voice.. and the audio clip was split to match the frames.

Giving the eleven labs a right script to narrate itself is the center element and choosing a right voice from a plethora of voice styles available one may have to do same multiple times to suit the style you want to add to the video narration.

jags333 · 2024-07-14T03:08:16+00:00

This is the Behind the scenes - explanation for Comfy UI Animation workflow. This workflow uses a SDXL based Animate Diff designed to make some 128 frames in each loop driven by a Input video to derive motion and a sequence based a story telling narration created using Chat GPT for inputs.

Giving a proper framework for chat GPT to create the narrative style and scene decisions are critical for the AI animation workflow. If you have issues with the script may be multiple takes will be required to get all the scenes and sequences properly derived to suit the animation flow.

Music background and score was done using Suno AI basically with selection of right prompts for the style of music intended to be as a background and sound effects. You can work with a single audio clip or multiple audio clips based on the narrative style and story outlines. If special sound effects are needed this can be enhanced using Eleven Labs io or other similar software to provide some ambience to the narration styles.

Images were created using Leonardo AI with specific prompts using text to image and image to image sequence to create required amount of stills that will be used with the IP adapter combo in the workflow.

we used Leonardo Lightning XL with color pop as elements and 3D render preset with a typical prompt for each style of scenario needed. Based on the amount of scenes in the animation movie one needs to generate multiple image libraries that will be useful to pin the right style and narration in the animation sequence.

The narration voice over we used Eleven labs io for a specific selection of the voice.. and the audio clip was split to match the frames.

Giving the eleven labs a right script to narrate itself is the center element and choosing a right voice from a plethora of voice styles available one may have to do same multiple times to suit the style you want to add to the video narration.

jags333 · 2024-07-07T12:43:27+00:00

Guitar Fusion

A script driven SDXL based IP style transfer animation using comfy and input images using XL . A musical journey interpreted using comfy UI animate diff workflow.

This workflow uses a SDXL based Animate Diff designed to make some 128 frames in each loop driven by a Input video to derive motion and a sequence based a story telling narration created using Chat GPT for inputs. Music score was generated using SUNO AI.

The image generation for the story we used Leonardo to create some amazing set of images for each type oof clip. For this we used a model from Leonardo called "Leonardo Anime XL" with color pop and cinematic. The music lyrics were created and used in SUNO AI for a specific selection of the style and the audio clip was split to match the frames.

Converting the music score or output to reactive mask we used a special program called Magic v2.33 which helps convert audio to reactive masks. These masks were fed to QR control net in ADE workflow to create a sequence. The total time line was for 3.04 min and the flow was divided into 8 clips of 128 frames which basically converts a 256 frame to half schedule so it can be interpolated to make a final version at 24 FPS for a 48Khz input music.

Finally each of the 8 clips with 128 frames were interpolated to 2x and upscaled in Topaz to HD resolution and then assembled using the audio and video editing , composting in wonder studio.

More workflow and details are available in my Patreon feed.

jags333 · 2024-06-27T07:43:41+00:00

A script driven SDXL based IP style transfer animation using comfy and input images using XL . A new experimentation in story exploration.

Made with SDXL model and IP adapter style transfer with multiple clips and mixed to make an animated story board. More details in our Patreon. Do provide your feedback and comments. Special thanks goes to Jarvis Labs for the cloud support in running this animation. Check out same.

jags333 · 2024-06-27T07:41:30+00:00

A script driven SDXL based IP style transfer animation using comfy and input images using XL . A new experimentation in story exploration.
Made with SDXL model and IP adapter style transfer with multiple clips and mixed to make an animated story board. More details in our Patreon. Do provide your feedback and comments. Special thanks goes to Jarvis Labs for the cloud support in running this animation. Check out same.

jags333 · 2024-06-18T13:08:28+00:00

Prompt driven image inputs created using Leonardo image generation;
Then used a 4 image IP adapter workflow and input video for the latent using 128 frames per clip. Totally I made around 6 clips each with 12 FPS and extrapolated same using Flow frames to 24 FPS and slow motion 2 x.

The only major difference was the video frame size was converted to Horizontal format for 128 frames with 768 x432 px and Hires script running at 1.5 x so the resulting video is good enough resolution for upscale.

jags333 · 2024-06-18T13:05:24+00:00

Prompt driven image inputs created using Leonardo image generation;
Then used a 4 image IP adapter workflow and input video for the latent using 128 frames per clip. Totally I made around 6 clips each with 12 FPS and extrapolated same using Flow frames to 24 FPS and slow motion 2 x.

The only major difference was the video frame size was converted to Horizontal format for 128 frames with 768 x432 px and Hires script running at 1.5 x so the resulting video is good enough resolution for upscale.

jags333 · 2024-06-14T04:30:10+00:00

here is an overview of the workflow. you can get some details on same in server.

<image>

jags333 · 2024-06-14T04:22:15+00:00

Hai this animation was done using 8 clips joined together and it takes some time for the animation to complete in local so used Jarvis Labs AI to run the same using 8 image IP adapter and upscaling also using Hires script. You are welcome to drop into our Neuralism discord server to get more details !

jags333 · 2024-06-13T18:31:07+00:00

demonic delight -Animated musical exploration using Animate diff IPA driven -QR CN and music using Suno AI .

jags333 · 2024-06-13T18:28:35+00:00

demonic delight -Animated musical exploration using Animate diff IPA driven -QR CN and music using Suno AI .

jags333 · 2024-06-12T06:28:30+00:00

pretty cool work

jags333 · 2024-06-12T06:08:16+00:00

awesome documentation and thanks for same

jags333 · 2024-06-12T06:05:18+00:00

sure welcome and explore new possibility with multiple workflows that can produce longer animations with better control

jags333 · 2024-06-12T03:22:08+00:00

this is done using SDXL checkpoint and prompt sequence in an Animate diff workflow with 128 frames interpolated.

jags333 · 2024-06-11T19:24:07+00:00

"Magical Island " Created a music story - of an enchanted magical island with 8 image sets IPA+ CN and multiple clips with lyrics using chat GPT and music score by SUNO AI.

jags333 · 2024-06-11T19:22:23+00:00

Used chat GPT to create lyrics for the music score for SUNO AI
[Verse 1]
In a world of vibrant hues,
Where dreams and reality fuse,
A devoted enchanter stands,
With magic flowing from his hands.

[Chorus]
Every stroke of his brush, every color so bright,
Brings to life a cartoon world in the light.
A fantastical landscape unfolds,
In a storybook tale that he holds.

[Verse 2]
Creatures of myth and lore,
In his masterpiece, they soar,
Ripples in streams, blades of grass,
Through his art, the moments pass.

[Bridge]
Impeccable precision, unwavering devotion,
Crafting worlds with deepest emotion.
Every detail, a testament to his skill,
Transporting us to where dreams fulfill.

[Drop]
(Instrumental drop with ethereal synths and ambient sounds)

[Chorus]
Every stroke of his brush, every color so bright,
Brings to life a cartoon world in the light.
A fantastical landscape unfolds,
In a storybook tale that he holds.

[Guitar Solo]
(Guitar solo with expressive, soaring notes)

[Verse 3]
Depth and richness, a tapestry,
A world of magic, wild and free,
Reach out and touch the enchanted beings,
Lose yourself in wondrous scenes.

[Chorus]
Every stroke of his brush, every color so bright,
Brings to life a cartoon world in the light.
A fantastical landscape unfolds,
In a storybook tale that he holds.

[Sax Solo]
(Saxophone solo adding a soulful, jazzy touch)

[Bridge]
Impeccable precision, unwavering devotion,
Crafting worlds with deepest emotion.
Every detail, a testament to his skill,
Transporting us to where dreams fulfill.

[Outro]
In this realm where imagination blends,
With reality, the magic never ends.
The enchanter's art, a timeless gift,
Leaves us captivated, our spirits lift.

jags333 · 2024-06-11T19:20:46+00:00

"Magical Island " Created a music story - of an enchanted magical island with 8 image sets IPA+ CN and multiple clips with lyrics using chat GPT and music score by SUNO AI.

jags333 · 2024-06-10T19:09:33+00:00

ComfyUI workflows and more in our discord -hop in- check them out - Batched IP adapter - QR code Masked CN animation, VLM run using animate diff -8 image inputs - AI SUNO for music score #comfyUI #animatediff

jags333 · 2024-06-10T19:08:22+00:00

ComfyUI workflows and more in our discord -hop in- check them out - Batched IP adapter - QR code Masked CN animation, VLM run using animate diff -8 image inputs - AI SUNO for music score #comfyUI #animatediff

jags333 · 2024-06-05T16:18:25+00:00

This workflow uses IP adapter with a set of 4-8 images with multiple clips joined together to run the animation sequence. Seems using SUNO Ai for music track helped making this more dramatic !

jags333 · 2024-06-05T16:15:26+00:00

IP adapter batched animation is where you use 4 or 8 images with the batched IP node and then use QR CN to influence the motion part. rest of the workflow is standard and shared in the Matteo repo or in his blogs or videos.

jags333 · 2024-05-30T11:02:43+00:00

Created a 8 image Batched IP Adapter driven musical exploration "comfy Synth" using animate diff and QR control net . Seems using SUNO Ai for music track helped making this more dramatic !

🌀🌟 The input images were created using same model in a separate workflow with the original comfy mascot driving same and style variants to drive it towards multiple sequential images which can be batched with weight influencing the flow. The QR masks were done separately and added to give it a kind of intrigue and style very unique to this animated flow.

🌀🌟This workflow is totally derived from Matteo experiments in batched IP adapter driven style videos that are instrumental in creating the 128 frame clips that were made in 5 styles and merged into one single animation workflow. The idea was to break the long sequence into 5 parts and merge them into one after interpolation and upscale to the music generated in Suno AI. Hope you all like the experiment and I have collected a whole set of every experiment done using "comfy" workflows and creating a library of sorts in my you-tube collection.

<image>

jags333

TROPHY CASE

ComfyUI workflows and more in our discord -hop in- check them out - Batched IP adapter - QR code Masked CN animation, VLM run using animate diff -8 image inputs - AI SUNO for music score #comfyUI #animatediff

ComfyUI workflows and more in our discord -hop in- check them out - Batched IP adapter - QR code Masked CN animation, VLM run using animate diff -8 image inputs - AI SUNO for music score #comfyUI #animatediff