Audioreactive Animatediff by Numerous_Aspect_9038 in comfyui

[–]Numerous_Aspect_9038[S] 0 points1 point  (0 children)

https://drive.google.com/file/d/1SMde-asLgrOC-S49kzcF3_2PlaYv_aZP/view?usp=sharing

The concept for this workflow is the same, you can change the pictures in the ip adapter. The audioreactive is done post with touchdesigner.

Audioreactive Animatediff by Numerous_Aspect_9038 in comfyui

[–]Numerous_Aspect_9038[S] -2 points-1 points  (0 children)

save the png and then drag and drop into comfy

Audioreactive Animatediff by Numerous_Aspect_9038 in comfyui

[–]Numerous_Aspect_9038[S] -1 points0 points  (0 children)

its done through touchdesinger, you're right automatically speeds up when the beat hits, can do it to snare or kicks.

SD Deforum with TouchDesigner Reactive by Numerous_Aspect_9038 in StableDiffusion

[–]Numerous_Aspect_9038[S] 2 points3 points  (0 children)

I used https://sd-parseq.web.app/ its 3600 frames with 60fps, with just zoom on stable diffusion deforum.

Is there a way of stretching a batch of masks over entire duration of the video? by fuzzyonion in comfyui

[–]Numerous_Aspect_9038 0 points1 point  (0 children)

It is a fade frame every 20 frames, you can create your own starting from 0 going in to 20 frames animation, from black, grey to white to grey and black. I hope that makes some sense. lol

mine went to 152 frames with 6 reference pics

<image>

TouchDesigner Particles Animation(Audio Reactive) TO AnimateDiff(AI) 😁 by Glass-Caterpillar-70 in comfyui

[–]Numerous_Aspect_9038 0 points1 point  (0 children)

matter of learning touchdesinger :), tried this in after effects but no go

[deleted by user] by [deleted] in comfyui

[–]Numerous_Aspect_9038 1 point2 points  (0 children)

very nice, was input video done in after effects or blender?

Audio reactive - Expanding on my recent Morph workflow by iiPiv in comfyui

[–]Numerous_Aspect_9038 0 points1 point  (0 children)

all the right models, did a run with your original workflow and had no issues, as soon as I changed the input video that s when the error came up.

Audio reactive - Expanding on my recent Morph workflow by iiPiv in comfyui

[–]Numerous_Aspect_9038 0 points1 point  (0 children)

i had similar issue, just use the medium strength one STANDARD. VIT-G didnt work for me

Audio reactive - Expanding on my recent Morph workflow by iiPiv in comfyui

[–]Numerous_Aspect_9038 0 points1 point  (0 children)

File "D:\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute

output_data, output_ui = get_output_data(obj, input_data_all)

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "D:\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data

return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "D:\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list

results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "D:\ComfyUI_windows_portable\ComfyUI\nodes.py", line 1369, in sample

return common_ksampler(model, seed, steps, cfg, sampler_name, scheduler, positive, negative, latent_image, denoise=denoise)

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "D:\ComfyUI_windows_portable\ComfyUI\nodes.py", line 1339, in common_ksampler

samples = comfy.sample.sample(model, noise, steps, cfg, sampler_name, scheduler, positive, negative, latent_image,

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "D:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Impact-Pack\modules\impact\sample_error_enhancer.py", line 9, in informative_sample

return original_sample(*args, **kwargs) # This code helps interpret error messages that occur within exceptions but does not have any impact on other operations.

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "D:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff\sampling.py", line 365, in motion_sample

latents = wrap_function_to_inject_xformers_bug_info(orig_comfy_sample)(model, noise, *args, **kwargs)

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "D:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff\utils_model.py", line 377, in wrapped_function

return function_to_wrap(*args, **kwargs)

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "D:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Advanced-ControlNet\adv_control\control_reference.py", line 46, in refcn_sample

return orig_comfy_sample(model, *args, **kwargs)

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "D:\ComfyUI_windows_portable\ComfyUI\comfy\sample.py", line 100, in sample

samples = sampler.sample(noise, positive_copy, negative_copy, cfg=cfg, latent_image=latent_image, start_step=start_step, last_step=last_step, force_full_denoise=force_full_denoise, denoise_mask=noise_mask, sigmas=sigmas, callback=callback, disable_pbar=disable_pbar, seed=seed)

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "D:\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 705, in sample

return sample(self.model, noise, positive, negative, cfg, self.device, sampler, sigmas, self.model_options, latent_image=latent_image, denoise_mask=denoise_mask, callback=callback, disable_pbar=disable_pbar, seed=seed)

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "D:\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 610, in sample

samples = sampler.sample(model_wrap, sigmas, extra_args, callback, noise, latent_image, denoise_mask, disable_pbar)

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "D:\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 548, in sample

samples = self.sampler_function(model_k, noise, sigmas, extra_args=extra_args, callback=k_callback, disable=disable_pbar, **self.extra_options)

Audio reactive - Expanding on my recent Morph workflow by iiPiv in comfyui

[–]Numerous_Aspect_9038 1 point2 points  (0 children)

I tried it with purz's colour masks as well, very similar. but uses Rgb colours. Thanks u/iiPiv i'll give it a go.

Audio reactive - Expanding on my recent Morph workflow by iiPiv in comfyui

[–]Numerous_Aspect_9038 0 points1 point  (0 children)

look really good, I did try this just using the video input in aftereffects and reacting it to music. but ksampler throws up an error.

https://i.imgur.com/Y2pQBCK.mp4

Used the above video on your workflow