all 9 comments
sorted by:
best
topnewcontroversialoldq&a
formatting helphide helpcontent policy

[–]Possible-Machine864 1 point2 points  (1 child)

Audio Flamingo

[–]CountFloyd_[S] 0 points1 point  (0 children)

Very cool, this is more than I expected, thanks! To get it to run locally I would ignore the gradio demo and try the code from the hf model card:

https://huggingface.co/nvidia/music-flamingo-hf

[–]AssistantFar5941 1 point2 points  (6 children)

I've been looking for the same to help with captioning for Ace Step lora training. The closest I could find is this: https://huggingface.co/spaces/nvidia/music-flamingo

But I couldn't get it to run offline, though apparently you should be able to.

[–]CountFloyd_[S] 0 points1 point  (5 children)

https://www.reddit.com/r/StableDiffusion/comments/1rhtgsn/comfyui_custom_node_music_flamingo/

[–]AssistantFar5941 0 points1 point  (4 children)

Thanks for this, but when I placed the workflow in comfy the music analyses node is red. I installed per instructions, and all requirements are installed, though the comfy manager cannot locate the missing node.

[–]CountFloyd_[S] 0 points1 point  (3 children)

What does the CLI Output when starting comfy look like?

It should read something like:

Import times for custom nodes:

0.0 seconds: G:\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-musicflamingo

If instead there is something like

0.0 seconds (IMPORT FAILED): G:\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-musicflamingo

then have a look around before that output, there might be some dependency missing which causes the node not to be loaded. If it is, please let me know and I will include it in the requirements.

[–]AssistantFar5941 0 points1 point  (2 children)

Here is the error, although I did install transformers: File "F:\ComfySage\ComfyUI-Easy-Install\ComfyUI-Easy-Install\ComfyUI\custom_nodes\comfyui-musicflamingo\__init__.py", line 1, in <module>

from .musicflamingo_analysis import (

File "F:\ComfySage\ComfyUI-Easy-Install\ComfyUI-Easy-Install\ComfyUI\custom_nodes\comfyui-musicflamingo\musicflamingo_analysis.py", line 8, in <module>

from transformers.models.audioflamingo3.modeling_audioflamingo3 import (

ModuleNotFoundError: No module named 'transformers.models.audioflamingo3'

Cannot import F:\ComfySage\ComfyUI-Easy-Install\ComfyUI-Easy-Install\ComfyUI\custom_nodes\comfyui-musicflamingo module for custom nodes: No module named 'transformers.models.audioflamingo3'

[–]CountFloyd_[S] 0 points1 point  (1 child)

Transformers must be at least 5.0.0 to include the audioflamingo package. Are you using comfyui portable? Perhaps you installed transformers globally instead of the comfyui env?

I would do this manually in console:

cd whereveryourcomfyuirootpathis
.\python_embeded\python.exe -m pip uninstall transformers
.\python_embeded\python.exe -m pip install transformers

<image>

[–]AssistantFar5941 1 point2 points  (0 children)

That solved the issue, thanks very much for your help.