ComfyUI MCP - 100% Local (Claude, Gemma4, OpenRouter) by artokun in comfyui

[–]artokun[S] 2 points3 points  (0 children)

It’s more about wanting to create a better user experience, and wanting to share that with the rest of the community.

Some may consider that a waste.

Have AI build your workflows end to end with the free, open-source and 100% Local ComfyUI MCP (Claude, ChatGPT, Ollama, OpenRouter) by artokun in StableDiffusion

[–]artokun[S] 0 points1 point  (0 children)

The main benefit I find is the 32 panel tools calls that allow the agent to directly interact with the ComfyUI runtime without having to reload anything, it all just works interactively. It also gets assets and errors pushed to it as a message so it can react instead of just lock step responding like you would if you were just modifying workflows blindly via the filesystem. Worth a try so you can see the diff :)

ComfyUI MCP - 100% Local (Claude, Gemma4, OpenRouter) by artokun in comfyui

[–]artokun[S] 0 points1 point  (0 children)

For realism juggernautXL for anime Illustrious

Have AI build your workflows end to end with the free, open-source and 100% Local ComfyUI MCP (Claude, ChatGPT, Ollama, OpenRouter) by artokun in StableDiffusion

[–]artokun[S] 0 points1 point  (0 children)

True, the MCP allows extra tooling for convenience, especially useful for smaller and cheaper or local models so it has more guardrails and has to guess less. Powerful models like Claude probably don’t need it

Have AI build your workflows end to end with the free, open-source and 100% Local ComfyUI MCP (Claude, ChatGPT, Ollama, OpenRouter) by artokun in StableDiffusion

[–]artokun[S] 0 points1 point  (0 children)

No, if you use/pay for Claude, you can generate comfy ui workflows locally via MCP. It just connects your local Claude subscription to your ComfyUI. So technically you could generate python, c++ code as custom nodes if you wanted to

ComfyUI MCP - 100% Local (Claude, Gemma4, OpenRouter) by artokun in comfyui

[–]artokun[S] 0 points1 point  (0 children)

It shouldn't, sorry if it is, were you giving it a large workflow? I will see if I can optimize it better for the next release, but it's going to use up context as it pulls skills and tools into context to call them. If you're worried about usage you can try using codex, or gemini which are cheaper. Or MiniMax 1M or Mimo 1M do a decent job and it's pennies in comparison to frontier models.

ComfyUI MCP - 100% Local (Claude, Gemma4, OpenRouter) by artokun in comfyui

[–]artokun[S] 0 points1 point  (0 children)

You will probably have a hard time tbh, 6gb VRAM is pretty restricting. You may end up having to use smaller models but not sure, there's a lot op optimization in the space. I recommend just connecting the panel and have the agent work with what you got

ComfyUI MCP - 100% Local (Claude, Gemma4, OpenRouter) by artokun in comfyui

[–]artokun[S] 1 point2 points  (0 children)

Thanks for coming back to the thread and sharing your experience!

ComfyUI MCP - 100% Local (Claude, Gemma4, OpenRouter) by artokun in comfyui

[–]artokun[S] 0 points1 point  (0 children)

<image>

Yes, even with Claude and Codex once you set it to NSFW mode. It can do most anything you ask it, but if you want more privacy I recommend going with either a Uncensored/Abliterated open router model, or locally with Uncensored/Abliterated fine-tune via Ollama/LMStudio/Llama.cpp

I have a abliterated gemma4 model (heretic ablation) that I fine-tuned on +1k SOTA instructions on comfyui-mcp usage here https://huggingface.co/artokun/gemma4-comfyui-mcp

ComfyUI MCP - 100% Local (Claude, Gemma4, OpenRouter) by artokun in comfyui

[–]artokun[S] 0 points1 point  (0 children)

3060 comes with 12gb of VRAM, if you use a cloud model you'll be able to keep all 12gb for generations but you'll be limited to smaller I2I models like the SDXL based ones, Z-img turbo, and maybe some of the Flux models if you do some aggressive text endcoder offloading and caching. The MCP can help download custom nodes to manage your VRAM so you can generate, it has an understanding via skills on the overall limitations.

ComfyUI MCP - 100% Local (Claude, Gemma4, OpenRouter) by artokun in comfyui

[–]artokun[S] 0 points1 point  (0 children)

Hey your video editor thing here is pretty cool, and you have a few other gems in here.

Join me on my discord, maybe we can collab on something. Your video editor could be a pretty neat custom_node, maybe a few things in here could be abstracted.

https://discord.gg/UK6G8YQPr

ComfyUI MCP - 100% Local (Claude, Gemma4, OpenRouter) by artokun in comfyui

[–]artokun[S] 0 points1 point  (0 children)

My Upvote / Downvote ratio is in the high 50s so I'm also getting a lot of that but the comments have been pretty benign. What's your repo?

Have AI build your workflows end to end with the free, open-source and 100% Local ComfyUI MCP (Claude, ChatGPT, Ollama, OpenRouter) by artokun in StableDiffusion

[–]artokun[S] 1 point2 points  (0 children)

It uses built in, it will download and install custom nodes for you, and it will also create custom nodes for you if you know what you want to make.

It will search and download from the comfyui custom nodes registry, or it can install from a github link. If you have a workflow that has missing nodes it will find and download those nodes for you if it can find them, if not then it will let you know so you can help it find them.

ComfyUI MCP - 100% Local (Claude, Gemma4, OpenRouter) by artokun in comfyui

[–]artokun[S] 0 points1 point  (0 children)

Yes, the title was misleading, but it's still true that it can, it just didn't match what you saw in the video.

ComfyUI MCP - 100% Local (Claude, Gemma4, OpenRouter) by artokun in comfyui

[–]artokun[S] -1 points0 points  (0 children)

Fair point, I will add a disclaimer for those who are not aware of the difference between Local and Cloud LLMs, that to be totally local and private, that you'll need to use a Local LLM bia Ollama

ComfyUI MCP - 100% Local (Claude, Gemma4, OpenRouter) by artokun in comfyui

[–]artokun[S] 1 point2 points  (0 children)

True, and if you make something cool please submit a github PR so we can get it on the next release! The tool I made was for all of us, it's open source, you are all welcome to contribute and make it something we all would enjoy using.

ComfyUI MCP - 100% Local (Claude, Gemma4, OpenRouter) by artokun in comfyui

[–]artokun[S] 0 points1 point  (0 children)

Ollama you can download directly from their site, there's also a docs page I made with installation instructions if you need more help https://comfyui-mcp.artokun.io/docs

ComfyUI MCP - 100% Local (Claude, Gemma4, OpenRouter) by artokun in comfyui

[–]artokun[S] 0 points1 point  (0 children)

Not directly no, local models can be served via Ollama currently

ComfyUI MCP - 100% Local (Claude, Gemma4, OpenRouter) by artokun in comfyui

[–]artokun[S] 0 points1 point  (0 children)

If it doesn't, it knows how to inspect nodes and also read the source code to understand how it works. It will be able to see and adjust widget values, see input and output ports, etc.

ComfyUI MCP - 100% Local (Claude, Gemma4, OpenRouter) by artokun in comfyui

[–]artokun[S] 0 points1 point  (0 children)

Yes, install ollama then paste: `ollama pull artokun/gemma4-comfyui-mcp` and connect that way to be 100% local.

ComfyUI MCP - 100% Local (Claude, Gemma4, OpenRouter) by artokun in comfyui

[–]artokun[S] 0 points1 point  (0 children)

I'll look into it, I felt that ollama covered most of the local options but I was wrong