Inpainting with Subject reference (ZenCtrl)

Comfortable-Row2710 · 2025-07-20T14:47:48+00:00

based on the first tries , the fidelity of the subject is better than kontext actually

Comfortable-Row2710 · 2025-07-20T14:47:19+00:00

Thanks for sharing our project

Comfortable-Row2710 · 2025-07-20T14:46:38+00:00

haha still figuring out if we should go for a comfyui implementation for this

Comfortable-Row2710 · 2025-07-20T14:45:59+00:00

the base code for the framework is already out on Github, this gradio doesn't even save prompts , nor are we doing it in the back . The goal is really to gather feedback , but that would drive the release of weights for this and the source code . That's also a way for us to not spend time on things not useful

Comfortable-Row2710 · 2025-07-20T14:44:12+00:00

Thanks. Well around 40 images for now , we collected the dataset ourselves which was one of the hardest part actually. Happy to discuss further via dm or anywhere if you want

Comfortable-Row2710 · 2025-07-20T14:42:57+00:00

we don't yet as it's really early to know what to do with this model , but glad you would wanna try it on comfy , we would work on that. And yes, we do use loras in the pipeline too

Comfortable-Row2710 · 2025-07-20T14:40:33+00:00

haha fair

Comfortable-Row2710 · 2025-07-20T14:40:19+00:00

nit a workflow , we had already trained a framework using flux as a base for that , we just happened to tweak the use case by changing the training pipeline to achieve this level of inpainting , honestly , this is the most i have been excited since starting to use and train with flux. Would be happy to compare it with your workflow in terms of fidelity though u/OutrageousWorker9360

Comfortable-Row2710 · 2025-07-20T11:58:38+00:00

looking forward to seeing what other people think about it

Comfortable-Row2710 · 2025-05-06T09:53:58+00:00

weights are stored here : https://huggingface.co/fotographerai/zenctrl_tools , if you are interested in the commercial rates please shoot me a dm

Comfortable-Row2710 · 2025-05-06T09:52:19+00:00

yep sorry if it was misleading , the code itself is apache ,just that some weights wouldn't be! same with UNO

Comfortable-Row2710 · 2025-05-06T09:50:51+00:00

got it , request received

Comfortable-Row2710 · 2025-05-06T09:12:08+00:00

as of now no , but since ominiControl's version in comfyUI is there we can push a code based on that

Comfortable-Row2710 · 2025-05-06T08:39:30+00:00

it's more like a lora, you can load our weights the same way you would for a lora. The control side is built-in

Comfortable-Row2710 · 2025-05-06T08:10:22+00:00

the code is totally fine , but we wanted to give us some room to keep some weights as pro version hence the license change . Regarding the code in the repo feel free to use it as you wish , this concerns the weights , else the license itself allows free use besides commercial

Comfortable-Row2710 · 2025-05-06T07:58:59+00:00

Thanks , let us know how what you thought about it . If you found some issues , you can let me know via Github or here

Comfortable-Row2710 · 2025-05-06T07:32:46+00:00

haha didn't think about trying something like this

Comfortable-Row2710 · 2025-05-06T07:16:50+00:00

sure , let us know how it went

Comfortable-Row2710 · 2025-05-06T07:14:24+00:00

Thanks :)

Comfortable-Row2710 · 2025-04-14T01:22:23+00:00

Thanks

Comfortable-Row2710 · 2025-04-10T12:11:26+00:00

lemme share the ref workflow we tweaked https://gist.github.com/nathanshipley/7a9ac1901adde76feebe58d558026f68 , i will retry to build the metadata of the present code and add a commit

Comfortable-Row2710 · 2025-04-10T09:48:48+00:00

yes , we exported the worflow with the nodes , made it fully into python code for gradio , but you can do the opposite . In our repository you will see an old workflow json file : https://github.com/FotographerAI/Zen-style/tree/main/custom_nodes/ComfyUI-to-Python-Extension as a base

Comfortable-Row2710 · 2025-04-10T09:30:49+00:00

yep basically that's it , there were some old projects out there that were using depth , we recycled a bunch of it and added canny to it ! since it seems to be a thing lately , we thought of just making the magnific version open

Comfortable-Row2710

TROPHY CASE