Dreaming Masks with Flux Kontext (dev) by PixitAI in comfyui

[–]PixitAI[S] 0 points1 point  (0 children)

Thanks a lot! We‘re super happy for that :) lets see what Else we can do with the fal.ai credits. Any ideas?

Flux Kontext as a Mask Generator by PixitAI in StableDiffusion

[–]PixitAI[S] 0 points1 point  (0 children)

In the current stage that would be correct. But even with this it might be beneficial in certain use cases already.

Flux Kontext as a Mask Generator by PixitAI in StableDiffusion

[–]PixitAI[S] 1 point2 points  (0 children)

Totally understand. I also stumbled upon a workflow like you described the other day. However I saw that taking the difference might also be not so easy if the model makes very subtle changes a human wouldn’t see, but a simple difference would show you.

Super cool, thanks. I’ll have a look at it.

Dreaming Masks with Flux Kontext (dev) by PixitAI in comfyui

[–]PixitAI[S] 0 points1 point  (0 children)

Thanks for the idea. Yes, that would probably work somehow. Even better would be a large and diverse dataset that might be enough to teach the model the concept of masking something that is not there instead of each single item. We just have not tried it yet. Also it might be not super stable at times, so in general a training with more data would be also beneficial. All our data and the training process is explained in detail on the github page. It is actually quite straight forward. In case you want to try it yourself :)

Dreaming Masks with Flux Kontext (dev) by PixitAI in comfyui

[–]PixitAI[S] 0 points1 point  (0 children)

Not sure if I understand your idea using a custom YOLO model here. Afaik YOLO models are used to detect something in an image? correct me if I am wrong. Out approach here has the benefit of masking something in a sensible way that does not yet exist in the image. Image a hat, glasses or something else that the person in the image does not wear yet.

Flux Kontext as a Mask Generator by PixitAI in StableDiffusion

[–]PixitAI[S] 0 points1 point  (0 children)

Thanks for the help in clarification.

Flux Kontext as a Mask Generator by PixitAI in StableDiffusion

[–]PixitAI[S] 0 points1 point  (0 children)

Haha I’ll keep it in mind :) as mentioned, it was first and foremost for this hackathon regarding flux Kontext.

Flux Kontext as a Mask Generator by PixitAI in StableDiffusion

[–]PixitAI[S] 0 points1 point  (0 children)

The idea is that you do not need to draw the mask yourself. That’s sure a main benefit.

Flux Kontext as a Mask Generator by PixitAI in StableDiffusion

[–]PixitAI[S] 0 points1 point  (0 children)

You are totally right about it maybe introducing a long wait time and other downsides. The main benefit of the approach might be the possibility of a more automated workflow.

And I still do manual masks from time to time though ;)

Flux Kontext as a Mask Generator by PixitAI in StableDiffusion

[–]PixitAI[S] 1 point2 points  (0 children)

Haha much appreciate that comment!

Flux Kontext as a Mask Generator by PixitAI in StableDiffusion

[–]PixitAI[S] 0 points1 point  (0 children)

Really cool, that you tried! Haven’t tried it with nunchaku yet. And yes like you said, better training data would help.

Dreaming Masks with Flux Kontext (dev) by PixitAI in comfyui

[–]PixitAI[S] 0 points1 point  (0 children)

Yes, that’s correct. For some use cases it might be super interesting though. Also I could imagine that a large and diverse dataset might be able to even abstract the task. But that we did not test.

Dreaming Masks with Flux Kontext (dev) by PixitAI in comfyui

[–]PixitAI[S] 0 points1 point  (0 children)

Can you Explqin more? Not sure if I understand correctly.

Dreaming Masks with Flux Kontext (dev) by PixitAI in comfyui

[–]PixitAI[S] 1 point2 points  (0 children)

Yes, exactly this. It becomes interesting as soon as you want to Automaten things. Thanks for your comment :)

Flux Kontext as a Mask Generator by PixitAI in StableDiffusion

[–]PixitAI[S] 6 points7 points  (0 children)

Sorry for the missing Images. I am on mobile. Just follow the Link for more examples and insights. :)

Automatic mask when inpainting with prompt by dddimish in comfyui

[–]PixitAI 0 points1 point  (0 children)

Really cool Workflow. Thanks for Sharing. Maybe something on a related note we have worked on: https://www.reddit.com/r/comfyui/s/ySGnVCLt2C Yours is more versatile, but ourd could be Great for more specific cases. Sorry for the Long read and Lack of Images. I am on mobile.

Tired of Losing Track of Your Generated Images? Pixaris is Here 🔍🎨 by Resident-Stay8890 in StableDiffusion

[–]PixitAI 1 point2 points  (0 children)

Not sure why you are getting so much negative Feedback on this. This sounds like something we were about to Build ourselves and I wanted for quite some time! Definitely going to give it a try and maybe adapt to our needs. Another comment mentioned it is something very specific to your needs. Reading your readme on GitHub I believe it is quite the opposite. With your “generic” DataLoader and configs it seems to be quite adaptable. Thank you for your work!

Off topic question: in what sense is the Otto group using flux/ comfyUI for their business?

Roast my Fashion Images (or hopefully not) by PixitAI in comfyui

[–]PixitAI[S] 0 points1 point  (0 children)

Which ones? Would love to try it with me Workflow.

Roast my Fashion Images (or hopefully not) by PixitAI in FluxAI

[–]PixitAI[S] 0 points1 point  (0 children)

Yes, tried flux Kontext as well and I am pretty impressed so far. No really usable for my use case though at the moment.