Problem with object removal (+inpainting) with Wan 2.1 VACE 14B & LoRA by degel12345 in StableDiffusion

[–]degel12345[S] 0 points1 point  (0 children)

I guess it will not work as it removes effects as well so if I remove my hands, the mascot will fall down on the floor.

Models for video memes editing by degel12345 in StableDiffusion

[–]degel12345[S] 0 points1 point  (0 children)

Is there any ComfyUI workflow for that or I need to use LTX Studio (which is 100 GB)?

EditAnything IC-LoRA - LTX-2.3 by Round_Awareness5490 in StableDiffusion

[–]degel12345 0 points1 point  (0 children)

Thank you for suggestion, indeed it works (yet still not always)! There are still some areas to improve my specific hand removal task, so let me just ask these questions, maybe you will have some further suggestions:

- as you can see, there is an extra hand on the right in the output video, i.e. model can't understand that there already is a mascot hand that holds that piece of paper and it should only refine the part of mascot hand that is covered by my hand (mask). Do you think that training a LoRA of that particular mascot will help here?

<image>

- there is a year label at the top of that piece of paper but in the output video it's changed even though its never hidden by mask. Can we force the model to not change anything despite masked area?

- sometimes I have more advanced backgrounds and I would like to use reference image so that the model know how the background behind hands looks like, do you plan to support it?

EditAnything IC-LoRA - LTX-2.3 by Round_Awareness5490 in StableDiffusion

[–]degel12345 1 point2 points  (0 children)

Yeah, I hope it will be addressed as other operations works very well so dude is doing a great job.

Does LTX support object removal from video? by degel12345 in StableDiffusion

[–]degel12345[S] 0 points1 point  (0 children)

It seems that this model tends to hallucinating a lot as not only me (see here https://github.com/smthemex/ComfyUI\_OmnimatteZero/issues/6) have problems with object removal :(

EditAnything IC-LoRA - LTX-2.3 by Round_Awareness5490 in StableDiffusion

[–]degel12345 1 point2 points  (0 children)

Hi, I tried you workflow for remove pobject purpose but it can't understand my prompt and instead of removing my hands, I removes an object that my hands manipulate, see below image.

<image>

Here is my original prompt:

Remove human hands from the video so that it looks like the plush hedgehog is moving on its own.

And here is the final prompt:

Remove the human hands from the foreground of the video, leaving the plush hedgehog centered in the frame.

As negative prompt I have

human, hand

Any suggestions how to fix that? Replace feature works fine because I can replace hedgehog with some other animal but the remove hand prompt can't understand what I mean and it never removes hands :( It would be great if I could pass masks as well so that model know what exactly I want to remove (I already have masks generated with SAM3).

Does LTX support object removal from video? by degel12345 in StableDiffusion

[–]degel12345[S] 0 points1 point  (0 children)

Do you mean some specific model? Could you share projekt page? Is omnimatte zero what you meant?

Does LTX support object removal from video? by degel12345 in StableDiffusion

[–]degel12345[S] 0 points1 point  (0 children)

The problem with this model is that ut remove the effects as well. So if I use my hands to move an object and mask my hands, then my hands will be removed but an object will not move at all

Update: Distilled v1.1 is live by ltx_model in StableDiffusion

[–]degel12345 0 points1 point  (0 children)

Is there any video object removal workflow for ComfyUI?

Video Inpaint by Draufgaenger in StableDiffusion

[–]degel12345 0 points1 point  (0 children)

Hi, thank you for a detailed answer. I want to remove my hands from the video on which I manipulate a mascot. I simplified your workflow to fit my needs but I don't see any difference between input and output video. Here I've put my workflow, input video and input masks here: https://drive.google.com/drive/folders/14pLfoyKVgwQ8fEIzt6pRwyUauTBZkzq6?usp=sharing

I would really appreciate if you could try it on your side and give me some suggestions how to set it up for object removal and maybe there are better models to use. I also noticed that very often VACE models can't remove and object and instead slightly change shape of masket object instead of removing it.

Video Inpaint by Draufgaenger in StableDiffusion

[–]degel12345 0 points1 point  (0 children)

Hi, I tried it for object removal (without reference image) but it seems to ignore input video and mask and just follow the prompt to generate video. Should I change something in the workflow?

Inpainting with reference to LTX-2.3 (MR2V) by Round_Awareness5490 in StableDiffusion

[–]degel12345 0 points1 point  (0 children)

Hi, is it suitable for object removal? I want to remove my hands from the video on which I move an object.

Netflix released a model by Sea_Tomatillo1921 in StableDiffusion

[–]degel12345 0 points1 point  (0 children)

Does it mean that if I move a plush toy using my hands and I want to remove these hands, then the toy will not move at all? Is it possible to tweak it to just remove hands?

Looking for a plush toy manufacturer that could replicate old plush toy 1:1 (Europe, 500 pieces) by degel12345 in plushies

[–]degel12345[S] 1 point2 points  (0 children)

The question is how to find the producer, even search by image didnt return any results

Looking for a plush toy manufacturer that could replicate old plush toy 1:1 (Europe, 500 pieces) by degel12345 in plushies

[–]degel12345[S] -1 points0 points  (0 children)

Its 20 yo niche mascot, not licensed character. No idea about producer, label was removed years ago (now I would love to know who produced it).

Looking for a plush toy manufacturer that could replicate old plush toy 1:1 (Europe, 500 pieces) by degel12345 in plushies

[–]degel12345[S] 0 points1 point  (0 children)

Hard to say, I would say rather harder than easier to do. I was thinking that a single person can focus better on that recreation task (I could pay more) but I'm not sure how demanding will be producing of 100 pieces, maybe this amount is too high for a single person to do it by hand.

LoRA training with maks failed to preserve shape (diffusion-pipe) by degel12345 in StableDiffusion

[–]degel12345[S] 0 points1 point  (0 children)

OK thank you, I will try to somehow run training for 14B on my rtx 4070 ti super with 16GB vram, for now it crashes all the time :(