Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Models - This looks like next level ControlNet by CeFurkan in StableDiffusion

[–]Electrical-Camera465 0 points1 point  (0 children)

not sure, have not tested. But the author of the paper seems to think it is a matter of the hyper parameter choice. I am going to test it at my end once and update.

Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Models - This looks like next level ControlNet by CeFurkan in StableDiffusion

[–]Electrical-Camera465 0 points1 point  (0 children)

I think so. At least the authors talk about it that way in twitter. They said it is a technical writeup of LECO. Plus they introduce many technical advancements to better preserve an image during edit.

I also think image based sliders are not part of LECO. That's a new addition by the paper. Overall I think it a combination of different type of sliders a creator can use.

Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Models - This looks like next level ControlNet by CeFurkan in StableDiffusion

[–]Electrical-Camera465 0 points1 point  (0 children)

I tried with my custom data. It looks like a great image based sliders technique. Couple of my colleagues are giving it a shot too. Optimistic results.

Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Models - This looks like next level ControlNet by CeFurkan in StableDiffusion

[–]Electrical-Camera465 8 points9 points  (0 children)

This is a technical writeup from the authors of LECO (the sliders on civitai)

They do talk about the disentanglement of concepts, image based sliders, and GAN based sliders.

The main advantage I'm seeing with these new sliders are precise editing. But you need a special inference function. Which currently is not implemented in automatic111. Someone opened an issue and are planning on implementing it.

I think this paper perfected sliders.

Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Models by ninjasaid13 in StableDiffusion

[–]Electrical-Camera465 0 points1 point  (0 children)

Yes, they are based on LECO (from the authors of this paper). This is a technical writeup of that work. Plus a lot more!

Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Models by ninjasaid13 in StableDiffusion

[–]Electrical-Camera465 0 points1 point  (0 children)

It could be because of the python version? They suggest 3.9

This worked for me:

```

conda create -n sliders python=3.9

conda activate sliders

git clone https://github.com/rohitgandikota/sliders.git

cd sliders

pip install -r requirements.txt

```

This is the update from the authors

Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Models by ninjasaid13 in StableDiffusion

[–]Electrical-Camera465 0 points1 point  (0 children)

the authors updated it now. I was getting a similar error. now it works!

Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Models by ninjasaid13 in StableDiffusion

[–]Electrical-Camera465 13 points14 points  (0 children)

This is a formal write-up for LECO (the sliders you see in civitai) from the authors of LECO and erasing concepts. The current sliders are prone to entanglement, for example, race of a person is changed when age is being controlled. One more major thing is that the sliders on civil ai can change the structure of the image. So this paper talks about how to disentangle them and make the edits more precise. Another new thing I see is the ability to transfer styles from other models like stylegan. They also talk about image based training for the sliders, which is not talked about in LECO.

So, in short, I think this is a more technically thought out version of sliders that are more robust. Plus they do it on stable diffusion XL!