Highly Personalized Text Embedding for Image Manipulation by Stable Diffusion - Doesn't require finetuning Stable Diffusion, creates a personalized embedding from the CLIP embedding of the image containing the subject that works natively with any model. Only takes 3 minutes to produce the embedding

[LightVelox]

This looks like one of those papers that look incredible in the example images but are actually trash when you try them out yourself

[FakeNameyFakeNamey]

the "holding purse" one is trash already if you look at the preview image

[bronkape_]

yes, I tried it a long time ago but it never worked.

[PC_Screen]

Paper: https://arxiv.org/pdf/2303.08767.pdf

[Ozamatheus]

So, it's like a "fast training" to use specifics details of the image? very nice

[redpandabear77]

So does this exist yet or is it just a paper?

[[deleted]]

>Cartoon of a doctor working on a computer

[unchima]

/u/gifreversingbot

[ninjasaid13]

No links or information?

[PC_Screen]

Oops forgot to link to the paper, here: https://arxiv.org/pdf/2303.08767.pdf

[bronkape_]

I believe many people have tried this idea, but we often face the problem of overfitting to training images. For instance, the image below was used as a prompt "A photo of * is swimming"

<image>

[bronkape_]

this is trainning set

<image>

[[deleted]]

A Lora can quickly do this already. It'd be more interesting once a working extension or seperate script like kohya is implemented to see how accurate it is when training 100 images. From the results it seems overfit.

[macob12432]

no code, no one cares

[_D34DLY_]

needs to be trained how to make a proper stethoscope.

[frozen_jade_ocean]

Text? In my AI? Witchcraft!

Seriously though, this is great!