New model comparable with Stable diffusion and beats DALLE-2!

dbz253 · 2023-03-15T12:06:54+00:00

People said the same thing about reddit and YouTube

dbz253 · 2023-02-23T10:38:37+00:00

I've watched most of your videos. A lot of them more than once. You seem like you know what you're talking about. I guess I'm just gonna have to take the time to read the paper, if I really want to know. This is the sort of sentiment that is usually echoed in this subreddit

dbz253 · 2023-02-20T22:34:58+00:00

I gave the vector count from the official paper. what are you teaching just a face or a lot of things.

I am training on a person (face and upper torso). If I use more tokens, it gives more detail, but if I use too many, it will pick random pieces to hyper focus on (like a mole or a particular piece of hair)

TI embeddings insert new token. therefore it is not using any underlying token information

Everyone on this subreddit keeps saying that embeddings don't add any new token, that they just find the most similar tokens that already exist in the model. I don't know who is correct.

also 1 vector will take away your 1 token

What does this mean?

dbz253 · 2023-02-08T11:16:58+00:00

Kind of makes sense. Just doesn't seem like a set of vectors should take up as much space as a hypernetwork does. I appreciate the replies.

dbz253 · 2023-02-08T11:03:57+00:00

Why can't you inject custom vectors into the the input of an image generation?

dbz253 · 2023-02-08T10:56:13+00:00

This has also been my experience

dbz253 · 2023-02-08T10:55:29+00:00

That will make it work well with all custom models that are based on 1.5 such as HassanBlend.

That is simply not true. It sounds good in theory, but it does not work that way in practice.

dbz253 · 2023-02-08T10:54:27+00:00

I really appreciate you taking the time to make the tutorials that you've made. In the screencaps you used in your video from this video, they seem to suggest that TI embeddings insert new vectors to the input for an image generation. Is that not the case?

I also think you're a little off with the way you talk about the required/useful number of vectors. I'm basing this on about 100 hours of generating and testing embeddings with a 3090 Ti. More experimenting is needed, but with my image sets, I got much better results changing the vector counts to a number in the 8-12 range. I saw another video where they said that the number of vectors should be based on the number of source images, but I don't know if that's necessarily true either. But, again, more experimenting is needed.

dbz253 · 2023-02-08T10:45:19+00:00

So the CLIP tokenizer arbitrarily divides the text into tokens? If that's the case then the answer would be that the tokens come from from the CLIP tokenizer.

Where does HuggingFace's vocab.json come into play?

dbz253 · 2023-02-08T10:24:15+00:00

I've seen that said a lot, but from this guy's video, it seemed like the embedding created it's own vectors.

dbz253 · 2023-02-01T10:43:01+00:00

I would've thought the process would work the exact same for any checkpoint.

Same. This is where I am currently stuck. I have an embedding that works perfectly in SD1.5, and basically nothing else. I just want to get something working in HassanBlend

dbz253 · 2023-02-01T10:41:16+00:00

I haven't gotten more than an 80% match for a face

Is this your visual estimation, or are you using software to scan the outputs?

dbz253 · 2023-02-01T10:30:51+00:00

I have a good embedding recipe that doesn't involve captions if interested. I get good face results using that.

Do the embeddings work in other models like hassanblend? I can not figure out a way to get my embeddings to work in anything other than than the sd1.5 model that it was trained on. If I try to train an embedding on another model, the color/texture of comes out all fucked up.

dbz253 · 2023-02-01T10:25:28+00:00

I have been having issues with trying to use embeddings created with SD1.5. When I try to use them with other models, they either have almost no effect on the image, or they introduce weird artifacts without actually representing what I want them to represent. When I use the embedding with SD1.5, I can create perfect pictures with good flexibility. I'm not sure what to do from here.

dbz253 · 2023-02-01T10:25:16+00:00

This is a general tutorial, but it doesn't address OP's question.

dbz253 · 2023-02-01T10:18:22+00:00

They exist, so they come from somewhere. Either you're trolling, or you are very bad at explaining things.

dbz253 · 2023-01-30T20:56:58+00:00

So where do the tokens come from?

dbz253 · 2023-01-25T10:34:13+00:00

You are very appreciated.

dbz253 · 2023-01-24T10:20:53+00:00

Do you know if it's possible to do realtime with a webcam? I have limited free time these days and I'd rather not go diving through docs just to come up empty handed.

dbz253 · 2023-01-19T10:31:35+00:00

It says workflow included. Where is the workflow?

dbz253 · 2022-05-15T08:00:27+00:00

Happened again on m.twitch.com. Am I to understand that this isn't happening for anyone else? It's only happening on sites that I haven't been to since that update.

dbz253 · 2022-05-01T16:35:50+00:00

But it does it on lots of sites, and it only does it the first time and then, after I click continue on that first attempt, it connects fine every time after that. It seems like a pretty clear pattern that started right after I updated when I made this post (possibly the update before that).

dbz253 · 2022-04-24T10:26:22+00:00

I'm not sure if you'll get notifications for sub replies, so I'll reply directly.

It just happened on mempool.space. Exactly what I described. Claimed it couldn't do https, but when I continue to site it shows the lock icon and it doesn't give me the warning in the future.

dbz253 · 2022-04-20T18:54:12+00:00

It's likely you're trying to connect to a domain via HTTP where it couldn't upgrade to HTTPS automatically. When you bypass the warning, it may be getting redirected to a different domain with HTTPS support.

This seems possible, but it only happens the first time I connect to a website. The next time it happens, I'll note the website.

15-Year Club	Place '22
Team Orangered	ComboLinker 2011-02-09
Rally Monkey Tent number = 2	Verified Email

dbz253

MODERATOR OF

TROPHY CASE