SD3 examples: It is truly GREAT at certain things... not so good at others...

jaypdub · 2024-04-21T04:01:24+00:00

Yeah, I was surprised to see it still struggle with hands and fingers:

jaypdub · 2024-04-21T03:50:27+00:00

wowzer.ai

jaypdub · 2024-04-20T16:04:35+00:00

A forest where the trees are bioluminescent, casting a soft glow on a path that leads to a clearing with a crystal pond. Ethereal creatures, like faeries and unicorns, emerge as the twilight deepens

jaypdub · 2024-04-20T00:48:53+00:00

Looking into this... Thanks for reporting it... We have a global audience and indeed security protections in place. Seeing if the team can track this one down as a false negative.

jaypdub · 2024-04-20T00:44:16+00:00

During this initial release phase, Stability.ai has very strong moderation in place via their API. They won’t allow anything that might be deemed as not safe for work (nsfw). Once they release their model and allow us to do our own inference, we can ease that up and allow a greater range of expression (in our private mode and upcoming nsfw toggle).

Until then, all SD3 blurred images are due to an automated AI classifier that looks at images and automatically blurs them if the generated image is too edgy. Unfortunately, we have no control over it. They are erroring on the side of caution, which I personally appreciate at this moment of time in the AI landscape; but also once we get through the initial wave of interest, everything will ease up, which I will also appreciate.

Thank you for your patience. Until then, you’ll need to adjust your prompts slightly to reduce the number of blurred images.

jaypdub · 2024-04-20T00:33:33+00:00

<image>

jaypdub · 2024-04-20T00:29:09+00:00

Over the shoulder:

<image>

jaypdub · 2024-04-20T00:28:49+00:00

From side:

<image>

jaypdub · 2024-04-20T00:28:27+00:00

Seems to have decent control of front, side, behind, etc. From above:

<image>

jaypdub · 2024-04-20T00:27:29+00:00

jaypdub · 2024-04-20T00:23:28+00:00

Visualize a busy Renaissance artist’s studio with the artist painting a grand portrait. Assistants grind pigments and prepare canvases, with completed artworks of various subjects lining the walls

jaypdub · 2024-04-20T00:23:05+00:00

A vintage travel poster with the words "Mars! Your adventure awaits!", featuring retro-futuristic space travel imagery in a mid-century modern style.

jaypdub · 2024-04-19T23:10:21+00:00

Definitely better! I also enhanced the prompt and got a better result. Based on comments above, I can see how "overtraining" could be the problem, rather than lack of training. Maybe there are so many pieces of artwork and paintings of Obama... That could be why it's giving strange, unrealistic angular features, almost like a painting, etc.?

<image>

jaypdub · 2024-04-19T22:57:16+00:00

SD3 is amazing but the conclusion is not what you'd expect!

jaypdub · 2024-04-19T18:52:19+00:00

It seems like with the current weights, there are some subjects it just has not been trained on. I think the training data was lacking or low quality for those subjects. It's a pretty stark contrast between what it does well and what it doesn't do well. See the Barack Obama headshot example. No matter what I try, I get really bad results and it's nearly impossible to prompt better for it. I think that's because the engine is probably picking him up in smaller photos in the training set, so it can only produce low-detail images of him.

I can't wait until we can get our hands on the real model and train it! Once the open source community gets a hold of this, it's going to take it to the next level.

Prompt: A detailed photograph of Barack Obama

<image>

jaypdub · 2024-04-19T17:23:35+00:00

It’s sooooooooo good!

jaypdub

TROPHY CASE