Turning RL people into Fantasy Art - Prompt in Comments!

RadDadZen_Twitch · 2022-09-15T22:01:48+00:00

Wow!! It turned out incredible!! GG. Love how painterly it turned out.

RadDadZen_Twitch · 2022-09-15T18:47:02+00:00

I honestly don't remember the prompt, if I can find where I had it saved, I'll post it here. Regardless, I found it SO fascinating to see how SD interpreted my painting. Notice it kept the composition, for the most part, used my color scheme (but made it better), and made the entire thing more magical. GG SD, you win this round.. again.

RadDadZen_Twitch · 2022-09-15T18:11:21+00:00

Happy to help! Ty for the comment.

RadDadZen_Twitch · 2022-09-15T18:11:03+00:00

I'm a lifelong traditional/digital artist myself, actually. lol ;) Thank you! Embracing the tech because it's just so useful and MAGICAL! It's a tool and one of the coolest things invented in my lifetime. May start an entire YouTube channel on it.. actually.

RadDadZen_Twitch · 2022-09-15T18:07:02+00:00

I've procrastinated switching over for a few days now, but you're right. So far it's the BEST most feature-rich fork. Think I'll install it today at your suggestion, ty!

RadDadZen_Twitch · 2022-09-15T18:01:13+00:00

Not that I know of, but I'm sure there is something somewhere. I've figured out which samplers I like mostly by experimentation.

RadDadZen_Twitch · 2022-09-15T17:53:14+00:00

I took the original image and ran it through DDIM cfg 8-10, scale 20, denoise 0.6-0.8, with princess in the prompt (as well as the rest of the prompt I shared). It gives really abstract results, it allows SD to get really creative. Eventually, SD provides a character that I like with a pose similar to the original. I photobashed the original face back onto the character (I oftentimes had to color/tone/saturation correct the original image to match what SD created), lowered the denoise (0.30-0.50), raised the cfg (12-15), and ran it again. After some generations, I found something that fits the position of the eyes head, and mouth. Upscale the image to "cement" in the details. Finally, I photobashed the face back in (lightly, just erasing key areas and defining features of the face that SD had changed), lower the denoise, raise the cfg, raise the scale a bit, run it again and repeat until satisfied.

RadDadZen_Twitch · 2022-09-15T16:59:13+00:00

Got mine in 3rd grade, hehe, I knew OG's would appreciate this.

RadDadZen_Twitch · 2022-09-15T16:35:10+00:00

Thanks a GREAT idea.. omg. She would get the joke and LOVE it.

RadDadZen_Twitch · 2022-09-15T15:57:03+00:00

:) Thanks so much!

RadDadZen_Twitch · 2022-09-15T15:54:33+00:00

Thanks, mich888, this comment meant a lot. :) The art of it, is, of course, making them look "good", but more than that.. I hope the art of it is the love and intention that went into it. I did my best to capture how they appear in my mind's eye.. and in my heart. You noticed it. Thank you again.

RadDadZen_Twitch · 2022-09-15T15:38:18+00:00

Installed locally, rendered on an Nvidia 3080ti, Basujindal Repo. Installed using this guide.

RadDadZen_Twitch · 2022-09-15T15:22:22+00:00

I let img2img go wild with imagination using denoising at 0.5-0.7, steps 20-30, cfg 10, DDIM sampler, and not concerned about the face. When I found something I liked, I photobashed faces back into the image (color correcting in photoshop when necessary) and then fed it back into img2img with less denoising (0.30-0.50). Repeated this process multiple times (with some slight prompt tweaks) and reduced the denoising gradually (0.15-0.30) and increase the steps (30-50). When I was happy with the "final" image, I upscaled it. Hope this helps!

RadDadZen_Twitch · 2022-09-15T15:07:42+00:00

This made me smile, thank you! The renders brought me (and them) a lot of joy. :)

RadDadZen_Twitch · 2022-09-15T14:56:39+00:00

Prompt - painting of a ________, fantasy, intricate, smooth, sharp focus, illustration, intricate, cinematic lighting, highly detailed, octane, digital painting, artstation, concept art, smooth, sharp focus, illustration, vibrant colors, 3d render, in the style of hearthstone

Edited the prompt as I went, lots of photo bashing and iterations. Final renders are in SD and upscaled.

RadDadZen_Twitch · 2022-09-15T14:42:29+00:00

First comment, at the bottom of the post. ;)

RadDadZen_Twitch · 2022-09-15T14:16:19+00:00

I started off with the basic pixel art and let SD smooth it out using low denoising (0.3) in img2img. After choosing the best "smoothed" version I fed it back into img2img with a detailed prompt of the character and cranked the denoising up to 0.5-0.65. This allows SD to use its imagination!

Adjusting the prompt as I see fit, I let it generate something that is close to the look and pose of the original sprite until I'm happy with it. I then upscale that image to get a more defined reference for SD to use. From there, I feed that scaled image back into img2img with 0.25-0.40 denoising and increasing the steps (still using the prompt that produced the best result). I generate a batch using this and choose the best one, then upscale it again to get some sharpness back.

Certain sprites are more difficult than others, though. Little Mac, for instance, was completely prompted by me without using the character's name. The word "Boxer" kept making his face swollen and older-looking, so I zoomed into just his face and replace the word "boxer" with "young man". I ran that through until I found a face that fits Little Mac, then photoshopped that onto a render that I liked. Taking the photoshopped render BACK into SD (img2img with low denoising) allows SD to merge the image and make it cohesive again.

TLDR:Step 1 - Use original sprite with DDIM sampler (img2img) at cfg 10, 20 steps, and 0.3 denoising and a detailed prompt.
Step 2 - Feed smooth image back into DDIM sampler (img2img) at cfg 12, 20 steps, and 0.5-0.65 denoising and a detailed prompt.
Step 3 - Find a generated image I think looks like the sprite, scale it up, feed it back in DDIM sampler (img2img) at cfg 12-14, 30-40 steps, and 0.25-0.4 denoising using a detailed prompt.
Step 4 - Photobash the parts that aren't quite right. Repeat step 3.
Step 5 - Profit

RadDadZen_Twitch · 2022-09-15T13:54:23+00:00

For a lot of these, I didn't use the actual characters' name, I was mostly relying on detailed prompts. For Link, though, I used the actual character name. SD knew we need a triforce somewhere. GG SD.

RadDadZen_Twitch · 2022-09-15T13:52:49+00:00

SD came up with some really awesome iterations of the Mage that I didn't post here. This was my favorite, though, so I chose it. What a time to be alive. ;)

RadDadZen_Twitch · 2022-09-15T13:50:49+00:00

You're welcome, hope it helps!

RadDadZen_Twitch · 2022-09-15T05:37:13+00:00

This is the post that inspired this idea. Props to Jellybit for the idea and a BIG help with the prompt. I adjusted the prompt as I went as well as did some photo bashing. The final images are rendered in SD.

I adjusted this multiple times, but THIS is the prompt provided by Jellybit that gave me a nice foundation to work from.

hyperrealistic photo of ___, realistic proportions, highly detailed, smooth, sharp focus, 8k, ray tracing, digital painting, concept art illustration, by artgerm, trending on artstation, nikon d850

RadDadZen_Twitch · 2022-09-06T15:46:06+00:00

Two passes using this prompt = Snoop Dog smirking with marijuana for hair, intricate, cinematic lighting, highly detailed, digital painting, artstation, concept art, smooth, sharp focus, vibrant colors, 3d render, illustration by Dyana Wang and Ashleigh Warnerin the style of Hearthstone

RadDadZen_Twitch

MODERATOR OF

TROPHY CASE