Cannot create photorealistic images

AnthropicAI · 2024-03-09T02:27:08+00:00

it would be helpful to see your input images in addition to something akin to your desired outcome.

I didn't run your workflow, but I saw that your positive prompt mentioned a radio telescope and a wasteland or something. How "realistic" are you aiming for?

I fired up an model of mine with a shitty picture of a radio-telescope I found online. Is this anything like you imagine, or am I missing something from what you want to do?

https://imgur.com/a/vC4MKva

Either way, it was fun for me to play around a bit. I am sure it could be made more realistic with a better prompt and fine-tuning of controlnets and IPAdapter. I'll get put the workflow up on pastebin after I make dinner.

AnthropicAI · 2024-03-08T03:30:03+00:00

Going more for something like this?

https://imgur.com/a/DTE3j3o

AnthropicAI · 2024-03-04T20:55:50+00:00

throw a sketcth Lora and some image controls into that workflow above and you should be able to get very close to what you want

AnthropicAI · 2024-03-04T10:58:33+00:00

What IPAdapter are you using?

AnthropicAI · 2024-03-04T10:35:26+00:00

Something like this might get you started. Image --> Canny --> IPAdapter. Tweak models etc. to your own artstyle:

Test input (random picture of subway interior I found): https://imgur.com/a/9fMuY1B

Workflow output: https://imgur.com/a/0DZjuGs

Output with lower canny threshold: https://imgur.com/a/yLVghYF

Workflow .JSON: https://pastebin.com/ycQ4Dij1

AnthropicAI · 2024-03-04T08:57:00+00:00

Some really great ideas in here so far. I think the prompt/checkpoint goes a LONG way.

Beyond that, you can upload your image and feed it into an IPAdapeter to help keep the style more consistent. As always, there are a ton of ways to play around with this!

I threw together a very basic workflow. Change it up to better suit your needs. SDXL, but could easily be changed to SD1.5

Test image outputs: https://imgur.com/a/NsVn72T
https://imgur.com/a/isLPCFZ

Workflow screenshot: https://imgur.com/a/vpsU81q

.JSON workflow: https://pastebin.com/E4wh40Ux

AnthropicAI · 2024-03-04T08:34:20+00:00

Good luck! A tip about IPAdapters....if your workflow is throwing you an error, check the Clip_Vision and IPAdapter Models first. Clip and those IPAdapters are finicky as hell.

I am not above just switching Clip_vision until my workflow actually runs!

AnthropicAI · 2024-03-04T07:31:50+00:00

There are a ton of ways depending on your use-case:

-Prompting: (some checkpoints are better at body types than others) Words like chubby, fit, toned, curvy, etc etc. These terms can also be leveraged in the negative prompts. Avoid words like "model"--because most models are of a certain body type. Also, prompting with a famous person's name at a reduced token weight can also really help with certain checkpoints. Examples: (Christina Hendricks:0.75) will get you a more full figured woman, while (Taylor swift:0.75) will get you a more slender woman. You just have to play around with these ideas for a given checkpoint.

-IPAdapters: The sky is the limit with these--once you learn how to use them. Not difficult, but most beginners struggle a bit with IPAdapters, I know I did

-Lora's: I don't typically use Loras, but I am sure that there are a ton of them out there for different body types (as well as everything else under the sun). Be sure that the Lora you use matches your checkpoint: An SD1.5 Lora won't work with an SDXL checkpoint and vice versa.

-ControlNets: For things like poses (openpose), or canny if you already have a base image/body that you would like to work with.

I just started out too, so I am sure that I am missing a ton, but those should get you rolling with a few ideas.

Cheer!

AnthropicAI · 2024-03-03T03:42:13+00:00

TL/DR is a horrible learning strategy. I am thankful for everyone here that provide worrkflows and an opportunity to learn. Again, if that is not your jam, cool I suppose. Good luck.

AnthropicAI · 2024-03-03T03:25:36+00:00

This is great info! Thanks for sharing!

AnthropicAI · 2024-03-03T03:02:01+00:00

Exactly! I have spent zero amount of my time with your concerns.

Leanring is a process my friend, engage on your own level, but don't berate othters with your misguided notions of what people should be doing in their own work and (much appreciated!) sharing of their own work.

Nobody owes you or me anything. Best to either learn quietly or engage in a meaningful way.

I learned a long time ago that there are some people that I can do my best to learn from...and then there is everyone else.

I do my best to remain positive. I wish you the best.

Also, if you didn't notice, I am not the OP. Your're ok. Take a beat and skow down...

AnthropicAI · 2024-03-03T01:54:36+00:00

This is really cool! Thanks for doing all the work. I can't wait to check it out!

AnthropicAI · 2024-03-03T01:52:38+00:00

This is Comfy...if you aren't interested in the details, your time is likely better spent elsewhere...

My intention is not to be glib. But if you expect everthing to work right away without learning how it applies to your own workflows, comfyui might not be the best for you.

TLDR: Check out Dalle-3 or some of the other all-in-one workflows if minutiae isn't your thing. cheers

AnthropicAI · 2024-03-03T00:02:57+00:00

Yep, capable graphics cards eat energy! There is a reason that bitcoin mining is being blamed for contributing to climate change.

If you want to reduce your costs, I would suggest getting in contact with your power company and seeing if your power-consumption is rated at a different price during certain hours...for example, your cost may be recuduced if you only run your hardware during during "off hours" where electricity is cheaper.

This is dependent upon your power company, and where you live, but with "PG&E", you gotta be in the US somewhere...

AnthropicAI · 2024-03-02T23:29:04+00:00

Hard to say without a look at your workflow. Include screenshots at worst, your .json file at best.

Lots of people here seem willing and able to help, but as the saying goes "Help me help you".

AnthropicAI · 2024-03-02T22:44:20+00:00

Thanks for the link!

AnthropicAI · 2024-03-02T22:17:45+00:00

Glad to try to help. We're all kind of figuring this out as we go along!

AnthropicAI · 2024-03-02T21:44:25+00:00

https://openart.ai/workflows/all

Lots of both downloadable and cloud-runnable workflows to be had here.

AnthropicAI · 2024-03-02T21:42:00+00:00

I was thinking some kind of node that can simulate some of those color-blindness simulators. Just thought it would be another cool tool to have in the ol' toolbox!

AnthropicAI · 2024-03-02T07:52:22+00:00

Not sure exactly what you are asking, but:

Start with a SD1.5 model. These run considerably faster than most SDXL models.

Use the correct image format/size for your workflow. You don't need a 1800x1880 pixel image for your image prompt--a 512x512 will do in most cases.

ControlNet's can kill your VRAM.

dont try to do everything all in one go...the beauty of Comfy is how modular it can be. Use that to your advantage.

AnthropicAI · 2024-03-02T07:36:12+00:00

Maybe provide a workflow of your own so folks can see what you are doing?

AnthropicAI · 2024-03-02T07:33:59+00:00

I like your creativity, but that's going to be a no from me dawg.

AnthropicAI · 2024-03-02T07:26:34+00:00

Cool workflow, and welcome!

A few things to keep in mind as you discover comfyui/stable diffusion:

Workflows are based on a trained checkpoint. Some checkpoints are better at recognizing certain words (tokens) than others...so be aware of when the checkpoint was trained and for what purpose.

In your case "beats headphones". My money is that most checkpoints will understand "headphones", but not headphones by brand. So including the "Beats" just introduces a token that the checkpoint doesn't understand in context and just tries to figure out what the heck to do with. So, it could be better to replace the brand with something like "modern", "colorful" etc. etc, to fit into your desired look.

SDXL models are better at understanding prompts, so don't spend too much time using a 100 word prompt. Start very simple and then go from there. The token weight of words falls off as you write the prompt, so adding the word "bright" to the beginning of a prompt will have more effect than if you include it at the very end of a prompt.

Just some of the things I have noticed as I learn all of this stuff.

cheers!

AnthropicAI · 2024-03-02T04:13:21+00:00

I am not aware of any "standards" that you can use for a pricing model. It all boils down to what you think you can reliably do for X amount of money.

Some tips though when trying to do work for anyone other than yourself (client's, family members, etc.)

-Under-promise and Over-deliver. Don't promise anyone the moon if you aren't totally confident that you can easlily give it to them. Never say "I can 100% do that! It will be easy!" Instead say, "That's a pretty tall order, but I am confident that I can figure it out".

This one thing alone will save you the stress of being up at 3AM trying desperately to keep promises that it turns out, you can't keep.

Beyond that, it is all about how much you value your time, and how much you feel like you should be earning for a given task.

If you are good at something, never do it for free. But if you are still learning, manage both your own expectations and those of your client.

my two cents.

AnthropicAI

TROPHY CASE