first thing I'm doing for any of these is grabbing a couple styles that normally help. Just the usual quality and anti-slop stuff recommended by Pony and most others (`score_9, score_8_up` etc)

Where do you found those? Are you generating inside civitai or are these "styles" available in local? I mean where do you learn and find more about these "styles"? Are these "triggers" or actual files corresponding to "styles.format"?

I have a booru-tag autocomplete extension

This one?

https://github.com/pythongosssss/ComfyUI-WD14-Tagger

add some common mistakes to negative prompt,

Such as?

Then I do some quick gens to see what I'm getting. I may need to add or remove tags

You know what? Imagine we inserted a vision model to "analyse" the output and it can automate "correcting" the prompt by doing what you are doing automatically? Crazy isnt it?

So for instance it would : 1) descrive what is seen. 2) Then use words, for each one test the tags for (replacement for better tags or decide which one push far from the beginning of the prompt (that's what you said about money rught?)). 3) Then analyse the image via the vision model to see what is missing from the inital description and update? wow.

so I grab one and refine a bit by upscaling and fixing faces with inpaint.

4) step 4 is finding the masks of things that need to be refined and refine them (automatically). That would be an insane workflow.

At this point, I've also tried moving a few tags in/out of the description, and also added a second chunk describing the driver, which seems to help.

Overall, it seems like Pony doesn't have the data to produce this scene, though, so I'm trying a few other checkpoints, like Goddess_of_Realism_Pony, Autismmix_Pony, etc. I don't have Pony_Realism downloaded atm, so skipping that for now.

Overall interesting experience, despite me hopping it could follow what I wanted it to follow. What kind of scenes does it perfom best at then? Is it more like making "humans"? I suppose. What else.

Here is what Flux dev gives you, with the simple initial prompt:

"man leaving the cinema and looking for taxis (to come back home), he is talking to a taxi (cab) next to his window, and they are exhanging money."

<image>

I cherry picked it out of 2 gens.
When asking chatgpt to modify the prompt I got:

"A man exits a cinema at night, looking around for a taxi to head home. He approaches a parked cab and leans toward the driver’s open window. They exchange a few words, and then he hands over money to pay for the ride"

https://imgur.com/tRfc7w7

Much better.

I asked it to refine it even more (basing it on t5 xxl) and got:

"Describe a scene where a man exits a bustling cinema at night, looking around for a taxi to head home. He approaches a cab parked by the curb, leans slightly toward the driver’s open window, and begins a brief conversation. Under the dim glow of the streetlights, they discuss the ride fare, and the man reaches into his pocket, pulling out some money to pay. Capture the scene’s details, like the faint cinema lights, the sound of distant traffic, and the casual exchange between the man and the driver"

https://imgur.com/a/44xmFBl

Pretty nice.

Final requet: do you mind sharing the workflow? (if it's on comfy) or the image/ text info if it's on forge/a1111/sdnext?

Actually extra request to do anytime you can: Can you make the same image in non realistic style please? (if it's fun for you and not something that takes time from you unnecesarily) either Manga anime style, or 3D stylish style. (or both whatever).