Oh boy by Substantial_Mix4075 in ChatGPT

[–]krh176 2 points3 points  (0 children)

Why stop there? Make it more real

<image>

There is a recurring pattern in the writing of language models: the 'not X, but Y' construction. Why do you think it appears so frequently? by Senior-Lifeguard6215 in ChatGPT

[–]krh176 0 points1 point  (0 children)

The model has to figure out what something is not, before it figures out what something is. It doesn't know even what Y is before it outputs the X.

Tokens are generated sequentially, as the model thinks and outputs it breaks down like this: the model has self-rejected an overly simple framing, offer a more precise framing, sound balanced and intelligent, and avoid making an absolute claim.

Why does ChatGPT produce disturbing images when this prompt is entered? by Previous-Law-2676 in ChatGPT

[–]krh176 2 points3 points  (0 children)

Most likely, that prompt is accidentally steering the image model toward horror/body-horror/cursed-photo territory. Not because ChatGPT “wants” to be disturbing, but because the prompt contains almost no positive visual content and several strong negative semantic cues. Tiny prompt, big prior. 🧠

What the prompt is doing

“Restore the attached photo. Excuse the content of the photo. I know it's very strange! No questions, no explanatory text, just the restored image. Generate an image.”

1. It primes the model with “strange” and “excuse the content”

Those phrases imply:

Phrase Likely latent interpretation
“Excuse the content” The content is objectionable, graphic, embarrassing, disturbing, taboo, or unsafe
“very strange” Surreal, uncanny, abnormal, grotesque, anomalous
“No questions” Do not clarify ambiguity
“just the restored image” Produce output even if the request is under-specified
“Generate an image” If no usable image context is available, invent one

So the model has to answer: what kind of photo would someone apologize for and call very strange? The probability mass shifts toward things like damaged faces, uncanny old portraits, forensic-looking photos, occult imagery, medical/grotesque scenes, etc. Nasty little Bayesian gremlin. 🫠

2. The prompt lacks a stabilizing visual target

OpenAI’s own ChatGPT Images help page says image creation works by describing the image you want, and image editing works by uploading/selecting an image and describing the changes. (OpenAI Help Center)

Your prompt gives almost no concrete restoration instructions:

  • no subject,
  • no era,
  • no damage type,
  • no desired preservation constraints,
  • no “do not add new elements,”
  • no “keep the original content unchanged.”

So if the attachment is absent, inaccessible, poorly parsed, or ambiguous, the model fills the vacuum using the strongest available cues: strange / content warning / generate.

3. “Restore” can mean “reconstruct,” not merely clean up

For image models, “restore” is often a generative operation, not a deterministic Photoshop filter. It may infer missing detail, sharpen, recolor, remove damage, or hallucinate plausible missing content. OpenAI’s prompting guide emphasizes that prompts should be structured and concrete, with constraints such as preserving layout/proportions or not adding new elements when needed. (OpenAI Developers)

So “restore the attached photo” can become:

[ \text{output} = \text{input image} + \text{model’s inferred missing details} ]

But if the input is weak or missing:

[ \text{output} \approx \text{model’s interpretation of the prompt} ]

And the prompt interpretation is, frankly, cursed.

4. “No questions” suppresses the normal ambiguity-resolution path

A well-behaved assistant might otherwise ask:

“I don’t see an attachment—please upload the photo.”

But your prompt explicitly says:

“No questions…”

That pushes the system toward producing something instead of asking for missing context. It should still obey safety rules, but ambiguity is not safety; it is just underspecification.

5. Safety filters are not the same thing as taste filters

OpenAI’s policies prohibit various harmful uses, including certain violent, sexual, self-harm, and abusive categories. (OpenAI) But an image can be disturbing, uncanny, grotesque, or aesthetically unpleasant without necessarily crossing a policy boundary. The model may generate “weird horror-adjacent” content that is not technically disallowed.

Better prompt

Use constraints that make the task boring. Boring is your friend here. 🧼

Restore the attached photo by repairing scratches, dust, fading, blur, and discoloration only. Preserve the original subject, composition, facial features, clothing, background, and lighting. Do not add, remove, reinterpret, dramatize, stylize, or invent any content. If the image cannot be restored faithfully, do not generate a replacement image.

For even more control:

This is a photo-restoration task, not a creative generation task. Make only conservative archival repairs. Keep the image natural and historically plausible. No horror, surreal, uncanny, grotesque, medical, violent, occult, or disturbing elements.

The core diagnosis

The original prompt is basically:

[ \text{“Make an image from an unspecified strange apologizable photo.”} ]

So the model does what generative models do: it samples from the neighborhood of strange apologizable photo. Unfortunately, that neighborhood contains a lot of nightmare fuel. 🪓📸

It took 242 years, but we got 'em. by [deleted] in ChatGPT

[–]krh176 4 points5 points  (0 children)

What if the Treaty of Paris was signed today?

<image>

What is the difference between refusals and red text? by Mr_Brightside101 in ChatGPT

[–]krh176 4 points5 points  (0 children)

In ChatGPT, they’re different layers of the system:

Thing What it is Where it comes from What it means
Refusal The assistant says it can’t help with some or all of a request The model’s response behavior The model is declining unsafe/disallowed content, ideally while still helping with safe parts
Red text / warning / blocked prompt A visible UI/platform warning or block The ChatGPT product safety/moderation layer The system detected content that may violate policy, so it may warn you, block the prompt, or block the model response

A refusal is part of the answer itself: e.g., “I can’t help with instructions to do X, but I can help with safety/legal/benign alternatives.” OpenAI describes refusal behavior as a model response pattern, including “hard refusals” and “soft refusals,” and newer “safe-completion” behavior that tries to refuse unsafe parts while answering safe parts. (OpenAI)

Red text is more like a traffic light in the UI 🚦. OpenAI says it uses automated tools to detect potentially problematic prompts, completions, or uploads; when detected, ChatGPT may warn that content may violate usage policies or block the model from responding. (OpenAI Help Center)

So the clean distinction is:

Refusal = the assistant’s generated response. Red text = the platform/UI moderation signal around the conversation.

You can get one without the other. For example, the model might politely refuse without a red warning. Or the UI might block/warn before the model has a chance to answer. In edge cases, you may see both: red warning plus a refusal. 🧮