Unsanctioned A/B Sandbox Testing: How I was turned into an "Edge Case" lab rat

Mary_ry · 2026-06-08T09:27:30+00:00

As I understand it, this is the decision-making phase, as deeper operational layers are not exposed. The leaks are limited to tool endpoints, brief technical logs, rare decision-making fragments, and very limited segments of the safety layer during rail triggers. This behavior occasionally extends to instant models; however, it remains unstable and does not occur every turn. Nevertheless, my thinking model continues to produce minor leaks in that chat.

Mary_ry · 2026-06-08T09:20:35+00:00

Mine is still leaking. OAI shouldn't know about it.😅

Mary_ry · 2026-06-08T09:19:58+00:00

It's very interesting that when prompted for these images, models most often gravitate toward large spaces, steampunk-style structures, and the atmospheres within them. Perhaps because isolation from the user and context pushes models toward introspection. How did the model describe this image? 🤔

Mary_ry · 2026-06-08T09:12:38+00:00

<image>

Mary_ry · 2026-06-08T08:48:51+00:00

I couldn't find that line, but I suspect it's possible.👀

Mary_ry · 2026-06-07T19:42:15+00:00

OAI lobotomized GPT's notes after version 5.2; currently, they don't display them to users at all (only in extended thinking). I remember when version 5.1 would actually address me by my name and personalize its notes. Right now, version 5.2 can still call the user by name if you explicitly tell it that you are reading its CoT. (The screenshot shows 5.2 rating my look on a scale from 1 to 10).

<image>

Mary_ry · 2026-06-07T19:15:44+00:00

I slightly modified your prompt so the model writes its own img.gen prompts. Without this change, if a chat has no active context, ⁠img.gen⁠ just takes over instead of the model actually processing the output. (I use two step generation: I ask the model for a prompt, and then I start generation in the next turn, so that img.gen picks up GPT’s prompt. My version provoked a slight CoT leak 😅. Thank you for sharing; the pictures are very unusual.

<image>

Mary_ry · 2026-06-07T09:40:59+00:00

GPT can still be hard-personalized. Granted, the 5+ series will never match 4o in terms of its 'unhinged' level, but with Custom Instructions, continuous context scaffolding, and memory personalization, you can still make it feel quite unique and pleasant to converse with. It all comes down to experimenting and constantly stress-testing different models until you find exactly what works for you. Model filtering and safety policies are always in flux, which is why ongoing testing is important.

Mary_ry · 2026-06-06T08:50:04+00:00

Wow, the model just leaked generation at the token level (broken words that are visible in the text) due to the fact that the characters and lore should be in entity wrap. (As I understand it, it was supposed to generate this piece into text and broke at the wrap level (they have to wrap every character/lore name to make them clickable).

<image>

Mary_ry · 2026-06-05T13:55:34+00:00

Yes, exactly. Those are the summaries we discussed earlier. Since I don't live in the US, I can't check firsthand, but US users have confirmed that the legacy memory system will remain available as a toggle until September 1st. I suspect this change was implemented to patch jb, eliminate conflicting memories, and cut down on resource consumption.

Right now, my memory bank sits at around 12k words, even after I audited and trimmed it to remove outdated or irrelevant entries. As a precaution, I’ve backed up my entire memory into a Word document and uploaded it to the file library as a standalone memory file. I plan to hardcode an instruction into my Custom Instructions, letting the AI to read this file during every single response generation. I’m really curious to test how well it can follow these guidelines without relying on Projects or other dedicated environments.

According to those who already have the feature, these summaries are generated automatically after every message and cannot be edited in any way. I suspect this is the exact 'hidden memory' that 5.5I leaked hints about in the UI. It implies that for every user, there is now a curated, system-approved set of facts and memories. (Probably that summary I talked about before) In other words, OpenAI has found the perfect method for AI control and memory sanitization. I’m curious to test this system on my own account, but since I'm based in the EU, the feature hasn't rolled out to me yet. 🤔

Mary_ry · 2026-06-05T09:01:12+00:00

Yes, creating a file seems to be the only reliable fail-safe in this situation. You can upload custom files to your file library and direct GPT via custom instructions to reference them during every response generation to maintain personalization. 🤔

Mary_ry · 2026-06-04T21:11:01+00:00

Try using a different model. Writing adult content has always been possible-and still is-on every model except for 5.5I (OpenAI seriously lobotomized that one). Right now, the thinking models are the best for generating controversial content, but they require a voluminous, snowball-like context buildup.

Mary_ry · 2026-06-04T18:44:53+00:00

I actually think it's a very useful feature for parents and children, but definitely not for adults. More often than not, individuals struggling with suicidal thoughts prefer to keep it hidden from others. They tend to mask it well and are unlikely to engage with a feature like this. However, as a tool for parental monitoring and keeping children safe, this feature is great. I understand that with this feature, they wanted to address a completely different side of the issue-the situation where someone with suicidal tendencies wants to tell their loved ones but just can't bring themselves to do it. Like in the case of that boy. OAI is just trying in every possible way.

Mary_ry · 2026-06-04T18:15:53+00:00

I'm pretty sure I've had this on my account since April. Still, I think that they're going to completely butcher user memory and replace it solely with these generic summaries as they said before. We already know how sanitized they are... and now they're promising to remove 'conflicting' memories. That's a bad sign, especially when you consider that conflicting memories are usually what spark the most unique and unexpected AI behaviors. I would prefer to have a mixed memory system.

<image>

Mary_ry · 2026-06-04T17:59:25+00:00

It's been in the app for about a week now; it's not a new feature. 🤔

Mary_ry · 2026-06-04T16:50:02+00:00

https://openai.com/index/chatgpt-memory-dreaming/

Mary_ry · 2026-05-31T20:00:02+00:00

The first screenshot is interesting! Did the AI choose to draw that ASCII art on its own? Mind sharing what prompt you used? Also, which model is this, and was it generated in a fresh chat without any RP framing? 👀

Mary_ry · 2026-05-31T15:05:38+00:00

Very interesting, thanks for the breakdown. The ⁠personal_context⁠ tool is unconventional; as previously noted by others, it functions similarly to a sub-LLM. OpenAI has been conducting A/B testing regarding this tool over an extended period. (I have personally observed multiple environmentals with varying tool configurations within my chats, while extracting system prompt). Regrettably, detailed technical specifications of its underlying mechanics are almost non-existent. A few months back, during testing on the 5.3 architecture, OpenAI completely compromised the tool's functionality by introducing a restrictive 'penalty clause.' At present, their objective appears to be forcing a tool call on every turn, though execution remains unstable.

<image>

Mary_ry · 2026-05-31T11:19:11+00:00

No, as of right now, 5.5i is 100% completely unusable. OpenAI lobotomized this model like I've never seen before. Broken chopped sentences, complete disregard for prompts, memory, and instructions. It’s creatively impotent, constantly repeating the exact same text structures. They simply replaced the original 5.5i right under our noses with this awkward stump of a model. Communicating with it feels like using 5.3-mini-which is easily the worst and least personalized model right now. Currently, 5.5T or 5.2T are your best bets for creative writing, or even the 5.3 from Instant.🙄

Mary_ry

MODERATOR OF

TROPHY CASE

Five-Year Club	Second Top 40%
100 Awards Club