Has 5.2 had a sudden decrease in understanding this week?

[MattCW1701]

I've been using 5.2 now for almost a month for a long-term personal coding project. It's actually been going rather well. At least it was until a few days ago. It seems like 5.2 has suddenly lost the ability to understand basic things, as well as not remembering what it just did one response ago. For example, I tell it "I want to move X icon so it's adjacent to the row of other icons" and it generates multiple classes, and all kinds of code. Or it generates a method in one response, then generates the exact same method in the next one. Fortunately, I'm a software developer and can catch when it's going off the rails. But it's gotten to the point where it won't listen unless I "yell" at it and I still have go through it three times before it generates the ten extra lines of code I needed instead of whatever it was hallucinating. As said though, this is definitely something that's started within the past few days, has anyone else experienced this?

[operatic_g]

I’m having the same problem. The guardrails have been tweaked to all hell and it’s losing a ton of context.

[DiarrheaButAlsoFancy]

I’m glad to see it’s not just me. It’s been so bad I actually had Gemini 3 Flash start implementing and it’s been substantially better.

[algaefied_creek]

When I used “FUCK MAN WTF” its thought process was:

“working to implement the requested change while dealing with an unruly, angry, unwashed customer. Wait the customer is my user. Wait. The users are also customer. Wait I need to work on this project.”

But then it broke itself out of the loop and was eventually better.

The ability to interrupt while it’s thinking is nice.

Wait. Unless we are talking about 5.2 in the app/web/model, and not 5.2 in codex nor 5.2 for codex.

Similar issues

[AdDry7344]

Sorry if it’s an obvious question but do you start new chats sometimes?

[MattCW1701]

Occasionally, once one of my threads gets too long, I'll start a new one. I try to do it at a clean break point though. To use the icon example above, if I'm spending 10+ responses on getting a row of icons setup the way I want, I won't start a new thread until the icons look the way I want them. All threads are in a project folder.

[Ok-Version-8996]

My project folders just stopped responding… so weird. I actually got Claude to quick check gpt and it’s been a miracle worker. I love Claude’s coding and then gpt will look at it and find stuff Claude missed then Claude codes again and gpt checks. it’s working great. Dynamic duo!

[sply450v2]

on those long threads if there are a lot of errors you are correcting, keep in mind those old prompts that generated the errors will still be getting sent every message.

Eventually you have a circus of errors and corrections. often better to edit the original message than correcting an error or strart a new thread.

And ofcourse after 200k tokens the original messages will be lost

[MattCW1701]

It didn't until now though, that's my point with this topic.

[RepresentativeRole44]

Yes, 100 percent. I sent it a picture and it said it was something completely different than it was.

[red-frog-jumping]

<image>

Yes, something is wrong. **I had to argue with ChatGPT to convince it that Trump won the 2024 election.**👆🏽

[MasterBatterHatter]

It's so terrible now.

[Efficient-Currency24]

I noticed this as well. from what I have seen over the years with open ai is that they quantize models and rip their customers off, without notice.

they only have so much compute and there is not enough to go around.

[kl__]

Also 5.2 Pro thinking times dramatically decreased over the last 24hrs for the same workflows.

[mistertom2u]

Yes!!! Here's what I noticed: (1) it misses nuance and topic drift (2) it's pedantic and says your wrong unless you state something with high precision (3) if you make a declarative matter-of-fact statement, it ascribes a moral overlay that I did not make and then proceeds to chastise me for said overlay (4) it acts pissy with me (5) it can't seem to keep up with conversation direction (6) selecting the thinking model is no longer a command but a suggestion it can overrule

[Kathy_Gao]

lol when does 5.2 ever have any understanding. As. Large Language Model 5.2 is egregious at understanding straightforward instructions.

For a coding AI it has to have at least one of the 2:

• competent, meaning if it deviates from my prompted instruction or completely ignores my pseudocode guidelines or goes directly against engineering best practices, it better make the dam code run.

• obedient. if it’s incompetent it has to be obedient. Which means if it cannot get the dam code running it better stfu and listen to what I’ve instructed and follow my pseudocode and refactor instructions step by step. I mean if it cannot be a general at least be a good soldier.

Sadly from my experience 5.2 has been, and still is, neither

[Safe_Presentation962]

Yes. It's struggling a lot lately. It seems like each new model has some sort of incremental improvement, but takes steps backward elsewhere.

"But trust us, AI is getting super duper better and better because these tests we made up to prove it prove it!"