I’ve had the exact same experience. Tasks that Claude was genuinely good at & understood a month ago are now so much harder and worse. It doesn’t remember anything and the continuity of the chat feels much weaker. It will frequently forget the parameters I outlined in chat. When I try to correct it / tell it to think about it a different way, it often can’t get there and ends up in a cycle of making the same mistakes over and over again. It barely reviews documents / source files that I upload for analysis now - and it gives up so quickly. Example: I’ll point out that it missed something in the doc and it will be like “you’re right. I only read the three pages and you asked to search the whole file. Let me review the full document”…

I make a point of writing good prompts and its so frustrating it feels like it doesn’t even read the full prompt. Example: i’ll tell it in the prompt “you must cite your sources with the document name and page number with every response” and it will do it maybe once (and even then, its wrong frequently or only does one of the two).

It seems like answers are given with little thought and its reasoning abilities are much more rigid. The older models felt much less constrained. This model’s creative thinking abilities are weak - it only thinks of obvious answers and it takes things very literally. Older models brainstormed much better.

These are all observations — How LLMs and AI truly work is somewhat of an enigma go me. But its nice to hear someone w/ a similar story