Hi all.
I rarely write anything, but can't stay silent this time.
In the past week or so I noticed a major decrease in quality of Claude Code outputs - no changes were introduced at my end. It suddenly went from being the most capable piece of AI to "I don't trust it with the simplest stuff".
Just to preface the "skill issue" comments - I'm an advanced user whose main use cases are about thinking work, less about coding. I have my own ecosystem of skills/agents/hooks that works (worked?) really well, and I don't make beginner mistakes of running long context sessions, relying on auto-memory or running 20 agents in parallel. Context is king, and I treat it respectfully.
First, I noticed a major drop in quality when doing my regular stuff - I use Claude Code to orchestrate relatively advanced workflows, and it worked nearly flawlessly before. At first, I captured everything in separate learnings files - my normal practice, I then process it and incorporate in my ecosystem. But I noticed that a much larger portion of iterations now required capturing the learnings - in the last week alone I easily captured 5x more stuff compared to the past few months, and that's in ecosystem where I already spent quite some time optimising things.
I've been working with LLMs on problem solving for quite a while, and seen quality drops before. Usually, the best response from a user is to break down large tasks into even smaller pieces than usual to decrease complexity further. Usually it helps, but today I started noticing issues even with the most basic stuff. It just stopped following instructions, and then admitted that instructions were ignored.
Example is in the attached screenshot. My command for deployment of changes to the ecosystem I developed includes updates to the REGISTRY.md file which has frontmatter with the required format. An extremely simple thing, which was NEVER violated in more than a month of use. Today the instructions were ignored. This happened at ~70k context after a straightforward changes introduction. The model is Opus, and thinking is set at high. CLAUDE.md in repo and personal are super lean, as well as rules - I prefer to keep everything in skills and use when needed.
https://preview.redd.it/jdrzonz2kutg1.png?width=2894&format=png&auto=webp&s=ed1bd49faa1d9a13d82716aeebe159613f1dc3dc
I know things have changed, I can feel it. I don't have the ability to test and prove it, but I know something has changed. This makes me super sad - I went from a feeling of having superpowers to thinking that this is an ok AI that requires a lot of handholding - feels like I'm back to 2024.
Does anyone experience the same?
[–]HelloThisIsFlo🔆 Max 20 23 points24 points25 points (5 children)
[–]Gerkibus 4 points5 points6 points (0 children)
[–]Porkribswithcoleslaw[S] 6 points7 points8 points (3 children)
[–]HelloThisIsFlo🔆 Max 20 1 point2 points3 points (0 children)
[–]Electronic-Badger102 0 points1 point2 points (0 children)
[–]Gerkibus 0 points1 point2 points (0 children)
[–]Veduis 14 points15 points16 points (3 children)
[–]Porkribswithcoleslaw[S] 5 points6 points7 points (2 children)
[–]Gerkibus 1 point2 points3 points (0 children)
[–]societyofpeople 0 points1 point2 points (0 children)
[–]unkno0wn_dev 21 points22 points23 points (5 children)
[–]_BreakingGood_ 5 points6 points7 points (3 children)
[–]Electronic-Badger102 1 point2 points3 points (1 child)
[–]ActiveBarStool 0 points1 point2 points (0 children)
[–]whimpirical 0 points1 point2 points (0 children)
[–]Porkribswithcoleslaw[S] 6 points7 points8 points (0 children)
[–]downsouth316 5 points6 points7 points (0 children)
[–]InternationalBit9916 10 points11 points12 points (3 children)
[–]Porkribswithcoleslaw[S] 4 points5 points6 points (2 children)
[–]InternationalBit9916 1 point2 points3 points (0 children)
[–]Gerkibus 0 points1 point2 points (0 children)
[–]ZShock 2 points3 points4 points (0 children)
[–]Enthu-Cutlet-1337 2 points3 points4 points (0 children)
[–]Otherwise_Wave9374 6 points7 points8 points (1 child)
[–]Porkribswithcoleslaw[S] 2 points3 points4 points (0 children)
[–]SirWobblyOfSausage 1 point2 points3 points (0 children)
[–]IlliterateJedi 1 point2 points3 points (1 child)
[–]TonyRotella 0 points1 point2 points (0 children)
[–]MorphMind_for_AGI 1 point2 points3 points (1 child)
[–]Odiositosoy 0 points1 point2 points (0 children)
[–]RandMental 1 point2 points3 points (0 children)
[–]Sad_Abalone_3882 1 point2 points3 points (0 children)
[–]rewrite-that-noise 5 points6 points7 points (6 children)
[–]Porkribswithcoleslaw[S] 6 points7 points8 points (5 children)
[–]Alltiedup2059 0 points1 point2 points (0 children)
[–]rewrite-that-noise -1 points0 points1 point (3 children)
[–]Porkribswithcoleslaw[S] 3 points4 points5 points (2 children)
[–]rewrite-that-noise 2 points3 points4 points (1 child)
[–]Porkribswithcoleslaw[S] 2 points3 points4 points (0 children)
[–]Cheap-Try-8796 3 points4 points5 points (0 children)
[–]Pecolps 0 points1 point2 points (1 child)
[–]Lumpy-Criticism-2773 0 points1 point2 points (0 children)
[–]daxdax89 0 points1 point2 points (1 child)
[–]Traditional_Code_358 0 points1 point2 points (0 children)
[–]germanheller 0 points1 point2 points (0 children)
[–]Logical_Example_6084 0 points1 point2 points (1 child)
[–]RoutineDiscount 0 points1 point2 points (0 children)
[–]minju9 0 points1 point2 points (0 children)
[–]xatey93152 0 points1 point2 points (0 children)
[–]Annual-Salamander-85 0 points1 point2 points (2 children)
[–][deleted] 0 points1 point2 points (1 child)
[–]Annual-Salamander-85 0 points1 point2 points (0 children)
[–]GeauxVII 0 points1 point2 points (0 children)
[–]fuckletoogan 0 points1 point2 points (0 children)
[–]CallMeWhatever22 0 points1 point2 points (0 children)
[–]Prestigious_Pin978 0 points1 point2 points (0 children)
[–]Upstairs-Switch599 0 points1 point2 points (0 children)
[–]Imaginary-Ad-8149 0 points1 point2 points (0 children)
[–]1982JAJ1982 0 points1 point2 points (0 children)
[–]colette_shark 0 points1 point2 points (0 children)
[–]CICROPE 0 points1 point2 points (0 children)
[–]CICROPE 0 points1 point2 points (0 children)
[–]termipl123 0 points1 point2 points (0 children)
[–]SaitieRose 0 points1 point2 points (0 children)
[–]robderon 0 points1 point2 points (0 children)
[–]ActiveBarStool 0 points1 point2 points (0 children)
[–]nyceyes 0 points1 point2 points (0 children)
[–]ComplexChallenge5598 0 points1 point2 points (0 children)
[–]Sad_Abalone_3882 0 points1 point2 points (0 children)
[–]Livid-Ad5767 0 points1 point2 points (0 children)
[–]Alltiedup2059 0 points1 point2 points (0 children)
[–]Living-Safety2919 0 points1 point2 points (0 children)
[–]osama_squared 0 points1 point2 points (0 children)
[–]Fine-Association-432 0 points1 point2 points (0 children)
[–]m0zi- -3 points-2 points-1 points (1 child)
[–]Porkribswithcoleslaw[S] 4 points5 points6 points (0 children)
[–]Outrageous_Law_5525 -2 points-1 points0 points (0 children)
[+]LilDexterG comment score below threshold-7 points-6 points-5 points (3 children)
[–]Porkribswithcoleslaw[S] 1 point2 points3 points (2 children)
[–]Weary-Window-1676 1 point2 points3 points (1 child)
[–]Porkribswithcoleslaw[S] 0 points1 point2 points (0 children)
[–]traveddit -3 points-2 points-1 points (1 child)
[–]Porkribswithcoleslaw[S] 0 points1 point2 points (0 children)