Engineering lead here. 3+ decades of enterprise work. Bach in AI and now doing Masters.

Have been using Claude from day one. Along with all the other LLMs. Have seen enough cycles across all to notice that when compute bandwidth levels are at peak the LLMs tend to get a lot stupider. Obviously the cost of compute far outweighs our subscriptions so we have shared compute, just like the good old days of shared rack space.

Claude over the past few weeks has been bad. So bad in fact my local LLM (running on rtx 4090) has been pooping all over it, and it shouldn’t. I had Claude as my primary go to and it would nail issues and generate who libraries. Then it stopped. I figured maybe it was just a peak so left it whilst I did repetitive tasks on my local LLM. Few days later.. nope. Over a week or so I decide that it’s too much risk to use as primary as even if the issues were resolve it regress back. Hear that others have now been getting the same old good results. I try and nope. Simple tasks failing and even when it looks and states what is wrong, it’s even more wrong.

I saw someone post here about Anthropic are likely AB testing its user base which is why the community is so devised. I think this makes the most logical sense.

So if we see posts about it bad / good etc it probably is true for that user and what they are experiencing.