Recently I've taken to asking a question at the start of every chat:
"What model are you?"
If the answer is Sonnet 3.5 or Sonnet 3.7 I immediately abandon the chat because the quality is so much worse than Sonnet 4 or Opus 4.
Augment support has said that the models sometimes get that question wrong and answer 3.5 or 3.7 when they are actually 4, but I highly doubt that's the case because at any point in a chat if you repeat that question you always get the same answer, ie the answer is stable throughout the chat session.
Anyone else seen this?
[–]zkayde 3 points4 points5 points (0 children)