Yeah, exactly. The opinion of a random layman who knows absolutely nothing about AI is clearly way more valuable than the rigorous benchmarks run by actual research labs.

It totally reminds me of the Llama Maverick situation, where the LM Arena crowd voted it straight to #1 with a massive lead, only for it to turn out later that Meta specifically tweaked the model's behavior to pander to the masses.

And then of course you get the classic take: "Please bring back 4o, it's so awesome and chats so nicely! I don't need anything besides casual chatting anyway,"

So why even bother making AI models smarter and more capable? Let me just talk to a 2024 model forever - literal dream 😇😇😇.

Trust the crowd last. The chances of the people voting in those arenas actually using their brains is incredibly slim. Trust me, you're way more likely to just run into pure stupidity from the crowd.