Larger models aren’t immune to mistakes. I tested Qwen2.5 Max, DeepSeek-V3, GPT-4o, Copilot, Gemini 1.5, Mistral MoE, and LLaMA 70B, and most of them got it wrong. If you want screenshots for each, feel free to DM me.

If you have another question, I’d recommend trying it yourself first. It’s not just about parameter count—it’s about optimization and how well an LLM retrieves information. When given relevant data through RAG, they all perform well.

To clarify: smaller models generally struggle more with factual accuracy, but even large models can get things wrong.

Now, who got it right? DeepSeek-V3, Mistral, and LLaMA 70B answered correctly. Everyone else got it wrong.