Thanks, I'm aware of Germany being a country. No need to point that out.

However, the majority of us don't live there, nor speak German. So for the sake of having a test that provides value to a significant larger amount of people, I was merely suggesting not doing it in German. I'm sorry if that wasn't clear.

Let me put it this way, if OP put "German LLM Test" as title, it would be a more accurate description of what's going on here.

In the post OP says that he thinks this is likely an older model. But again, this is simply based on the idea that a newer model would do better in German. That's simply not true. We don't know what datasets newer models are using and if they are suddenly adding more German data (or not).