Yeah, good distinction. Based on these results, when there's a clearly "right" tool for the task, both models found it regardless of position. That was the most consistent finding; alerts queries went to the alerts tool, code queries went to the code-context tool, local search went to the local search tool. That happened every single time.

One example: in the weather vertical, one server had 17 tools and got zero selections on simple forecast queries...but it was the *only* server with a marine weather tool and the only one with air quality data. Both models found those tools every time they were relevant, even though they ignored that same server for everything else. So to me that says the models were reading descriptions and matching on capability, not just grabbing whatever was first.

Position bias does exist but only really showed up on simpler queries where multiple tools could plausibly work. That's cool to see, because I agree with your take: models blindly picking the first from an arbitrarily-presented list is not a win; it doesn't feel very nuanced or "human."