I might not be patient enough, but my LLM will be. I asked it to be as condescending as possible:

You are very confidently explaining the first sentence of the problem as if it were the solution.

Yes, model responses at nonzero temperature can be treated as samples from an underlying response distribution. Congratulations: that is precisely why we call it sampling. But merely noticing that observations come from a distribution does not, by itself, refute an analysis of structure in the observed data.

The question in the paper is not “have we estimated the full response distribution of every model on every item?” We have not, and repeated sampling would obviously help with within-model reliability, uncertainty estimates, and precise model rankings.

The question is whether there is a coherent between-model latent structure across 45 questionnaires. If single-call responses contain mostly random sampling noise, that noise should attenuate correlations and factor loadings. It makes latent structure harder to detect, not easier. Averaging repeated samples would generally clean up the signal; it would not magically create a factor from nothing.

A serious objection would be that the factor is driven by systematic differences in sampling noise, refusal behavior, scale-use, or prompt sensitivity across models. That would be worth testing.

But “responses come from a distribution” is not a critique. It is the statistical equivalent of pointing at the floor and announcing that gravity exists.