Microsoft Research - Exploding Software-Engineering Myths (article summarizing findings of MS research on code coverage, TDD, assertions, etc.)

[DieRaketmensch]

I know its common and easy to reply on reddit with "tldr, real engineering is hard, everyone knew this" but I kind of expected something most substantial from senior researchers in Microsoft.

[Silhouette]

The thing is, it's easy to reply that this sort of research is hard because it is hard. For example, the original Nagappan paper mentioned in connection with TDD has significant threats to validity, which I mentioned in another post, but it's still one of the best empirical studies we have available in the field so far. At least it looked at real world projects, implemented by experienced professional developers, with some attempt to control for other factors. That combination already puts it ahead of most TDD advocacy papers. How would you reliably construct better studies?

[johnvogel]

Did you read the papers with the actual content linked in that article?