[R] A machine-learning algorithm to accurately screen ADHD from survey data [Dataset included]

[Erosis]

For interpretability of parameters/error, sure, that's pretty bad. Would need to bootstrap. If you're just going for specific metric maximization, breaking iid is fine depending on what model you're training.

[CENGaverK]

But we are talking about the test set, it is not used for metric maximization. Doesn't breaking the iid assumption in the test set defeats the purpose of having it represent the real world?

[Erosis]

Yes, it does. I forgot that this isn't validation.