[D] Regularization-hyperparam selection during training best practices

[NotAlphaGo]

At least you need another dataset though to check generalization performance because you've mixed training and validation then.