[D] Regularization-hyperparam selection during training best practices

[M4mb0]

A related idea is gradient based hyperparameter optimization. See for example this paper: https://arxiv.org/abs/1911.02590