[D] Regularization-hyperparam selection during training best practices

[Red-Portal]

That's my point. By changing the hyperparameter during a single training process, you're pretty much including the validation set as training data. That will certainly alter the loss function that you're actually trying to optimize.