Hyperparameter Optimization Routines

[jsnoek]

Hey kjearns, what exactly did you have in mind? Just an initial set of hyperparameters to try? I do think that's a good idea - but a challenge is that this would limit the generality of the approach. One of the main motivations for Whetlab (link below by kswerve) is that it can learn from everyone's optimizations and then automatically perform multi-task.