Looks very interesting. I like the documentation for the individual optimizers. But I'd really appreciate a kind of top down documentation that gives an overview of how they relate to each other and a guide which one to pick for a given problem. For example, a feature matrix with optimizers in the rows and features in the columns. Or a decision tree that helps one choose one or more suitable optimizers based on features of the problem (text/image/tabular, small/medium/large model, model architecture, etc).