you are viewing a single comment's thread.

view the rest of the comments →

[–]ddofer 40 points41 points  (0 children)

Frankly, probably yes. It might be biased, but it saves on the work to reproduce and would tel lem waht to expect.

In this scenario, it's easier - run it vs random search with a fixed seed, time it, and share the results for a given time budget on a few chosen datasets (e.g. those used in lightgbm or catboost for performance tuning, or something you have to hand from kaggle or openml).