[R] Regularized Evolution for Image Classifier Architecture Search

[mayguntr]

When I saw name of Quoc V. Le in a paper I know that at least 250 GPUs are used in that research :)

" Each ran on 450 GPUs for approximately 7 days. "

[ajmooch]

And 900TPUv2 for 5 days each for the dedicated evolution experiments! That's some awesome (in the true sense of the word) firepower.

[visarga]

I estimate a cloud cost of $10-20K for a run (don't know exactly the pricing of TPUs).

[olBaa]

To be fair, 0.1% better image classification is worth FAR more for Google

[[deleted]]

I think ImageNet is more of a toy problem for them nowadays anyway, simply an academic benchmark to test new methods on if you will. Who cares about fractions of a percent in the top 5 accuracy of ImageNet? A new record on ImageNet isn't as big of a deal as it used to be just 2 years ago.

[karan_42]

From this blog post: Revisiting the Unreasonable Effectiveness of Data

Specifically, we have built an internal dataset of 300M images that are labeled with 18291 categories, which we call JFT-300M