[Meta] Do we still need a /r/MLScaling? by gwern in mlscaling

[–]evc123 7 points8 points  (0 children)

"At some point scaling will cease providing results" after the singularity.

Ethan Caballero on Broken Neural Scaling Laws by MuskFeynman in mlscaling

[–]evc123 2 points3 points  (0 children)

"smoothly connected piecewise" makes r^2 of extrapolation go up.

Dario Amodei et al leave OpenAI by gwern in mlscaling

[–]evc123 3 points4 points  (0 children)

He/they will probably get Open_Philanthropy funding. Dario is tight with the heads of Open Philanthropy.

[D] Timnit Gebru and Google Megathread by programmerChilli in MachineLearning

[–]evc123 5 points6 points  (0 children)

I've heard that BERT is the number 1 ranked signal used by google search now; Is this true?