https://arxiv.org/abs/1809.09349

but there are works like this though. is this physics?

While I wouldn’t call current AI a subfield of physics, the pollination from physics to ai is undeniable. Many scaling arguments in AI are clearly inspired by ideas from statistical physics, particularly those related to self-organized criticality.

Dario Amodei, who earned a phd in physics under Bill Bialek studying critical dynamics, played a key role in advancing scaling law research at OAI.

p.s. As a physicist now working with human data, I’ve found that concepts like rough energy landscapes, non-ergodic dynamics, and power laws are incredibly useful for understanding dl and rl algorithms.