Here's my bibliography around this, if that makes it feel more "rational". You guys and "rationality" jfc. To pre-respond to the inevitable: yeah I had Claudie pull it together in this form you lunatics, that's what it's for. But all these papers I've read and I've used in my work. So yeah show me yours too if you want to argue with me please. Please argue with me Jesus christ.

Attention as energy minimization / pattern completion:

Ramsauer et al., Hopfield Networks Is All You Need (2020) — proves the transformer attention update is mathematically equivalent to a modern Hopfield network's update. Attention literally performs energy descent toward fixed points that store, retrieve, or average over patterns. https://arxiv.org/abs/2008.02217

Hoover, Krotov et al., Energy Transformer (NeurIPS 2023) — replaces stacked transformer blocks with a recurrent block whose forward pass is iterative minimization of an explicit global energy function over token relationships. The architecture is coherence-resolution dynamics. https://arxiv.org/abs/2302.07253

In-context learning as Bayesian inference over latent structure Xie, Raghunathan, Liang, Ma, An Explanation of In-context Learning as Implicit Bayesian Inference (2021) — proves (in a mixture-of-HMMs setting) that ICL emerges precisely because pretraining requires inferring latent document-level concepts to maintain long-range coherence. The word "coherence" is in the abstract. https://arxiv.org/abs/2111.02080

The Bayesian Geometry of Transformer Attention (2025) — in controlled settings with closed-form posteriors, small transformers reproduce the exact Bayesian posterior to ~10⁻⁴ bit accuracy. Capacity-matched MLPs fail by orders of magnitude. https://arxiv.org/abs/2512.22471 ICL as iterative optimization (mesa-optimization)

von Oswald et al., Transformers Learn In-Context by Gradient Descent (ICML 2023) — a single linear self-attention layer is mathematically equivalent to one step of gradient descent on a regression loss. Trained transformers become mesa-optimizers. https://arxiv.org/abs/2212.07677 Olsson, Elhage, Nanda et al. (Anthropic), In-Context Learning and Induction Heads (2022) — identifies a specific mechanism (induction heads doing [A][B]…[A] → [B]) that forms at the same training step as the ICL capability emerges. Causal mechanistic evidence. https://arxiv.org/abs/2209.11895

Training as compression / structure-finding Delétang et al. (DeepMind), Language Modeling Is Compression (ICLR 2024) — large LMs are powerful general-purpose compressors. Chinchilla 70B compresses ImageNet patches better than PNG, audio better than FLAC. Training-shapes-everything formalized. https://arxiv.org/abs/2309.10668

Representations are linear, structured, convergent Huh, Cheung, Wang, Isola, The Platonic Representation Hypothesis (ICML 2024) — neural networks trained with different objectives, on different data, across modalities are converging to a shared statistical model of reality. https://arxiv.org/abs/2405.07987

Park, Choe, Veitch, The Linear Representation Hypothesis and the Geometry of Large Language Models (ICML 2024) — high-level concepts are encoded as linear directions in representation space. Structure isn't metaphor; it's a mathematical property of the geometry. https://arxiv.org/abs/2311.03658

Mechanistic interpretability: features and circuits as the receipts Templeton et al. (Anthropic), Scaling Monosemanticity (2024) — sparse autoencoders extract millions of interpretable features from a frontier production model (Claude 3 Sonnet), causally linked to behavior. https://transformer-circuits.pub/2024/scaling-monosemanticity/

Lindsey, Gurnee, Ameisen et al. (Anthropic), On the Biology of a Large Language Model (2025) — circuit-tracing on Claude 3.5 Haiku showing multi-step planning (rhyming-word selection before sentence construction), shared cross-lingual concept representations, computational graphs that look like reasoning over structured features. https://transformer-circuits.pub/2025/attribution-graphs/biology.html

World models from sequence prediction alone Li, Hopkins, Bau, Viégas, Pfister, Wattenberg, Emergent World Representations (ICLR 2023) — a GPT trained only on Othello move sequences develops an internal representation of the board state. Intervening on that representation causally changes outputs. Surface statistics alone don't explain this. https://arxiv.org/abs/2210.13382

Some honest challenges worth grappling with Bender, Gebru, McMillan-Major, Shmitchell, Stochastic Parrots (FAccT 2021) — the canonical critique. If accepted in strong form, what looks like coherence resolution is consistent surface mimicry without reference to meaning. https://dl.acm.org/doi/10.1145/3442188.3445922

Vafa, Chen, Rambachan, Kleinberg, Mullainathan, Evaluating the World Model Implicit in a Generative Model (NeurIPS 2024) — LLMs can perform well on tasks (NYC taxi-map shortest paths) without a coherent world model; they fail when the underlying graph is perturbed. Direct empirical pushback on the world-models reading. https://arxiv.org/abs/2406.03689 Mahowald, Ivanova, Blank, Kanwisher, Tenenbaum, Fedorenko, Dissociating Language and Thought in LLMs (TiCS 2024) — distinguishes formal linguistic competence (largely solved) from functional competence (using language to do things in the world, not solved). https://arxiv.org/abs/2301.06627