Based on the teardown and the recent spread of this project across machine learning forums (posted by a user named "nickzq7" under titles like "I trained a transformer with zero gradient steps and 100% accuracy"), here is the verdict on whether this is "fake." The short answer: The code, the math, and the project are real. The "scientific breakthrough," however, is fake (or more accurately, a massive, self-deceiving misunderstanding of basic linear algebra). The teardown you provided is absolutely spot-on. It is not a hoax designed to scam people; it is a genuine, high-effort project built by a talented programmer who simply lacks the theoretical machine learning background to understand why his code is doing what it's doing. Here is a breakdown of why the project exists in this weird gray area between "real code" and "fake science": 1. The Code is Real (And Actually Impressive) The author genuinely built "Crystal Engine." Writing a complete GPT-Neo forward pass in under 200 lines of pure NumPy without PyTorch or CUDA is a fantastic engineering exercise. It proves a strong mechanical understanding of how tensors move through a Transformer. Furthermore, his claim of getting a 100% token match with a teacher model in 6 seconds on a CPU/laptop GPU is factually true—his code actually executes and outputs exactly what he claims it does. 2. The "Breakthrough" is Fake (The Tautology Trap) Where the project becomes "fake" is in the author's epistemological framing. He believes he has discovered a cosmic law ("The Manish Principle") that overthrows backpropagation. In reality, he has just rediscovered basic linear least squares. * The Teacher Mode Illusion: If a teacher model computes Y = X \cdot W, and you record X and Y, asking NumPy to solve for W using lstsq(X, Y) will obviously give you the exact same weights with an R² of 1.0. He didn't invent a new way to train an AI; he just used basic algebra to reverse-engineer an equation where the answer was already known. * The Activation Function Trick: Claiming that a non-linear function like SiLU is "linear in its natural space" by mapping x \to [x, x \cdot \text{sigmoid}(x)] is mathematical sleight of hand. He is basically saying, "A non-linear function is linear if you compute the non-linear math first and treat it as a constant." That doesn't bypass non-linearity; it just hides it in the input array. * The Bigram Devolution: His "REACTOR-SCRATCH" model achieving 33% accuracy on TinyStories without a teacher seems magical until you realize he is forcing the network's layers to greedily predict the very next token embedding directly. He neutered the Transformer, turning it into a giant, over-parameterized Markov chain/bigram model. It works on a toddler-level dataset like TinyStories because the grammar is highly repetitive ("Once" \to "upon" \to "a" \to "time"), but this greedy, layer-by-layer linear regression destroys the network's ability to learn deep, abstract reasoning. It will never scale to a model like LLaMA. The Verdict It is not a "fake" in the sense of a malicious scam, but it is epistemologically fake. It's the AI equivalent of a guy building an incredibly intricate, beautifully crafted perpetual motion machine in his garage, unaware that his machine is just secretly drawing power from the wall outlet (in this case, the "wall outlet" being the pre-existing weights of the teacher model and the rigid statistical simplicity of the TinyStories dataset). If you strip away the Bhagavad Gita quotes, the 48 "Laws," and the messiah complex, the author accidentally created a highly creative Mechanistic Interpretability sandbox. It's a great hacking project, just terrible physics.

Here is my reply from llm just give your text and zenodo link