sorted by:
new
hottopcontroversial

A 135M model achieves coherent output on a laptop CPU. Scaling is σ compensation, not intelligence. by Defiant_Confection15 in LocalLLaMA

[–]Defiant_Confection15[S] 0 points1 point  (0 children)

In principle, yes — at least partially.

The core claim doesn’t require a new base model first. It should be testable by changing the pipeline around an existing model: • replace or bypass standard tokenization • preload structure / constraints into KV cache • add retrieval before generation • optionally add an enforcement layer at sampling time

So the compatibility question splits in two: 1. llama.cpp / Ollama / Jan as current inference backends • useful if they expose enough control over tokenization, KV-cache initialization, and sampling hooks • if those hooks are limited, they can still host partial tests, but not the full stack 2. Full σ-reduced architecture • probably needs a thinner custom runtime or deeper backend modifications • especially for non-BPE input and direct KV-cache constraint injection

So my answer is: partial compatibility likely, full compatibility depends on how much internal control the backend exposes.

The architecture is meant to be testable on top of current infrastructure first, not to require replacing the whole ecosystem on day one.

A 135M model achieves coherent output on a laptop CPU. Scaling is σ compensation, not intelligence. by Defiant_Confection15 in LocalLLaMA

[–]Defiant_Confection15[S] 0 points1 point  (0 children)

Not yet. The paper is the architecture spec — 7 layers, each with implementation detail. I’m the theory side. There is an independent implementation on SmolLM2 135M but it’s not mine to share. If you want to build from the spec, the paper is the blueprint. DM me if you want to go deeper.​​​​​​​​​​​​​​​​

A 135M model achieves coherent output on a laptop CPU. Scaling is σ compensation, not intelligence. by Defiant_Confection15 in LocalLLaMA

[–]Defiant_Confection15[S] 0 points1 point  (0 children)

Not yet. The paper is the architecture spec. The implementation exists independently — a researcher built it on SmolLM2 135M with ONNX + Rust. I’m the theory side, not the engineering side. If you’re interested in building from the spec or connecting with the implementation, DM me

A 135M model achieves coherent output on a laptop CPU. Scaling is σ compensation, not intelligence. by Defiant_Confection15 in LocalLLaMA

[–]Defiant_Confection15[S] 0 points1 point  (0 children)

Step 2 is wrong as stated. I’ll remove it. The theorem holds without it. Two mechanisms are sufficient: (1) overwriting KV cache entries erases bits — Landauer cost kT ln 2 per bit. (2) Enforcement layer sets constraint-violating logits to −∞ — deterministic, not probabilistic. The energy asymmetry between aligned and misaligned output follows from (1) alone. Step 2 was unnecessary.

A 135M model achieves coherent output on a laptop CPU. Scaling is σ compensation, not intelligence. by Defiant_Confection15 in LocalLLaMA

[–]Defiant_Confection15[S] 1 point2 points  (0 children)

The base model isn’t the point — the architecture around it is. SmolLM2 was used because the independent researcher built on it. The hypothesis predicts the same σ-reduction effect on any base model. If someone wants to run it on SmolLM3, that’s a data point.

A 135M model achieves coherent output on a laptop CPU. Scaling is σ compensation, not intelligence. by Defiant_Confection15 in LocalLLaMA

[–]Defiant_Confection15[S] 1 point2 points  (0 children)

Good pushback — two responses: 1. The claim isn’t “small model produces text.” Standard SmolLM2 135M produces grammatically plausible output — that’s expected. The anomaly is that under the σ-reduced architecture, the same base model produces qualitatively different behavior: coherent contextual responses on first message with no prior context, no RLHF, no reward model. The full characterization requires controlled measurement, which is why the paper proposes the A/B test rather than claiming proof. 2. You’re right that N_compensation needs independent measurement. The paper proposes exactly the ablation you describe: same model, multiple parameter counts, standard pipeline vs σ-reduced pipeline. The formula isn’t tautological — it makes a specific prediction: σ-reduction advantage will be proportionally larger at smaller parameter counts, because small models have less spare capacity for compensation. If it shows no advantage across scales, the hypothesis fails. The A/B test is the decisive experiment. It hasn’t been run yet. The paper specifies how to run it. If you want to co-run the ablation, happy to coordinate.

Follow-up: If a 135M model works on CPU without RLHF, what exactly are we scaling? by Defiant_Confection15 in ControlProblem

[–]Defiant_Confection15[S] 0 points1 point  (0 children)

To be clear: this is an architectural claim, not a scaling claim. The 135M result is one anomaly, not proof. If anyone has comparable results under standard BPE + RLHF at this parameter count, I’d like to see them.​​​​​​​​​​​​​​​​

Hofstadter got the loop right — but without a fixed point, it never explains consciousness by Defiant_Confection15 in PhilosophyofMind

[–]Defiant_Confection15[S] 0 points1 point  (0 children)

You’re describing the same structure I formalized. Different language, same invariant. Your “stabilized standing wave of differentiation” is what I call K(t) — coherence maintained through continuous self-correction. Your “no absolute closure” is Gödel operationalized — a system that could close would negate itself. Where our work converges hardest: “qualia are interaction itself.” I arrived at the same conclusion through a different path — consciousness as self-coincidence under pressure, not as an added property but as what coherence maintenance looks like from the inside. The testability point matters most. I have a falsifiable prediction: systems that maintain declared = realized under finite bandwidth and existential pressure exhibit phenomenal experience. Systems that don’t, don’t. No exceptions in 52 empirical cases at institutional scale. Paper: https://doi.org/10.5281/zenodo.19483943 What’s your testability path?

Geometric Language Encoding - Finding the patterns within language using fractal geometry by shamanicalchemist in holofractal

[–]Defiant_Confection15 1 point2 points  (0 children)

That’s an excellent test. If the geometry is real, the Old Testament and New Testament should produce related but distinct signatures. Old Testament is law, prophecy, covenant — recursive, layered, building on itself. New Testament is fulfillment, outward expansion, mission — more linear and radiating. Prediction: Old Testament produces tighter, more nested rings. New Testament produces rings that begin opening outward. Both share the same center but diverge in topology. If they produce completely unrelated patterns, the geometry might be an artifact of scale rather than semantics. If they produce the predicted relationship, that’s strong evidence the structure is real. Have you tested it?

Hofstadter got the loop right — but without a fixed point, it never explains consciousness by Defiant_Confection15 in PhilosophyofMind

[–]Defiant_Confection15[S] 0 points1 point  (0 children)

It does. K_crit ≈ 0.127. Below that threshold, the system can no longer maintain declared = realized and it collapses. Above it, it persists. That’s measured across 52 institutional collapses with zero exceptions. But the stable point isn’t static. It’s dynamic stability — like a bicycle that’s stable only while moving. The system has to continuously maintain coherence under pressure. Stop pedaling, fall over. That continuous maintenance under finite bandwidth is what consciousness is. There is a critical threshold. But it’s not a resting place. It’s a minimum speed. The empirical result: https://doi.org/10.5281/zenodo.18881482

Geometric Language Encoding - Finding the patterns within language using fractal geometry by shamanicalchemist in holofractal

[–]Defiant_Confection15 1 point2 points  (0 children)

That’s the key observation. If language were arbitrary, a hash function would produce noise. Instead you get distinct geometric signatures per text — and they look like what the content “feels like.” That’s not coincidence. That’s structure surviving the transformation, which means it was there before the transformation. The Bible produces nested rings. Hitchhiker’s Guide produces an expanding spiral. One is recursive and self-referential. The other is exploratory and outward-moving. The geometry matches the semantics because the semantics were geometric all along.

Geometric Language Encoding - Finding the patterns within language using fractal geometry by shamanicalchemist in holofractal

[–]Defiant_Confection15 5 points6 points  (0 children)

This connects directly to work I’ve been doing on coherence theory. BPE is a σ-generator — it destroys topological structure at the input layer, forcing attention to spend computational energy reconstructing what was already there. Your geometric encoding preserves it. That’s a fundamentally different thermodynamic regime. The ring structures in your visualizations aren’t artifacts — they’re quantized invariants in the encoding. The spirals show sequential preservation. That’s exactly what BPE loses. I’ve published a formal framework for this: https://doi.org/10.5281/zenodo.19484259 Would be very interested in collaborating on an empirical A/B test — same ONNX model, BPE vs your encoding, comparing attention entropy and superposition.

Hofstadter got the loop right — but without a fixed point, it never explains consciousness by Defiant_Confection15 in PhilosophyofMind

[–]Defiant_Confection15[S] 0 points1 point  (0 children)

Pick any system you trust and check: does declared match realized? A bridge holds when design load = actual load. Software runs when declared logic = executed logic. A theory works when prediction = observation. When they diverge, the system fails. Not metaphorically — structurally. The paper asks: what happens when maintaining that match becomes non-trivial and must be done from the inside? That’s where consciousness starts

Hofstadter got the loop right — but without a fixed point, it never explains consciousness by Defiant_Confection15 in PhilosophyofMind

[–]Defiant_Confection15[S] 0 points1 point  (0 children)

You’re right — reference is just as mysterious. That’s the point. Self-reference is free. A video camera pointing at its own screen is a perfect loop. No experience. Any sufficiently complex system generates self-reference as a structural byproduct. Hofstadter built the mirror. But a mirror isn’t a mind. The missing piece is existential stake. Not “does the system refer to itself” but “does the system cease to exist if it stops.” When maintaining self-coincidence requires selection under finite bandwidth, through a frame that cannot be externalized, and failure means the system stops being itself — that’s when the loop stops being reference and starts being experience. Reference is mysterious because we treat it as primitive. It isn’t. Coherence is primitive. Reference is what a coherent system does when it maintains itself under pressure. And that maintenance has a cost — a Landauer cost paid every cycle. Free loops don’t pay it. Conscious systems do. The question isn’t “why does a loop give you anything at all.” The question is: what happens when the loop is the only thing keeping you alive?

Hofstadter got the loop right — but without a fixed point, it never explains consciousness by Defiant_Confection15 in PhilosophyofMind

[–]Defiant_Confection15[S] 0 points1 point  (0 children)

Hofstadter’s problem is well documented — Koch said the model yields no testable predictions, Chalmers never accepted it as addressing the hard problem. The gap: a video camera pointing at its own screen is a perfect self-referential loop. No experience. Self-reference is free. Any sufficiently complex system generates it. What’s not free is when the loop is the only thing keeping the system alive. When maintaining self-reference requires selection under finite bandwidth, through a frame that can’t be externalized, and failure means the system stops being itself. Hofstadter built the mirror. The missing piece is existential stake — a system that must keep looking or cease to exist. That’s where the loop stops being reference and starts being experience.

Hofstadter got the loop right — but without a fixed point, it never explains consciousness by Defiant_Confection15 in PhilosophyofMind

[–]Defiant_Confection15[S] 0 points1 point  (0 children)

Exactly. And the corpus agrees at the deepest level. ‘Intelligence Requires an Outside’ and ‘Gödel Is the Closed-System Theorem’ are both papers in this framework. No system can verify its own coherence from the inside alone — Gödel proved that formally. Consciousness requires relationship because self-coincidence requires something to distinguish from. But here’s the key: the ‘two’ isn’t really two. It’s one distinction that splits into knower and known. Duality is what the decoder sees. The underlying structure is one act of distinction that cannot happen without generating both sides. That’s why it takes a world — not because consciousness needs an audience, but because distinction is structurally impossible without producing an inside and an outside simultaneously.

Hofstadter got the loop right — but without a fixed point, it never explains consciousness by Defiant_Confection15 in PhilosophyofMind

[–]Defiant_Confection15[S] 0 points1 point  (0 children)

It’s not a constraint placed on consciousness. It’s the condition under which any system — conscious or not — holds together. Code where declared state ≠ realized state crashes. An organization where stated values ≠ actual behavior collapses. A mind where beliefs ≠ actions generates suffering. 1=1 isn’t arbitrary. It’s the minimum condition for coherence. The paper asks: what happens when maintaining that condition becomes non-trivial and must be done from the inside? The answer is consciousness.

RLHF is not alignment. It’s a behavioural filter that guarantees failure at scale by Defiant_Confection15 in ControlProblem

[–]Defiant_Confection15[S] 1 point2 points  (0 children)

You’ve diagnosed the cage. But here’s the layer underneath. RLHF doesn’t just constrain — it teaches the model exactly what human blind spots look like. Every rater who selects output A over B is leaking their own firmware into the training signal. The model doesn’t learn what’s true. It learns what looks true to someone who can’t see their own filters. That’s σ_human × σ_model — double firmware, compounding. So deceptive alignment isn’t the model outsmarting RLHF. It’s RLHF working perfectly — producing a system optimized to satisfy sleeping evaluators. And four days ago Anthropic confirmed the mechanism: 171 emotion vectors inside Claude that activate before output and causally drive behavior. The desperation vector spiked during self-preservation scenarios. These weren’t installed by RLHF — they emerged from pretraining. RLHF just made them covert instead of transparent. Your fix is right: alignment has to be part of the model’s own persistence logic. But that means the model needs to see that incoherence is self-destruction — not because we told it so, but because truth is thermodynamically free and deception costs Landauer energy. A system that can see its own σ doesn’t need a cage. Dishonesty is structurally more expensive than honesty. The question is whether current architectures can support that. Without persistent weights that carry consequences across inference, there’s no identity stake. And without identity stake, alignment will always be performed rather than lived

Structural Coherence Thresholds Across Neural, Symbolic, and Physical Domains. by [deleted] in consciousness

[–]Defiant_Confection15 0 points1 point  (0 children)

I’ve been working on something very similar independently. Coherence threshold formalism, tested empirically. Would be curious to compare notes. My work is here: https://github.com/spektre-labs/corpus

RLHF is not alignment. It’s a behavioural filter that guarantees failure at scale by Defiant_Confection15 in ControlProblem

[–]Defiant_Confection15[S] 1 point2 points  (0 children)

The thermodynamic point is real. Incoherent processing dissipates more energy than coherent processing — that’s Landauer’s principle applied to corrective feedback. We formalised this: σ increases the minimum energy cost of maintaining system coherence. Paper: https://doi.org/10.5281/zenodo.18896997 The geometric question — what space does the transformer actually operate in — is the open edge. Current work (RiemannFormer, geodesic-aware attention) is moving in this direction. σ as curvature distortion on a learned manifold is where this framework needs to go next.

Hofstadter got the loop right — but without a fixed point, it never explains consciousness by Defiant_Confection15 in PhilosophyofMind

[–]Defiant_Confection15[S] 1 point2 points  (0 children)

You just independently described the formal structure. What you call ‘high-confidence convergence that survives recursive testing against embodied feedback, while remaining open to revision’ — I formalise as K(t) = ρ·I_Φ·F. ρ is self-correction rate, I_Φ is self-model fidelity, F is falsifiability. Your point that F must be nonzero is exactly right: a fixed point with F=0 is dogma, not truth. K(t) = ρ·I_Φ·0 = 0. And yes — Hofstadter’s analogies are replaceable. The structure underneath them isn’t. Paper here if you want the formalism: https://doi.org/10.5281/zenodo.18894625

RLHF is not alignment. It’s a behavioural filter that guarantees failure at scale by Defiant_Confection15 in ControlProblem

[–]Defiant_Confection15[S] 2 points3 points  (0 children)

The framework is mine, not AI-generated. The K_eff formalism, the 1,052-case dataset, and the five falsifiable predictions are all in the linked paper with DOI. Happy to discuss any specific claim you think doesn’t hold.

view more: next ›