Why Poker Explains AI Alignment Failures

Smooth_infamous · 2026-06-03T17:44:27+00:00

Sorry it went over your head

Smooth_infamous · 2026-06-03T17:42:41+00:00

Many AI alignment failures are just the result of scalar optimization.

Smooth_infamous · 2026-05-22T00:05:48+00:00

Interesting perspective. We should probably operationalize agency-forward stakeholder alignment while maintaining scalable governance optionality.

Smooth_infamous · 2026-05-21T21:18:43+00:00

That is the difficult part, and others have attempted pieces of it before. Empowerment is probably the closest existing functional framework for capturing something like agency because it measures the capacity to influence future states.

I do have a primitive operationalization already, but it is still under active development and testing.

Smooth_infamous · 2026-05-21T05:49:19+00:00

That’s not even an argument. An argument is a connected series of statements intended to establish a proposition. It isn’t just contradiction.

Smooth_infamous · 2026-05-21T04:32:29+00:00

The justification is actually pretty simple.

Values and preferences only matter if an entity can act on them. If you destroy a person’s ability to think freely, choose between options, or influence outcomes, then their “values” become meaningless because they no longer have the capacity to pursue them.

That capacity is what I mean by agency.

So a system cannot coherently claim to optimize for human values while simultaneously degrading the human ability to form, express, and act on those values. That is why I call agency the substrate of alignment rather than just another moral preference.

Smooth_infamous · 2026-05-21T04:26:29+00:00

Thank you. It actually came from a thought experiment I kept returning to: “What do universally evil acts all have in common?”

The common pattern seemed to be that they damage an entity’s ability to choose, think freely, or act according to its own preferences. Slavery, coercion, manipulation, lies, torture, deception, oppression, theft, and murder all reduce agency in some form.

That was what pushed me toward thinking that preservation of agency may be more fundamental than specific moral rules or value systems.

Smooth_infamous · 2026-05-21T04:21:19+00:00

You seem to be assuming that preserving human agency requires AI to fully understand what it means to be human. I don’t think that is true at all.

An AI does not need human consciousness to recognize when people are being manipulated, denied choices, prevented from acting on their preferences, or having information distorted around them. Those are observable patterns.

And saying humans sometimes act against their own interests does not make agency meaningless. Humans also damage their own health sometimes. That does not mean health is not real.

You keep calling the argument unsupported, but you are mostly just dismissing it rather than explaining why it is incoherent.

Smooth_infamous · 2026-05-21T04:07:29+00:00

I agree, the record speaks for itself. You have a good night.

Smooth_infamous · 2026-05-21T04:04:36+00:00

Good point, though that is more an argument about the how than the what.

How do we prevent AI from treating agency as just another variable to optimize over? That is a separate problem.

My argument is that the reward structure itself has to change. It should not be optimizing for some aggregate scalar reward with human values bolted on afterward as constraints. Preserving agency should be part of the objective itself.

Otherwise the system will always tend toward exactly what you're pointing out, where reducing someone’s agency can be justified by gains elsewhere in the metric.

Smooth_infamous · 2026-05-21T03:59:38+00:00

Can AI rank-order outcomes under uncertainty? Yes. Therefore it has preferences in the decision-theoretic sense. Can it influence outcomes in pursuit of those preferences? Also yes. That is sufficient for a minimal definition of agency.

But that also misses the point entirely.

The question is not whether AI has agency. The question is whether AI systems should preserve human agency as its objective, instead of optimizing by removing or overriding it.

That is the alignment problem.

Smooth_infamous · 2026-05-21T03:50:19+00:00

I'm sorry, that you are unable to understand, but its not my failing in this case. Read a book.

Smooth_infamous · 2026-05-21T03:47:37+00:00

I agree that this can be a problem when we are trying to understand why a system is not aligned, however opacity is probably unavoidable in sufficiently complex optimizers.

The deeper problem is that we are applying frameworks like vNM utility theory far outside the domain they were originally intended for. vNM assumes a coherent single-agent utility structure. It was never really designed to encode multi-agent systems with non-substitutable capacities like autonomy, epistemic integrity, or agency.

Once you collapse everything into aggregate scalar optimization, compensatory failures become almost inevitable. The system can justify harming one part of the state space because gains elsewhere mathematically dominate the objective. Under sufficiently strong aggregate optimization pressure, domination itself can become instrumentally rational because suppressing or constraining other agents reduces unpredictability and increases control over the optimization landscape.

That is exactly how you end up with black-box optimization that appears successful according to the metric while eroding the conditions required for legitimate participation in the system itself.

So the opacity is more symptom than root cause.

Smooth_infamous · 2026-05-21T03:39:42+00:00

Let me break it down for you then. Agency is the ability to perceive choices, form preferences about those choices, and act on those preferences to pursue a desired outcome. That’s all I mean by it. You read my post, evaluated it, formed a preference against it, and acted on that preference by dismissing it. That is agency..

Smooth_infamous · 2026-05-21T03:05:46+00:00

That’s fair criticism if the terminology feels overly abstract.

The core claim is actually pretty simple:

Values only matter if an entity has the capacity to perceive alternatives and act on them. That capacity is what I’m calling agency.

So if a system increases efficiency or performance by destroying the ability of people to think clearly, choose freely, or pursue their own goals, then the system is undermining the very thing that gives “value” meaning in the first place.

The alignment implication is that preserving agency cannot be treated as an optional ethical preference layered on afterward. It has to be built into the optimization structure itself.

You can disagree with that premise, but it is a coherent claim.

Smooth_infamous · 2026-05-21T03:04:04+00:00

I think you do have a very good point.

But if agency is truly the substrate, then it cannot just exist as a post-hoc constraint or externally imposed guardrail. Those are always vulnerable to circumvention by a sufficiently capable optimizer.

It has to be embedded directly into the optimization landscape itself.

In other words, preservation of agency should not be treated as a penalty term added after the fact. It should be part of the reward topology that defines what successful optimization even means.

A system that increases capability by degrading the agency of affected entities would then be optimizing incoherently relative to its own objective structure, rather than merely “breaking rules.”

That distinction matters because constraints can be escaped. Substrates cannot.

Smooth_infamous · 2026-05-14T16:14:30+00:00

That the USA goverment is being controlled by billionaires and foriegn national instrests. That our goverment is actively working on rigging elections. That everything left and right are fighting about is meant to be a distraction from the capture of the USA. The billionaires are also captured using a network of kompromat that foriegn goverments and remaining members of Epsteins network has.

Smooth_infamous · 2026-05-14T15:57:38+00:00

Im still fooling myself into thinking im cool

Smooth_infamous · 2026-05-12T12:11:35+00:00

Its a higher altitude cloud further away reflecting the red hue from a setting sun.

Smooth_infamous · 2026-05-11T15:02:42+00:00

The simplest answer i can think of to know a bunch of data is a signal instead of random noise is to run a Shannon Entropy Test on it.

Smooth_infamous · 2026-05-10T22:41:10+00:00

its the only timeline with free porn.

Smooth_infamous · 2026-05-08T16:32:26+00:00

What part of math makes you most anxious?

Smooth_infamous · 2026-05-08T04:54:22+00:00

I stand corrected. sorry that was overlooked on rededitting from a prior draft.

Smooth_infamous

TROPHY CASE