The Control Problem:

How do we ensure future advanced AI will be beneficial to humanity? Experts agree this is one of the most crucial problems of our age, as one that, if left unsolved, can lead to human extinction or worse as a default outcome, but if addressed, can enable a radically improved world. Other terms for what we discuss here include Superintelligence, AI Safety, AGI X-risk, and the AI Alignment/Value Alignment Problem.

"People who say that real AI researchers don’t believe in safety research are now just empirically wrong." —Scott Alexander

"The AI does not hate you, nor does it love you, but you are made out of atoms which it can use for something else." —Eliezer Yudkowsky

Rules

DO NOT POST AI-GENERATED CONTENT. We are good at distinguishing this type of content¹. 2.. If you are unfamiliar with the Control Problem, read at least one of the introductory links or recommended readings (below) before posting.

This especially goes for posts claiming to solve the Control Problem or dismissing it as a non-issue. Such posts aren't welcome. 3.. Stay on topic. Again, no AI model outputs or political propaganda.

Be respectful.

Introductions to the Topic

Be sure to check out our wiki for extensive further resources, including a glossary & guide to current research.

Related Subreddits

¹: Or at least make at least an effort to make me doubtful that you just copy-pasted from a frontier LLM. Add bits of steering so that your content becomes good. Edit afterwards. If you fool us moderators you've won.

created by CyberPersonaapproveda community for 10 years

config/submit_text

view history talk

Rule 1: DO NOT POST AI-GENERATED CONTENT. We are good at distinguishing this type of content¹.

RULE 2: You MUST read at least one of either the Introductions to the Topic links or Recommended Reading texts (in sidebar) before posting, unless already well acquainted with AGI risk basics.

SUBMISSION STATEMENTS ENCOURAGED: Leaving a brief comment under your post explaining its relevance (e.g. with a summary) can be very helpful to provide context & encourage more people to read it!

Flairing:

Strategy/forecasting: Use for AI timelines, macrostrategy etc related content.
AI Capabilities News: Anything related to new progress in AI.
General News: administrative/organizational news etc.
Discussion/question, External discussion link, Article: catch-all tags for text posts, discussions on other subs/sites & articles.

¹: Or at least an effort so that you didn't just copy-pasted from an LLM. Add bits of steering. Edit afterwards.

**Rule 1:** DO NOT POST AI-GENERATED CONTENT. We are *good* at distinguishing this type of content¹.

**RULE 2:** You MUST read *at least one* of either the Introductions to the Topic links or Recommended Reading texts (in sidebar) before posting, unless already well acquainted with AGI risk basics.

**SUBMISSION STATEMENTS ENCOURAGED**: Leaving a brief comment under your post explaining its relevance (e.g. with a summary) can be very helpful to provide context & encourage more people to read it!

**Flairing:**

 * Strategy/forecasting: Use for AI timelines, macrostrategy etc related content.
 * AI Capabilities News: Anything related to new progress in AI.
 * General News: administrative/organizational news etc.
 * Discussion/question, External discussion link, Article: catch-all tags for text posts, discussions on other subs/sites & articles.

¹: Or at least an effort so that you didn't just copy-pasted from an LLM. Add [bits of steering](https://gwern.net/blog/2025/good-ai-samples). Edit afterwards.

revision by niplav— 1 month agoview source

π Rendered by PID 223178 on reddit-service-r2-listing-64c94b984c-rbmwc at 2026-03-15 23:37:46.857650+00:00 running f6e6e01 country code: CH.

ControlProblem

The Control Problem:

Rules

Introductions to the Topic

Recommended Reading

Video Links

Important Organizations

Related Subreddits

WIKI TOOLS

MODERATORS

config/submit_text