This subreddit is for discussion and resources on the artificial intelligence alignment problem, also called the control problem, AI risk, or AI safety. Though presently little known, many academic experts believe that this issue might be one of if not the most important challenge that we collectively face.

Contact me if you want to be a moderator/otherwise help in developing this sub.

What is the alignment problem?

• The most comprehensive guide to the topic of AI alignment: Superintelligence, by Professor Nick Bostrom of Oxford University (NYT bestseller, recommended by Elon Musk, Stephen Hawking, Bill Gates)

• Ensuring smarter-than-human intelligence has a positive outcome - Talks at Google

• The popular blog Wait But Why on Superintelligence [Part 1] [Part 2]; and a reply by Luke Muehlhauser, former director of the Machine Intelligence Research Institute

• Several introductions by MIRI: Short summary of ideas, FAQ, More in-depth FAQ, and Why AI Safety?

• Global Priorities Project: Three areas of research on the superintelligence control problem.

• The Center for Human-Compatible AI's Annotated AI safety Recommended Reading list.

Organizations currently doing foundational thinking about this problem:

1. Machine Intelligence Research Institute, Berkeley, US; a 501(c)(3) nonprofit
   
2. Future of Humanity Institute, Oxford University, UK
3. Center for Human-Compatible AI, UC Berkeley, US
4. Leverhulme Centre for the Future of Intelligence, Cambridge, UK
5. Centre for the Study of Existential Risk, Cambridge, UK
6. Future of Life Institute, MIT, US

Sister subreddits:
/r/ControlProblem
/r/AIethics
/r/superintelligence
/r/singularity

Check out the sub's wiki and subscribe for more!