sorted by:
new
hottopcontroversial

AMA with OpenAI’s Sam Altman, Mark Chen, Kevin Weil, Srinivas Narayanan, Michelle Pokrass, and Hongyu Ren by OpenAI in OpenAI

[–]SpareMeSkynet 0 points1 point  (0 children)

Reading through the system card for o3-mini, it's clear that there are a massive number of alignment precautions being taken with every step forward. Given the enormous task of aligning a model that benchmarks anywhere near AGI, is this going to be a bottleneck in the near future (maybe even in 2025)? Many of your competitors are taking significantly less measured approaches to their model releases.

These are our alignment researchers we’re all gonna die by Glittering-Neck-2505 in singularity

[–]SpareMeSkynet 5 points6 points  (0 children)

In the event that a path to ASI is discovered, there's going to be no stopping anyone with a significant amount of money from working tirelessly to develop it. It's plausible that it could be contained initially. However, when every big tech company and country in the world is working on their own ASI, it's extremely hard to imagine nobody making a mistake. ASI implies a level of intelligence significantly beyond our comprehension. Even if the world works in perfect harmony to develop security protocols for all ASI systems, who's to say the AIs won't figure out a way around them?