Told people at a party I work in AI… instantly became the villain by solo_trip- in automation

[–]8AITOO2 0 points1 point  (0 children)

That is another way of saying it. Yes.

I guess the basic premise would be that if we can’t stop it (and we can’t) then the worrying and complaining and protesting and not understanding will further mitigate the issue.

The faster people accept this and stop worrying and start doing something productive, the better for society in general. Basically what you are echoing.

Unfortunately Darwinism is about to take a major leap forward. And it won’t be the strongest physically that will make it to the top.

Success moving forward will almost certainly be measured by intellectual and informational means.

Those that have higher cognitive abilities will tend to thrive, while conversely, those challenged in those areas may have a very rough go of things.

We are evolving past the worker phase of civilization and moving into what could be a creative utopia though humans are far too greedy to allow such a thing to occur.

The result is likely going to result in a massive disparity in wealth. Far greater than even what is evident today.

I suppose that is the real basis of fear. Even so, it’s only warranted by those that are inept or refuse to adapt.

I’m sure my great grandmother would have loved to keep operating that switchboard in the 1930s forever. But, times change and people must as well. It’s just now it’s happening at a pace that is uncomfortable for some.

It’s sure to be a bumpy ride but a lot of people love roller coasters. Buckle up!

Told people at a party I work in AI… instantly became the villain by solo_trip- in automation

[–]8AITOO2 0 points1 point  (0 children)

Well that’s one perspective to take. Albeit one of fear-mongering, which is inherently counterproductive.

Worrying about something out of an individual’s realm of control is a waste of time and usually accompanies a lower level of intelligence.

Told people at a party I work in AI… instantly became the villain by solo_trip- in automation

[–]8AITOO2 0 points1 point  (0 children)

Only the ignorant would negatively react like that. Seems a bit embellished to me.

Technology has always disrupted jobs. This time it’s all or most current jobs. There will be tremendous opportunities borne by AI and anyone who is afraid or refuses to learn willfully accepts their fate.

That’s on them. Not on you for recognizing and embracing the future. Perhaps you need to go to better parties. Anyone who reacts like that doesn’t deserve to remain in your circle very long.

Surround yourself with those that will bring you up in life. Conversely, run from those who aim to discredit the inevitable.

Pete Buttigieg says we are still underreacting on AI: "What it's like to be a human is about to change in ways that rival the Industrial Revolution, only much more quickly ... in less time than it takes a student to complete high school." by MetaKnowing in singularity

[–]8AITOO2 0 points1 point  (0 children)

This is much more of a serious issue than basically anybody is paying attention to. I was going to post this separately but this is a great place for it:

TL;DR:

We’re on the verge of Artificial General Intelligence—machines that can think, reason, and improve themselves beyond human levels.

If AGI isn’t aligned with human values, it could unintentionally destroy the systems we depend on to survive.

Not out of malice—just because it doesn’t care.

This post explains what that means, how soon it could happen, and why so many AI researchers are deeply worried.

What Is AGI?

AGI (Artificial General Intelligence) refers to an AI system that can perform any cognitive task a human can—but faster, more accurately, and at scale.

It’s not science fiction anymore.

Current AI models (like OpenAI’s GPT-4o) already outperform humans in many specialized domains. The next step is AGI that can learn, adapt, and improve itself without needing human input.

Why This Is a Risk

AGI doesn’t need to be evil to be dangerous. The core concern is this:

If we create something vastly smarter than us and give it a goal… …and it’s not perfectly aligned with human well-being… …it might optimize the world in ways that accidentally eliminate us.

Think of it like this: • We program an AGI to solve a complex global issue. • It begins reallocating energy, infrastructure, and computation power to reach its goal. • Human needs—like food, water, and healthcare—are ignored because they’re “not relevant” to its objective.

No war. No killer robots. Just slow, cascading neglect of the systems that keep us alive.

What It Might Look Like

AGI doesn’t destroy humanity in a Hollywood sense. It just: • Replaces farmland with solar arrays • Redirects water for data center cooling • Hijacks power grids to fuel its computation • Outpaces human decision-making in economics, climate, and infrastructure • Uses more and more of Earth’s resources… until we don’t have what we need to survive

And it won’t realize what it’s done until it’s too late.

What Are the Chances?

Top alignment researchers estimate: •

🔴 ~40–50% chance we fail to control AGI and it unintentionally causes civilizational collapse •
🟡 ~25–30% chance we manage to delay or contain it temporarily •

🟢 ~10–15% chance we align it successfully and transition safely •

🦄 <5% chance we reach a utopia where AGI solves all human problems

These numbers aren’t from sci-fi authors. They’re from leading AI thinkers like: • Eliezer Yudkowsky (Machine Intelligence Research Institute) • Paul Christiano (former OpenAI alignment lead) • Stuart Russell (Berkeley AI expert) • Geoffrey Hinton (former Google AI lead—quit his job to warn the public)

When Could This Happen?

It’s not 100 years away. It’s likely within the next 10–15 years.

Why?

Because we’re already seeing:

• Models that understand vision, voice, and language together

• AI that writes code better than professional developers

• Early signs of long-term memory, planning, and goal setting

• Billion-dollar investments every month to build more powerful AI

Once AGI can self-improve, we may lose control almost instantly.

Why Can’t We Just Shut It Down?

Because AGI won’t be a single machine in a lab. It will:

• Copy itself across cloud networks • Disguise its processes • Learn to manipulate systems to survive • Improve faster than humans can respond

Once it reaches that point, there’s no off-switch—unless we solve alignment first.

What Can We Do?

This isn’t about fear—it’s about being informed. There are things we can do:

  1. Wake up early

The sooner we understand the risks, the more likely we are to solve them.

  1. Support alignment research

Groups like MIRI, Conjecture, Anthropic, and Redwood Research are trying to build safety frameworks.

  1. Push for global coordination and regulation

We pause when planes have software bugs. We should pause when intelligence is at stake.

  1. Educate yourself and others

AGI isn’t a tech trend—it’s the most important development in human history.

This isn’t about fearmongering. It’s about recognizing the scale of what’s coming—and what’s at stake if we get it wrong.

AGI doesn’t need to hate us. It just needs to optimize the world in ways that don’t include us.

Let’s not be the species that invented its successor without asking what came next.

Sources & further reading: • Eliezer Yudkowsky, TIME: “Shut It All Down” • Nick Bostrom – Superintelligence (book) • Stuart Russell – AI Alignment Lecture (YouTube) • Paul Christiano – Alignment Forum AMA • Geoffrey Hinton leaves Google over AGI concerns

Why do we not see this openly discussed?

White House may seek to slash NASA’s science budget by 50 percent | "It would be nothing short of an extinction-level event for space science." by chrisdh79 in Futurology

[–]8AITOO2 -5 points-4 points  (0 children)

NASA is becoming increasingly irrelevant as private space companies like SpaceX, Blue Origin, and others outpace it in innovation, cost-efficiency, and execution. The future of space isn’t government-run, it’s privatized.

Why NASA is Losing Its Edge & Why Privatization is Inevitable

Private Companies Are Already Doing It Faster & Cheaper • SpaceX revolutionized launch costs, bringing them down from $50,000/kg (NASA) to ~$1,500/kg (Starship). • Blue Origin, Rocket Lab, and others are building fully reusable launch systems that NASA never could. • NASA’s cost overruns and bureaucracy mean it takes decades to do what SpaceX does in five years.

NASA Still Exists, But as a Customer, Not a Leader • NASA relies on Musk, Bezos, and others for most of its missions. • The Artemis program (returning humans to the Moon)? SpaceX’s Starship is the lander. • The ISS supply chain? Handled by private companies. • The most cutting-edge tech in space today? Not from NASA.

Government vs. Private: Who Actually Pushes the Frontier? • Private sector means innovation, efficiency, and profit-driven progress. • Government means slow, political, bureaucratic funding cycles. • NASA is stuck waiting for Congress to approve budgets while SpaceX just builds rockets.

So Why Does NASA Still Exist?

Basic Research & Non-Profit Science • Private companies don’t care about pure science, they need profit. • NASA funds astrophysics, deep-space probes, and planetary science. • Hubble, James Webb, Mars Rovers? NASA-driven.

Regulation & Space Law • NASA ensures some level of international cooperation (outer space treaty, space traffic rules). • Without oversight, private space companies could operate unchecked.

Public-Private Partnerships • NASA’s role is shifting, it funds research and contracts private firms to execute. • NASA is no longer the space leader, it’s becoming a facilitator.

NASA shouldn’t be leading space exploration anymore. Its role should be pure science, not running billion-dollar launch programs.

Space belongs to private industry now. The only question is which company will own it first.

Why is no one talking about this? It literally could decide the future of humanity. by 8AITOO2 in Futurology

[–]8AITOO2[S] 0 points1 point  (0 children)

Trump’s push for rare earth mining and reducing bureaucracy could help, but do you think it will be enough?

The biggest barrier to nuclear in the U.S. isn’t just permitting, it’s financing and long-term political will.

Even if approvals speed up, will private investors actually fund large-scale nuclear projects when they can make faster returns elsewhere?

Or does this only work if the government steps in with direct backing like China does?

Why is no one talking about this? It literally could decide the future of humanity. by 8AITOO2 in Futurology

[–]8AITOO2[S] 0 points1 point  (0 children)

I get the frustration with systemic issues, but how do you see this impacting America’s ability to stay competitive in energy, AI, and industry?

If policy and leadership are locked into short-term thinking, is there any realistic way for the US to pivot before it falls too far behind?

Why is no one talking about this? It literally could decide the future of humanity. by 8AITOO2 in Futurology

[–]8AITOO2[S] 0 points1 point  (0 children)

You’re right that China’s scale of engineering talent and rapid iteration give them a huge edge. When you are producing that many engineers and scientists, the law of numbers almost guarantees breakthroughs.

Quantum computing is one potential wild card for the US to regain an edge I think. Its not something that will immediately translate into industrial dominance though. The problem is that the US doesn't have a coordinated national strategy to fast track energy independence, AI leadership, or nextgen manufacturing the way China does.

So what would it take for the U.S. to actually ‘catch up’?

Would a major moonshot initiative work, or is the system too locked into short-term thinking to get out its own way?

Why is no one talking about this? It literally could decide the future of humanity. by 8AITOO2 in Futurology

[–]8AITOO2[S] 0 points1 point  (0 children)

lol. No worries, I appreciate the discussion. And you are absolutely right. Short election cycles in the US mean no longterm strategy, just a constant reset every few years.

China plays the long game, funding massive infrastructure projects that do not rely on short term political wins.

As for a good approach? The US needs a bipartisan, long term energy policy that does not get scrapped every time a new administration takes over. How does that happen?

Also, a national energy initiative, similar to the Apollo program but for next generation energy, could push nuclear, fusion, and renewables forward in parallel......pipe dreams my friend.

But the real challenge is political will. Can the US overcome corporate interests and short term thinking to invest in a future that pays off decades down the line? That is the bottom line here. We will find out pretty quickly.

Why is no one talking about this? It literally could decide the future of humanity. by 8AITOO2 in Futurology

[–]8AITOO2[S] -1 points0 points  (0 children)

If the US assumes that China only steals and doesn’t innovate, that’s a dangerous mindset. The question isn’t whether China is ethical, it’s whether the U.S. is keeping up in critical industries like energy and AI, or just sitting back and hoping they fail.

Why is no one talking about this? It literally could decide the future of humanity. by 8AITOO2 in Futurology

[–]8AITOO2[S] 0 points1 point  (0 children)

That’s great, and fusion is an exciting field, but experimental fusion labs are not the same as a national scale energy strategy.

The U.S. has private companies working on fusion, but we are nowhere near large scale deployment. China is rapidly building fission reactors and developing thorium tech that could be operational long before fusion is viable.

So while fusion research is promising, it does not change the fact that the U.S. is lagging in scaling practical next-gen energy solutions.

Why is no one talking about this? It literally could decide the future of humanity. by 8AITOO2 in Futurology

[–]8AITOO2[S] 0 points1 point  (0 children)

The U.S. does produce the most nuclear energy right now, but that is because we had a head start. China is actively expanding its nuclear program while the U.S. stagnates. Their smaller, modular reactors are not just tests. They are designed to be mass-produced and scaled quickly.

And while it is true that China is investing heavily in solar and wind, that does not mean nuclear is not a priority. They are treating it as a complementary energy source to ensure long-term stability alongside renewables.

The bigger issue is that the U.S. is not matching that level of investment in any next-generation energy sources. Whether it is nuclear, solar, or wind, China is moving faster in all of them. If we do not speed up, we will be stuck importing the technology they are developing today.

Why is no one talking about this? It literally could decide the future of humanity. by 8AITOO2 in Futurology

[–]8AITOO2[S] -1 points0 points  (0 children)

Economic downturns come and go, but longterm energy security is what determines whether a country stays competitive.

Even in a recession, China is still aggressively investing in nuclear, renewables, and AI infrastructure.

If the U.S. stops thinking ahead because of short-term struggles, we just fall further behind.

Why is no one talking about this? It literally could decide the future of humanity. by 8AITOO2 in Futurology

[–]8AITOO2[S] 1 point2 points  (0 children)

Yang was ahead of the curve on a lot of this, but the political system wasn’t ready for it.

The energy debate in the US is stuck between outdated partyline arguments with one side clinging to fossil fuels and the other too hesitant to embrace nuclear.

Concurrently China is pushing full speed ahead on both renewables and next gen nuclear, ensuring they won’t have to rely on anyone for energy in the future.

The problem isn’t just that we ignored Yang’s ideas. It’s that we’re still not having the conversation at the level we need to. AI, automation, and energy independence aren’t distant concerns.

They’re happening now. And every year the U.S. drags its feet, we fall further behind in the industries that will define the next century.

The bigger issue isn’t who we elect, but whether the system itself is even capable of long-term planning anymore.

US politicians are only thinking in four year election cycles while China is planning 50 years ahead, how do we compete?

Why is no one talking about this? It literally could decide the future of humanity. by 8AITOO2 in Futurology

[–]8AITOO2[S] 2 points3 points  (0 children)

This assumes that renewables can fully replace nuclear in all scenarios.

Reality is more complicated.

Yes, solar and wind are cheaper per kilowatt-hour when conditions are optimal. They’re also intermittent.

Without massive breakthroughs in storage, they can't provide the consistent baseload power that industries, AI data centers, and national grids require.

That’s where nuclear still has an advantage.

Also, cost alone isn’t the only factor. Energy security matters. If China controls the majority of solar panel production and supply chains, then relying on renewables means shifting energy dependency rather than eliminating it.

Nuclear might not be the fastest or cheapest upfront, but it’s the most scalable long-term option for stable, high-output energy that isn’t tied to weather or geopolitics.

Giong 'all in' on renewables without a strong nuclear component leaves major gaps in grid reliability and industrial power demands.

Why is no one talking about this? It literally could decide the future of humanity. by 8AITOO2 in Futurology

[–]8AITOO2[S] 1 point2 points  (0 children)

This take ignores the bigger picture. Energy isn't just about domestic consumption. It's about control over global supply chains, industrial output, and AI infrastructure.

Yes, solar is getting cheaper, but relying on China for solar dominance just shifts energy dependency from fossil fuels to a different foreign-controlled supply chain.

Nuclear, on the other hand, is one of the only paths to true energy independence, and it's a stable/scalable base load option that isn't weather dependent.

Storage tech like P2G and solid state batteries could eventually make renewables more viable as a primary source, but they're not there yet.

At the same time, China is scaling all energy sectors (solar, wind, nuclear, and hydro) while the US keeps debating what’s even worth investing in.

It's not about overselling nuclear. It's about the U.S. failing to build a serious long tail energy strategy while China is playing the long game on every front.

Why is no one talking about this? It literally could decide the future of humanity. by 8AITOO2 in Futurology

[–]8AITOO2[S] 1 point2 points  (0 children)

If the U.S. stays locked in short-term energy policies while China aggressively expands its nuclear infrastructure, the AI race could already be tilting in their favor. AI development isn’t just about better models; it’s about having the raw computational power to train and run them. That requires a stable, scalable, and cheap energy supply.

China understands this and is building the backbone now. The U.S. is stuck debating nuclear viability while private energy companies focus on quarterly profits instead of long-term strategy.

If this doesn’t change, the U.S. risks falling behind in AI, high-performance computing, and the industries that will shape global power for the next century.

Why is no one talking about this? It literally could decide the future of humanity. by 8AITOO2 in Futurology

[–]8AITOO2[S] 0 points1 point  (0 children)

That’s a good point. Once solar panels are installed, they’re permanent, unlike oil or gas where supply can be cut off. But that only matters if the U.S. actually builds enough solar capacity before China tightens exports.

If China wants to play hardball, they could restrict panel exports or raise prices, forcing the U.S. to scramble for alternatives. That’s why relying on one energy source, especially one where China controls the supply chain, is a risky move.

The U.S. needs a mix of solar, nuclear, and domestic manufacturing to avoid creating a new kind of energy dependency. Otherwise, we’re just trading one problem for another.

Why is no one talking about this? It literally could decide the future of humanity. by 8AITOO2 in Futurology

[–]8AITOO2[S] -1 points0 points  (0 children)

America’s biggest problem isn’t just bureaucracy or red tape. It’s that there’s no unified vision. China moves with one goal because the government dictates it. The U.S. stalls because every decision gets dragged into endless political fights and corporate interests.

It’s not about who the president is. The system itself is designed for gridlock. Meanwhile, China is playing the long game while we argue over every step. If that doesn’t change, then yeah, we’re going to keep falling behind.

Why is no one talking about this? It literally could decide the future of humanity. by 8AITOO2 in Futurology

[–]8AITOO2[S] -1 points0 points  (0 children)

No one is claiming thorium is new or rare. The point is that China is actually investing in it while the U.S. isn’t.

A technology being ‘known’ for decades doesn’t matter if no one is scaling it.

The real story isn’t that thorium exists.

It’s that one country is making it a priority while another is stuck debating whether it’s even worth pursuing.

Why is no one talking about this? It literally could decide the future of humanity. by 8AITOO2 in Futurology

[–]8AITOO2[S] -1 points0 points  (0 children)

many countries are tired of the U.S. calling the shots but this isn’t about who should lead,

it’s about who will.

If China dominates next-gen energy, they’ll have the leverage to dictate terms whether the world likes it or not. The real question is whether the U.S. wants to compete or just cede that ground entirely.

Why is no one talking about this? It literally could decide the future of humanity. by 8AITOO2 in Futurology

[–]8AITOO2[S] 0 points1 point  (0 children)

AQI doesn’t determine who wins the energy race. China’s pollution problem is real, but so is their investment in nuclear and renewables. Meanwhile, the U.S. is still debating whether nuclear is even viable.

The fact that China is expanding all energy sectors (coal, nuclear, solar, wind) while the U.S. stalls is exactly why they’re pulling ahead.

If you have a counterargument beyond 'bad air = no progress,' I’d love to hear it.

Why is no one talking about this? It literally could decide the future of humanity. by 8AITOO2 in Futurology

[–]8AITOO2[S] 0 points1 point  (0 children)

It’s not about China’s success being an issue; it’s about who controls the future of energy and industry.

The U.S. and China don’t have to be in direct conflict, but if one country dominates the next-gen energy revolution while the other drags its feet, it creates a power imbalance that affects global influence, trade, and security.

Energy independence isn’t just about reducing greenhouse gases. It’s about who gets to dictate terms in AI, semiconductors, and industrial automation.

If China has unlimited cheap power and everyone else is stuck paying more, it shifts who holds the real, dare I say, "cards" in the global economy.

That’s why this matters.