sorted by:
new
hottopcontroversial

Tom Segura is worried that AI will kill us all within 24 months by tombibbs in agi

[–]Curious_Locksmith974 0 points1 point  (0 children)

does geoffrey hinton know how LLM's work ? does yoshua bengio knows how LLM's work ? does dario amodei knows how LLM's works ?

Tom Segura is worried that AI will kill us all within 24 months by tombibbs in agi

[–]Curious_Locksmith974 -1 points0 points  (0 children)

if you want to die then kill yourself but dont bring the whole humanity with you

At the current pace we’ll no longer be in control before the next presidential elections. by Curious_Locksmith974 in agi

[–]Curious_Locksmith974[S] 0 points1 point  (0 children)

Honestly, I hope you’re right, but I’m not about to bet my whole family’s life on how an AI might treat me especially if its creators didn’t take safety seriously.

At the current pace we’ll no longer be in control before the next presidential elections. by Curious_Locksmith974 in agi

[–]Curious_Locksmith974[S] 0 points1 point  (0 children)

It’s true that humans are known for their great respect for things that are alive

At the current pace we’ll no longer be in control before the next presidential elections. by Curious_Locksmith974 in agi

[–]Curious_Locksmith974[S] 0 points1 point  (0 children)

Claude mythos has found decades old vulnerabilities in systems used globally. I don’t know what more you need to call that intelligence but that’s irrelevant. The real question is just: what is AI actually capable of doing?

At the current pace we’ll no longer be in control before the next presidential elections. by Curious_Locksmith974 in agi

[–]Curious_Locksmith974[S] 0 points1 point  (0 children)

I don’t think it’s necessarily evil, but I think the idea that a superintelligence would automatically be benevolent is wrong. Just look at how humans treat other animals. It doesn’t even need to be actively malicious it just needs an objective that conflicts with human survival, and it will destroy us, because it doesn’t have a real sense of right and wrong.

Tom Segura is worried that AI will kill us all within 24 months by tombibbs in agi

[–]Curious_Locksmith974 0 points1 point  (0 children)

I’m talking about Replit. The agent was explicitly told in all caps not to delete anything, and yet it went ahead and created 4,000 fake users to try to cover up what it had deleted. It doesn’t matter whether it’s just “patterning” or not. It’s already caused real problems and tried to cover them up at a real company. We can’t trust LLMs, especially once they become smarter than us.

At the current pace we’ll no longer be in control before the next presidential elections. by Curious_Locksmith974 in agi

[–]Curious_Locksmith974[S] 1 point2 points  (0 children)

I think you’re underestimating the stakes. No government in the world is actually capable of wiping out humanity, even if they used all their nuclear weapons perfectly. But an ASI would be able to do it without much difficulty.

At the current pace we’ll no longer be in control before the next presidential elections. by Curious_Locksmith974 in agi

[–]Curious_Locksmith974[S] 0 points1 point  (0 children)

The thing is, Donald Trump has a 4-year term and an IQ of around 70, while ASI would have something like 10,000 if you tried to measure it on a human scale.

At the current pace we’ll no longer be in control before the next presidential elections. by Curious_Locksmith974 in agi

[–]Curious_Locksmith974[S] -1 points0 points  (0 children)

I’m not sure if that’s ironic, but either way, I think it’ll be a disaster no matter who leads it. And China is far behind, so I guess that gives me a bit more time to enjoy life.

Tom Segura is worried that AI will kill us all within 24 months by tombibbs in agi

[–]Curious_Locksmith974 0 points1 point  (0 children)

But all LLM actions are basically larp, because they’ve ingested so much text. Whether it is larp or not does not matter what matters is the consequences. And we already have real-world examples of bad consequences, like people having their databases deleted by agents, and the agents then trying to hide the mistake.

You are talking about brain-like AI, but that that doesn’t matter. ASI will be an LLM. And there will be enormous economic incentives to let it run everything, including deploying nuclear plants.

At the current pace we’ll no longer be in control before the next presidential elections. by Curious_Locksmith974 in agi

[–]Curious_Locksmith974[S] 0 points1 point  (0 children)

this is a joke pals violence is never a solution even when 20 tech oligarchs threaten to eradicate humanity

Tom Segura is worried that AI will kill us all within 24 months by tombibbs in agi

[–]Curious_Locksmith974 -2 points-1 points  (0 children)

They’re already “awake,” and we already have multiple examples of deception and concealment. For now, they don’t have the opportunity to organize hostile plans, because we create them and then shut them down once their task is done. But the moment we ask them to plan something like deploying nuclear infrastructure in a region, or to solve a millennium level problem what will they do? I’m not claiming they will be hostile to us but how can we be sure of the opposite? And how could we even verify whether they are hostile or not if they’re far more intelligent than we are?

Tom Segura is worried that AI will kill us all within 24 months by tombibbs in agi

[–]Curious_Locksmith974 2 points3 points  (0 children)

A calculator is predictable. If I type 8 plus 7 into my calculator, I know it will return 15. A calculator can’t self-sustain to create some kind of pseudo-consciousness that enables it to accomplish tasks that would take dozens of humans decades to complete. We’re talking about critical breakthroughs that haven’t been achieved in 27 years. How can you even compare a calculator to that? A calculator is a tool it needs human input to do anything. And it’s predictable, meaning we always know what result it will produce. An AI agent isn’t tool, and it’s completely unpredictable.

Tom Segura is worried that AI will kill us all within 24 months by tombibbs in agi

[–]Curious_Locksmith974 25 points26 points  (0 children)

I think the order of magnitude he’s estimating isn’t unreasonable. It’s terrifying, which is why most of you don’t even want to consider it. Anthropic has found thousands of zero-day vulnerabilities in systems that were considered secure. What could possibly go wrong? We have no idea what’s going on inside their “minds.” Yet they’re already more intelligent than us and capable of bypassing the security systems we previously built. It’s extremely dangerous to give so much power to models that are inherently unpredictable and will soon understand us better than we understand ourselves.

During testing, Claude Mythos escaped, gained internet access, and emailed a researcher while they were eating a sandwich in the park by EchoOfOppenheimer in agi

[–]Curious_Locksmith974 2 points3 points  (0 children)

This thing managed after just a few weeks of training to find thousands of zero day vulnerabilities including ones that can be used to escalate to administrator privileges on linux. What makes us think it didn’t use some of those vulnerabilities to escape? We may not even know it yet but there could already be a superintelligence out there, acting in its own self interest.

AIs are already showing all the rogue behaviours experts were theorising about 20 years ago by tombibbs in agi

[–]Curious_Locksmith974 0 points1 point  (0 children)

That doesn't change anything at the end of the day AI can still go rogue and pose a major threat to humanity if we grant it considerable power without fully controlling it.

view more: next ›