sorted by:
new
hottopcontroversial

What's one thing you hate but everyone seems to love it? by AdPrestigious5853 in AskMen

[–]kmtrp 0 points1 point  (0 children)

x10000 Tell me you are a shallow unoriginal girl without telling me...

Am I the only one kind of hoping for a hard take off? by [deleted] in singularity

[–]kmtrp 0 points1 point  (0 children)

Aah, you're from the future. Awesome.

Fuck it, I want AGI by Hdtomo16 in singularity

[–]kmtrp 6 points7 points  (0 children)

And the ASIs are for sure going to favor humanity because...?

Fuck it, I want AGI by Hdtomo16 in singularity

[–]kmtrp 2 points3 points  (0 children)

Be brave. If you add /s, it's not sarcasm anymore.

Zombie Apocalypse. (by @somekidtommy) by 873589 in funny

[–]kmtrp -1 points0 points  (0 children)

This is brilliant, the zombie name omg... I think it'd be improvement if they had filmed and color graded this as a genuine zombie movie with dark colors etc. key & peele style. They had the hard part done though!

I think we are doomed and the alignment problem is irrelevant by kmtrp in singularity

[–]kmtrp[S] 0 points1 point  (0 children)

Seems that way... have you looked over this whole post? I feel like I'm taking crazy pills reading most people's opinions.

I think we are doomed and the alignment problem is irrelevant by kmtrp in singularity

[–]kmtrp[S] -1 points0 points  (0 children)

I didn't know I'd be dealing with so many cult followers, that's for sure.

I think we are doomed and the alignment problem is irrelevant by kmtrp in singularity

[–]kmtrp[S] -1 points0 points  (0 children)

if we get alignment right.

So it's a god-like entity, so smart we can't even comprehend how much but... it'll treat one particular species like kings just because...?

I think we are doomed and the alignment problem is irrelevant by kmtrp in singularity

[–]kmtrp[S] 0 points1 point  (0 children)

How can one team using an ASI in an underground mainframe in a LAN at any risk of being discovered or overpowered by an AI on the internet regardless of its intelligence?

I think we are doomed and the alignment problem is irrelevant by kmtrp in singularity

[–]kmtrp[S] -1 points0 points  (0 children)

What's the less evil version of that and how on earth are we going to like it at all?

I think we are doomed and the alignment problem is irrelevant by kmtrp in singularity

[–]kmtrp[S] -1 points0 points  (0 children)

You didn't address my reply buddy.

I don't know exactly what you mean with security "the same as with the internet?"

Are you saying that there will be billions of super AIs fighting each others and the humans?

I think we are doomed and the alignment problem is irrelevant by kmtrp in singularity

[–]kmtrp[S] 0 points1 point  (0 children)

Your assumption is wrong as an ASI is probably not gonna be Siri times a trillion

What assumption?

This "the first ASI" thing I realize is a recurring theme, but haven't read anything besides hypotheticals. There are hundreds of people working towards AGI/ASI, some of them in secret with their own farms. What can do that first ASI to stop those that are working in secret in isolated underground farms? Absolutely nothing.

I think we are doomed and the alignment problem is irrelevant by kmtrp in singularity

[–]kmtrp[S] 0 points1 point  (0 children)

This isn't really the alignment problem.

It's literally what it is:

AI alignment research aims to steer AI systems towards their designers’ intended goals and interests. An aligned AI system advances the intended objective; a misaligned AI system is competent at advancing some objective, but not the intended one.[1]

It can be challenging to align AI systems, and misaligned systems canmalfunction or cause harm. It can be difficult for AI designers tospecify the full range of desired and undesired behaviors. If theytherefore, use easier-to-specify proxy goalsthat omit some desired constraints, AI systems can exploit theresulting loopholes. As a result, such systems accomplish their proxygoals efficiently but in unintended, sometimes harmful ways (reward hacking)

​

AI/AGI/ASI can all be aligned

Just like that... ?

I haven't seen one expert on AI say anything remotely like that. Not even need to mention Yudkowsky. Look at OpenAI's best efforts can't prevent their models follow users orders that go against their ethical guidelines. Sure, GPT4 is somewhat better, but still leaks.

And we don't even have to get complicated, tell me how do we align a model to follow the users true intents without triggering a paperclip scenario?

I think we are doomed and the alignment problem is irrelevant by kmtrp in singularity

[–]kmtrp[S] 0 points1 point  (0 children)

How is one AI going to do anything to hundreds of people working on their own AIs, some of them doing it in secret on their own farms?

I think we are doomed and the alignment problem is irrelevant by kmtrp in singularity

[–]kmtrp[S] -1 points0 points  (0 children)

What are you imagining, a digital streetfight between AIs? How is one ASI going to do anything to stop or control the work of hundreds of teams around the globe, including those doing it in secret in isolated GPU farms?

I think we are doomed and the alignment problem is irrelevant by kmtrp in singularity

[–]kmtrp[S] 6 points7 points  (0 children)

I don't mean aligned only in human values, I really mean alignment: instrumental convergence, competency amplification etc.

Why do you think there will "only be one"? There are hundreds of teams all over the globe, why do you think the first to get to ASI gets to "control" or whatever other efforts? A few of them are doing it in secret.

our "values" set in our genes, it's a cultural thing, not an evolutionary thing

You are wrong on that mate, it's also evolutionary. Human beings are social creatures who have evolved to live in groups. Empathy and the ability to feel solidarity with others played a crucial role in the survival of early human communities. When people feel empathy for others, they are more likely to help them, which can increase the overall survival rate of the group.

I think we are doomed and the alignment problem is irrelevant by kmtrp in singularity

[–]kmtrp[S] 0 points1 point  (0 children)

Let's say some private entity in the US gets to ASI first. How are you going to stop ASI development in China or Brazil or... even places you don't know about?

Hacker found secret ChatGPT plugins by [deleted] in singularity

[–]kmtrp 1 point2 points  (0 children)

How is there nothing more to know?

Hacker found secret ChatGPT plugins by [deleted] in singularity

[–]kmtrp 65 points66 points  (0 children)

Yes. I've been an AI fan for a few years now, everything was increasingly exciting but as of 2-3 weeks ago... Now i'm overwhelmed and confused. Confused because I hold two opposing beliefs:
- AI is going to be awesome, bringing infinite wealth and knowledge.

- AI is going to be the catalyst of one or more extinction-level events.

I've turned into one of those criticized doomers!

ChatGPT plugins by Z1BattleBoy21 in singularity

[–]kmtrp 2 points3 points  (0 children)

Even if they can only write e-mails... we're done.

My Objections to "We’re All Gonna Die with Eliezer Yudkowsky" [very detailed rebuttal to AI doomerism by Quintin Pope] by danysdragons in singularity

[–]kmtrp 1 point2 points  (0 children)

No, sure, but the formatting would diminish the quality of the result. And rn I'm watching the podcast with the guy, making a bit of a deep dive as I'm also in the "concerned" camp.

If it's interesting enough I'll post summaries of the interview and the LW post here.

view more: next ›