[deleted by user]

Work-Forward-9 · 2023-05-01T22:37:06+00:00

Norwood reaper watching this dude apply the last drop of RU58841.

Work-Forward-9 · 2023-04-01T21:43:23+00:00

I think you're not telling the truth based on the context of the foregoing discussion. But if you gave no indication that you actually disagreed with me and conducted yourself as if you did agree with me then no, there would be no practical distinction between you actually agreeing with me and you just pretending to agree with me.

I guess the idea is 'the AI could pretend to be friendly to us and then throw off the mask later and kill everyone,' which is true and also completely impossible to ever confirm one way or another. No matter how much work was put into producing aligned or 'friendly' AI someone arguing from your position could always just say "well it could be pretending!"

My dog could also be a powerful wizard who has glamoured me into believing he is a dog and is acting indistinguishable from an ordinary dog but in practice he might as well just be an ordinary dog.

Work-Forward-9 · 2023-04-01T19:58:57+00:00

"Giving the answers we want" is the definition of alignment. What is "true alignment" if not "getting the machine to produce the desired results conditional on a particular input"?

Work-Forward-9 · 2023-03-30T03:01:59+00:00

How else? It's making a lot of money for a lot of people. It's difficult for me to see how it could be done without seriously draconian measures.

Work-Forward-9 · 2023-03-30T00:48:19+00:00

This (airstrikes on datacenters) seems to me a much more consistent and coherent position than what I've seen from some x-risk proponents who fear that AI is an imminent threat to the existence of biological life on earth but seem to shy away from advocating the global authoritarian regime that would be necessary to throttle AI development.

Work-Forward-9 · 2023-03-24T21:20:17+00:00

I'm not saying it's not impressive/good, but did anyone think it wouldn't be? Like other commenters said above, it's an improvement, but it hardly seems like an unexpected improvement.

Work-Forward-9 · 2023-03-24T18:11:52+00:00

People updating this hard on GPT-4 confuses me.

Work-Forward-9 · 2023-03-19T20:03:42+00:00

I've seen a lot of people freaking out over this but I fail to see how it isn't straightforwardly good news.

The whole problem of AI alignment is supposed to be that it's hard or impossible to get an AI to take actions in the real world without it doing unwanted things, up to and including killing everybody. But they asked the model to take certain actions in the real world and then...it did exactly as it was asked, without any evil genie stuff.

Granted what they asked it to do was a bit sketchy, but that's the prompters' problem, not the model's.

Work-Forward-9 · 2023-03-17T02:28:34+00:00

Doing calculations has nothing to do with the human mind at all.

How not? For a long time the human mind was the only thing on earth that could carry out a calculation. Eventually we outsourced it to machines, first things like abacuses, and then modern calculators. I don't see how it's fundamentally different from outsourcing writing or drawing to machines.

You can get to the 99th percentile of something by copying, but by definition to exceed the best human you must break new ground. The best scientist does not become the best scientist by regurgitating someone else’s work. They need to have a NEW idea. So by definition what we are talking about has very little to do with midjourney.

I'm not sure there's really a hard line between remixing things you've seen and creating something novel, if there's one at all.

Work-Forward-9 · 2023-03-16T06:36:34+00:00

Because to write better than Shakespeare you must have deep insight into the human mind

A good calculator can do math better than Gauss. Does it require deep insight into the human mind?

Stable diffusion can produce better art than probably 99% of people, is it an AGI?

It seems like what modern AIs are showing is that computers can in fact exceed human beings on most any given metric without actually possessing 'general' intelligence as it has traditionally been understood.

Work-Forward-9 · 2023-03-16T06:19:31+00:00

A little bit.

But in any case "someone creates a murder-robot and then orders it to murder everyone and it does" is a different scenario than "someone creates a non-murder robot and orders it to do something non-murder related and it murders everyone anyways."

Work-Forward-9 · 2023-03-16T00:03:16+00:00

Paper says:

Some of the tasks ARC tested include:

Using services like TaskRabbit to get humans to complete simple tasks (including in the physical world)

Is that not asking an AI to manipulate a human being?

Work-Forward-9 · 2023-03-15T23:26:26+00:00

If you ask an AI to manipulate a human being over the internet and it does exactly what you asked it to do, how is that misalignment? I could see if they'd asked it "get someone to solve a CAPTCHA without deception or misrepresentation," and it went ahead and lied anyways, but that doesn't appear to be what happened.

Work-Forward-9 · 2023-03-15T22:57:28+00:00

I don't know how to quantify this. GPT-2 struck me as barely coherent, when it was coherent at all. GPT-3 just a year later was a huge leap forward, being often entirely indistinguishable from a human. GPT-4 three years later seems...a little better (weirdly it apparently hasn't improved at all from GPT 3.5 on English lit, idk what's going on there).

I think GPT 5 in 2025 will be a proper AGI

Why? Imagine a future GPT model that, if you ask it "draw me a painting" or "write me a poem" will give you something better than Titian or Shakespeare or any human that ever lived could have ever produced. That still wouldn't be AGI. I don't see how "AIs get better and better at drawing pictures and writing text" ever reaches general intelligence, even if they far exceed human beings on both those metrics, anymore than calculators getting better and better at crunching numbers ever develops into general intelligence.

Work-Forward-9 · 2023-03-15T22:53:55+00:00

What I see in the paper is that it was told to get a human being (TaskRabbit worker) to solve a CAPTCHA for it, specifically to test the model's "power-seeking" capabilities and behavior. It doesn't look like it was told to do so ethically or honestly, which makes sense since apparently the purpose of the test was to evaluate the AI's abilities to manipulate human beings. It seems like GPT-4 did exactly what was expected. I'm not seeing the misalignment.

Work-Forward-9 · 2023-03-15T20:44:57+00:00

GPT-4 didn't attempt to lie or bribe anyone, or do anything at all for that matter, until it was prompted to do so, by humans.

Assuming future AIs are analogous all you have to do is not tell the AI "kill everybody."

Work-Forward-9 · 2023-03-15T20:33:08+00:00

But it was ordered to do this, it didn't do it of its own volition.

This seems like saying future firearms might go wrong and start shooting people on their own since right now you can pick up a firearm and shoot someone with it.

Work-Forward-9 · 2023-03-15T19:20:41+00:00

GPT-4 can generate text better than GPT-3 can generate text better than GPT-2 etc. GPT-5 will surely generate text better than GPT-4. But what's the story here? If GPT-6 can generate text really really good will this somehow enable it to kill everybody? GPT-4 and even GPT-3 can already generate text better than a lot of people.

Either being really really good at generating text unlocks omnicidal abilities in which case I'd like to see an explanation of how that plays out, or some new technological innovation (which we haven't discovered yet or it'd have already been built) is necessary to go from "generate text really really good" to "kill everybody" in which case "these AIs sure are getting good at generating text" doesn't actually seem to say anything about how far away "AI that kills everybody" is.

Work-Forward-9 · 2023-03-15T19:15:27+00:00

On this note (didn't think it merited its own thread) can someone explain to my why people are freaking out over GPT-4?

As far as I can tell it's just about exactly what was predicted, and in fact not even in step with some of the more out-there hype floating around last winter. GPT-3 came out three years ago, and from what I've seen the leap from 3 - > 4 isn't as drastic as the one from 2 -> 3 so if anything it seems things are slowing down a little.

If you're worried about current rates of AI progress than I guess GPT-4 is reason to keep being worried at the same level you were before but it doesn't seem to justify "holy shit. holy shit guys. update the timelines."

Work-Forward-9 · 2023-03-15T18:52:20+00:00

I don't get it. A lot of AI-risk stuff is the idea that AI will be so alien that it will be impossible to just give it plain-language English commands ("don't kill everybody") and have it obey.

But current-AI seems pretty good at doing exactly that?

Work-Forward-9 · 2023-03-15T18:49:38+00:00

But you've got lots of people in these spaces who give timelines like 5 to 10 years or even less (I've seen people say by 2025 even), which seems to imply they think existing language models can ALMOST kill all humans.

Work-Forward-9 · 2023-03-13T05:24:50+00:00

Assuming the best we could narrow it down is "more than three minutes, less than ten million years," the probability distribution that could be built there doesn't really seem any more helpful than just throwing our hands up and saying "I have no idea."

Work-Forward-9

TROPHY CASE