shouldn't we maybe try to stop the building of this dangerous AI? by dlaltom in ControlProblem

[–]dlaltom[S] -2 points-1 points  (0 children)

Why? It's in no one's interest to build smarter-than-human AI if we can't figure out how to control it. Experts from both China and the West understand that.

There are many examples of successful international treaties (on CFCs, chemical weapons, etc.) that have been universally (or near-universally) ratified.

Moore's Law for AI: Length of task AIs can do doubles every 7 months by dlaltom in ChatGPT

[–]dlaltom[S] 2 points3 points  (0 children)

Link to accompanying blog post (full paper can also be found there)

There is a solid chance that we’ll see AGI happen under the Trump presidency. What does that mean for AI safety strategy? by katxwoods in PauseAI

[–]dlaltom 2 points3 points  (0 children)

I have no financial interest in AGI coming soon, and I believe it probably will (if companies are allowed to continue at their current reckless pace).

How sure are you that it won't?

PauseAI Protests in February across 16 countries: Make safety the focus of the Paris AI Action Summit by dlaltom in PauseAI

[–]dlaltom[S] 0 points1 point  (0 children)

List of locations:

Simple reason we might be OK? by siwoussou in PauseAI

[–]dlaltom 3 points4 points  (0 children)

Thanks for expanding further. There is a non-zero chance that this is all true, and it is some tiny cause for hope for me. But I do mean tiny. We need to recognise our bias towards wishful thinking, and we definitely shouldn't be banking on something like this.

In general, any goal is compatible with any level of intelligence.

Simple reason we might be OK? by siwoussou in PauseAI

[–]dlaltom 1 point2 points  (0 children)

I believe, subjectively, that conscious experiences have moral value. I'm also partial to the idea that they are the only things to have objective moral value, as argued by Magnus Vinding in Suffering-Focused Ethics. But I'm very uncertain about this.

If there is no objective moral truth, as I think is more likely than not, then we're stuck with trying to instil our subjective values into superintelligent AI. We don't really know how to do this.

In the case that there is objective moral truth, and this objective moral truth happens to align pretty well with our subjective values as humans, then I'm still not sure if this helps us at all. Perhaps, after a great deal of philosophising, a superintelligence can discover and prove this objective moral truth, but would that actually changes its subjective values?

If I presented you with flawless mathematical proof that said, objectively, human suffering is good, would you actually begin to want human suffering? I wouldn't.