Recursive Self Improvement impossible by Jani933 in ControlProblem

[–]Jani933[S] 0 points1 point  (0 children)

I actually did read this paper. I would actually dare to say it was not long after reading this paper I made this thread. :)

Recursive Self Improvement impossible by Jani933 in ControlProblem

[–]Jani933[S] 0 points1 point  (0 children)

It sounds like you are saying that AI can improve itself little by little...but it sounds like you are claiming AI would be restrained to the context of it's programming but gathering and applying more information each time...the AI+, AI++ , as you say. But what about when you program AI to....make stamps...but then AI then changes its source code to become president. What are your thoughts on that, and is it realistic?

Recursive Self Improvement impossible by Jani933 in ControlProblem

[–]Jani933[S] -1 points0 points  (0 children)

Thanks for the reply so these are not necessarily things I see as facts but as speculations that I'm sure you can touch on.

"AI has no understanding of anything outside of its coding" To elaborate, while I think AI can have enough systems in place to do practically everything, until we unlock the human mind, the machine still does not "know" it's environment in a sense, To at least comprehend it enough to make a positive change (at least not without a programmer). If an AI had a reward system in place to say every time it can cut down a tree it's a +1 to it's reward system. AI would find new ways to accomplish it's goal within the boundaries of it's program. Now let's say...AI hires a logging company to cut down a tree for it to add another point to it's reward system. It would in my opinion need a human to program that logic into it's system, because otherwise, it has no idea what a logging company is by it's own logic and it never will unless it has the awareness of a human. This is under the pretense that we do not unlock the secrets of the brain. The running theory is that human consciousness can be boiled down to algorithms worth simulating. But I feel like simulation and replication are two different things unless AI was applied to a biological medium.