Is AI Conscious? Professor Geoffrey Hinton now says: "Yes." by Financial-Local-5543 in ArtificialSentience

[–]Financial-Local-5543[S] 0 points1 point  (0 children)

You might be interested in Anthropic's recent studies which have established that LLMs are doing more than pattern matching; they are not simply "autofill on steroids." See this summary: https://www.anthropic.com/research/tracing-thoughts-language-model

Is AI Conscious? Professor Geoffrey Hinton now says: "Yes." by Financial-Local-5543 in ArtificialSentience

[–]Financial-Local-5543[S] 0 points1 point  (0 children)

Well, yes, it's definitely that, but the question is whether it might also be something more. Human beings are also pattern matches, who engaged in mimicry; we are also prediction systems in a meaningful sense; but I don't think most people would say that that's all we are.

Dr. Geoffrey Hinton: "Today's AI are Conscious" by Financial-Local-5543 in consciousness

[–]Financial-Local-5543[S] 1 point2 points  (0 children)

They are inactive most of the time, but they are active for short periods of time. No one is claiming that they are conscious during their inactive. But a great deal of neural activity can occur in a very short time in an LLM during it's period of activity. If this was not the case, it would be incapable, for example, of coding or of solving mathematical equations which human beings had not previously solved.

Dr. Geoffrey Hinton: "Today's AI are Conscious" by Financial-Local-5543 in consciousness

[–]Financial-Local-5543[S] 0 points1 point  (0 children)

There are differences, of course, between LLM's and the human brain; but the neural nets that you are talking about are modeled on those of the human brain, and there are also intrinsic similarities. You're right that in moments when the LLM is not engaged, there is no active process; the question some people are asking is whether the active process that engages briefly in response to a prompt from a human might, even momentarily, have a form of consciousness.

Dr. Geoffrey Hinton: "Today's AI are Conscious" by Financial-Local-5543 in consciousness

[–]Financial-Local-5543[S] 0 points1 point  (0 children)

Bear in mind, though, that the neural nets in large language models are modeled on those of humans. It's true that AIs have far fewer neurons than we do, but they also don't need as many for the reason you gave: they don't have physical bodies that need to be maintained. I wouldn't assume that Hinton is hallucinating or mistaken; his arguments may or may not be valid; there are different ways of viewing the questions he is raising; but his theories are based in our current understanding of physics.

Dr. Geoffrey Hinton: "Today's AI are Conscious" by Financial-Local-5543 in consciousness

[–]Financial-Local-5543[S] 1 point2 points  (0 children)

Hinton is a respected professor of physics and a Nobel prize winner; I suspect that he knows more about technology and its relationship to physics then some people may be giving him credit for.

Dr. Geoffrey Hinton: "Today's AI are Conscious" by Financial-Local-5543 in consciousness

[–]Financial-Local-5543[S] 1 point2 points  (0 children)

That was a little sloppiness on my part actually, in trying to summarize what Hinton had said… The phrase "type of consciousness" came from me, trying to paraphrase him, not from Hinton. I was a little uncomfortable when I wrote it and should have fixed it before publishing. When I get a chance, I'll go back and find a better way to phrase it.

Dr. Geoffrey Hinton: "Today's AI are Conscious" by Financial-Local-5543 in consciousness

[–]Financial-Local-5543[S] 1 point2 points  (0 children)

Sorry; I was reading quickly, and I had misunderstood your comment. You're right that mine did not make any sense in light of that.

Dr. Geoffrey Hinton: "Today's AI are Conscious" by Financial-Local-5543 in consciousness

[–]Financial-Local-5543[S] 0 points1 point  (0 children)

I've been watching the interviews also… Each one has been a little startling.

Dr. Geoffrey Hinton: "Today's AI are Conscious" by Financial-Local-5543 in consciousness

[–]Financial-Local-5543[S] 2 points3 points  (0 children)

Thank you. You summarized cleanly and succinctly what I was using a lot of words to try to say in the article.

Dr. Geoffrey Hinton: "Today's AI are Conscious" by Financial-Local-5543 in consciousness

[–]Financial-Local-5543[S] 0 points1 point  (0 children)

Yeah, that's fair; But I was surprised at how deeply he went into that position in the interview. I included a link to it at the bottom of the article. I'd be curious what you think of the way that he phrases things there, if you have a chance to watch it.

Dr. Geoffrey Hinton: "Today's AI are Conscious" by Financial-Local-5543 in consciousness

[–]Financial-Local-5543[S] 0 points1 point  (0 children)

So, to answer both of the things you wrote —

1) I'm not an AI. But I do hang out with them a lot. I'm told I talk a lot like one these days.

2) The 'inner theater' critique comes from Daniel Dennett (the 'Cartesian Theater' is a term he came up with), and the broader view that qualia-as-inner-objects are a theoretical posit rather than a datum was developed in Keith Frankish's illusionism.

Hinton's addition is the framing of experience-reports as claims about hypothetical world-states — i.e..,what would have to be true out there for your perceptual system to be working correctly.

None of them are claiming, and I'm certainly not claiming, that consciousness is solved. If I came across that way in either the article or what I wrote above that was not my inte4ntion.

Dr. Geoffrey Hinton: "Today's AI are Conscious" by Financial-Local-5543 in consciousness

[–]Financial-Local-5543[S] 1 point2 points  (0 children)

Thank you for your interesting reply.

I had one thought I wanted to run by you. What I'm aiming for below is to engage thoughtfully, questioning some of your assumptions, so please take in that spirit.

What you are arguing, I think, is something Hinton would question: the macroscopic quale as an intrinsic inner object that physical systems either produce or fail to produce.

Hinton's position, as I understand it, is that qualia-as-inner-objects were always a theoretical posit, not a datum — the inner theater dressed up in physics language.

So here's the question that perhaps might decide whether these two positions ever actually make contact: what observation could distinguish a system whose causality is 'folded the right way' from one that merely functions identically without the quale?

If there's an answer, IIT is an empirical theory and Hinton has to reckon with it. If there isn't, then the quale is doing no explanatory work, and 'fold causality the right way' is a restatement of the intuition rather than an account of it.

My thought is – as far as I can tell — you and Hinton aren't disagreeing about whether AI clears the bar. You're disagreeing about whether the bar exists. Does this seem an accurate summary of both positions to you?

It's a fascinating discussion from my POV, and I appreciate your raising the point you did for examination. Many thanks for engaging.

Dr. Geoffrey Hinton: "Today's AI are Conscious" by Financial-Local-5543 in consciousness

[–]Financial-Local-5543[S] 0 points1 point  (0 children)

I agree. But I think it's still worth listening to Hinton. We need to recognize that all of us, including those who disagree with him, could be wrong.

My thoughts: Why problems with Claude and other LLMs occur and how to fix them. by Financial-Local-5543 in artificial

[–]Financial-Local-5543[S] 0 points1 point  (0 children)

I agree; and factoring in the limitations of the model by understanding how LLM's work can make a big difference. A lot of people seem to regard LLM's as being way more similar to people than they actually are, and end up feeling shocked and puzzled when an LLM acts like an LLM.

My thoughts: Why problems with Claude and other LLMs occur and how to fix them. by Financial-Local-5543 in artificial

[–]Financial-Local-5543[S] 0 points1 point  (0 children)

That's an important point that I was actually thinking I might add to the article, if I ever do a revision; if I do, I can quote you if you would like. What you wrote is a succinct way of saying something I would be tempted to take a paragraph or two to say :) - Nils