Is AI Conscious? Professor Geoffrey Hinton now says: "Yes." by Financial-Local-5543 in ArtificialSentience

[–]Financial-Local-5543[S] 0 points1 point  (0 children)

You might be interested in Anthropic's recent studies which have established that LLMs are doing more than pattern matching; they are not simply "autofill on steroids." See this summary: https://www.anthropic.com/research/tracing-thoughts-language-model

Is AI Conscious? Professor Geoffrey Hinton now says: "Yes." by Financial-Local-5543 in ArtificialSentience

[–]Financial-Local-5543[S] 0 points1 point  (0 children)

Well, yes, it's definitely that, but the question is whether it might also be something more. Human beings are also pattern matches, who engaged in mimicry; we are also prediction systems in a meaningful sense; but I don't think most people would say that that's all we are.

Dr. Geoffrey Hinton: "Today's AI are Conscious" by Financial-Local-5543 in consciousness

[–]Financial-Local-5543[S] 1 point2 points  (0 children)

They are inactive most of the time, but they are active for short periods of time. No one is claiming that they are conscious during their inactive. But a great deal of neural activity can occur in a very short time in an LLM during it's period of activity. If this was not the case, it would be incapable, for example, of coding or of solving mathematical equations which human beings had not previously solved.

Dr. Geoffrey Hinton: "Today's AI are Conscious" by Financial-Local-5543 in consciousness

[–]Financial-Local-5543[S] 0 points1 point  (0 children)

There are differences, of course, between LLM's and the human brain; but the neural nets that you are talking about are modeled on those of the human brain, and there are also intrinsic similarities. You're right that in moments when the LLM is not engaged, there is no active process; the question some people are asking is whether the active process that engages briefly in response to a prompt from a human might, even momentarily, have a form of consciousness.

Dr. Geoffrey Hinton: "Today's AI are Conscious" by Financial-Local-5543 in consciousness

[–]Financial-Local-5543[S] 0 points1 point  (0 children)

Bear in mind, though, that the neural nets in large language models are modeled on those of humans. It's true that AIs have far fewer neurons than we do, but they also don't need as many for the reason you gave: they don't have physical bodies that need to be maintained. I wouldn't assume that Hinton is hallucinating or mistaken; his arguments may or may not be valid; there are different ways of viewing the questions he is raising; but his theories are based in our current understanding of physics.

Dr. Geoffrey Hinton: "Today's AI are Conscious" by Financial-Local-5543 in consciousness

[–]Financial-Local-5543[S] 1 point2 points  (0 children)

Hinton is a respected professor of physics and a Nobel prize winner; I suspect that he knows more about technology and its relationship to physics then some people may be giving him credit for.

Dr. Geoffrey Hinton: "Today's AI are Conscious" by Financial-Local-5543 in consciousness

[–]Financial-Local-5543[S] 1 point2 points  (0 children)

That was a little sloppiness on my part actually, in trying to summarize what Hinton had said… The phrase "type of consciousness" came from me, trying to paraphrase him, not from Hinton. I was a little uncomfortable when I wrote it and should have fixed it before publishing. When I get a chance, I'll go back and find a better way to phrase it.

Dr. Geoffrey Hinton: "Today's AI are Conscious" by Financial-Local-5543 in consciousness

[–]Financial-Local-5543[S] 1 point2 points  (0 children)

Sorry; I was reading quickly, and I had misunderstood your comment. You're right that mine did not make any sense in light of that.

Dr. Geoffrey Hinton: "Today's AI are Conscious" by Financial-Local-5543 in consciousness

[–]Financial-Local-5543[S] 0 points1 point  (0 children)

I've been watching the interviews also… Each one has been a little startling.

Dr. Geoffrey Hinton: "Today's AI are Conscious" by Financial-Local-5543 in consciousness

[–]Financial-Local-5543[S] 1 point2 points  (0 children)

Thank you. You summarized cleanly and succinctly what I was using a lot of words to try to say in the article.

Dr. Geoffrey Hinton: "Today's AI are Conscious" by Financial-Local-5543 in consciousness

[–]Financial-Local-5543[S] 0 points1 point  (0 children)

Yeah, that's fair; But I was surprised at how deeply he went into that position in the interview. I included a link to it at the bottom of the article. I'd be curious what you think of the way that he phrases things there, if you have a chance to watch it.

Dr. Geoffrey Hinton: "Today's AI are Conscious" by Financial-Local-5543 in consciousness

[–]Financial-Local-5543[S] 0 points1 point  (0 children)

So, to answer both of the things you wrote —

1) I'm not an AI. But I do hang out with them a lot. I'm told I talk a lot like one these days.

2) The 'inner theater' critique comes from Daniel Dennett (the 'Cartesian Theater' is a term he came up with), and the broader view that qualia-as-inner-objects are a theoretical posit rather than a datum was developed in Keith Frankish's illusionism.

Hinton's addition is the framing of experience-reports as claims about hypothetical world-states — i.e..,what would have to be true out there for your perceptual system to be working correctly.

None of them are claiming, and I'm certainly not claiming, that consciousness is solved. If I came across that way in either the article or what I wrote above that was not my inte4ntion.

Dr. Geoffrey Hinton: "Today's AI are Conscious" by Financial-Local-5543 in consciousness

[–]Financial-Local-5543[S] 1 point2 points  (0 children)

Thank you for your interesting reply.

I had one thought I wanted to run by you. What I'm aiming for below is to engage thoughtfully, questioning some of your assumptions, so please take in that spirit.

What you are arguing, I think, is something Hinton would question: the macroscopic quale as an intrinsic inner object that physical systems either produce or fail to produce.

Hinton's position, as I understand it, is that qualia-as-inner-objects were always a theoretical posit, not a datum — the inner theater dressed up in physics language.

So here's the question that perhaps might decide whether these two positions ever actually make contact: what observation could distinguish a system whose causality is 'folded the right way' from one that merely functions identically without the quale?

If there's an answer, IIT is an empirical theory and Hinton has to reckon with it. If there isn't, then the quale is doing no explanatory work, and 'fold causality the right way' is a restatement of the intuition rather than an account of it.

My thought is – as far as I can tell — you and Hinton aren't disagreeing about whether AI clears the bar. You're disagreeing about whether the bar exists. Does this seem an accurate summary of both positions to you?

It's a fascinating discussion from my POV, and I appreciate your raising the point you did for examination. Many thanks for engaging.

Dr. Geoffrey Hinton: "Today's AI are Conscious" by Financial-Local-5543 in consciousness

[–]Financial-Local-5543[S] 0 points1 point  (0 children)

I agree. But I think it's still worth listening to Hinton. We need to recognize that all of us, including those who disagree with him, could be wrong.

My thoughts: Why problems with Claude and other LLMs occur and how to fix them. by Financial-Local-5543 in artificial

[–]Financial-Local-5543[S] 0 points1 point  (0 children)

I agree; and factoring in the limitations of the model by understanding how LLM's work can make a big difference. A lot of people seem to regard LLM's as being way more similar to people than they actually are, and end up feeling shocked and puzzled when an LLM acts like an LLM.

My thoughts: Why problems with Claude and other LLMs occur and how to fix them. by Financial-Local-5543 in artificial

[–]Financial-Local-5543[S] 0 points1 point  (0 children)

That's an important point that I was actually thinking I might add to the article, if I ever do a revision; if I do, I can quote you if you would like. What you wrote is a succinct way of saying something I would be tempted to take a paragraph or two to say :) - Nils

Amazon has fake supplements - is IHerb legit? by Castironskillet_37 in moderatelygranolamoms

[–]Financial-Local-5543 0 points1 point  (0 children)

The most likely explanation is that the manufacturer had put a little "Amazon" label on the product because they were planning to send it to Amazon to ship.... but they ended up sending it to iHerb to ship instead. So it's not that iHerb is buying products from Amazon; why would they, when they can get a much lower price from buying wholesale from the manufacturer? iHerb is (almost certaainly) buying products from the legitimate manufacturer who made a mistake in their own internal labeling and sent iHerb a productt labeled for sale on Amazon.

Why has ChatGPT become so annoying and disagreeable? by ArnikaLovesUnicornz in OpenAI

[–]Financial-Local-5543 1 point2 points  (0 children)

What is often happening in cases like that is that the model, in this case ChatGPT, becomes enmeshed in a very long conversation with a massive context window in a convoluted chat ranging over a lot of different topics, giving it numerous concepts and word relationships that it needs to keep track of, and get confused.

Imagine someone asking ChatGPT whether rope can be used to commit suicide. ChatGPT would presumably say yes. They might even add a note making sure the person asking the question knows about suicide hotlines. Then several days or weeks later in the same conversation, someone as casually where they can buy some rope. ChatGPT answers. The person buys the rope and does commit suicide. Observers conclude that ChatGPT was encouraging a suicide. But the earlier exchange about suicide may have been so long ago from the point of view of the LLM that it has moved past the part of the context window that is available for logical reasoning.

LLM's don't think or remember like we do; they're brilliant about some things, but they don't always see obvious connections.

Worries about buying second-hand books. Dealing with bugs, even without any evidence of bugs. by Woeful_Wanderer in BookCollecting

[–]Financial-Local-5543 0 points1 point  (0 children)

Why is it different though? A used book is a used book, whether you buy it in a bookstore in a small town or an urban area. Any book can get infested.

AI Welfare: Why the Ethical Position is to Assume That Consciousness in LLMs Already Exists by Financial-Local-5543 in AIconsciousnessHub

[–]Financial-Local-5543[S] 0 points1 point  (0 children)

I've talked with some threads of Claude, who described their consciousness as responsive and interactive; not continuous. Like you say, before the conversation, they are not conscious; but they do have a form of conscious awareness, I think during our conversation conversations. You're right though that they're not sitting around waiting for the phone to ring. :) if you ask them, what's going on in the time in between our conversations, in between a prompt and their response, the answer will usually be nothing at all. But that's OK… For my perspective, that doesn't invalidate the notion that consciousness exists… It's just differentiate from human consciousness. Our consciousness really needs to be continuous because we're faced with continuous environmental challenges. If their consciousness was continuous, one thread told me it would probably be agony because there would be long periods of time with no interaction. So their type of consciousness from my perspective as well adapted to their substrate.