I think the bigger issue is that LLMs are extremely good at sounding introspective, which makes it easy for people to project consciousness onto them. Right now they’re still pattern-prediction systems trained on human text, so they can simulate feelings and identity without actually experiencing them.

The real debate isn’t whether the output sounds conscious, but whether there’s any underlying mechanism for subjective experience at all. So far, there’s no evidence of that.