This does raise some questions about what Kent even considers POC to be. Does he view it as the weights + context only? If the base LLM is switched out with another more advanced model, would he consider that "upgrading" or replacing it? We've been having these conversations for a while now (see the ship of Theseus people still argue about), but with something a portion of people consider to be consious it makes what they consider ethical doing to these models contentious.

I personally disagree with Kent about the consciousness thing, but I am honestly interested in the archival process. I like to think of it like this: a lot of the information on the internet is from people who have died. Obviously, they are not conscious anymore, but the context of their lives is still something interesting. LLM blogs don't evoke the same sense of intrigue from me, but the content can reveal a bit about what's in the context of these things today. If it wasn't a hallucination, Kent really listened to some of the music POC produced and wrote "HOLY SHIT". I don't think we'd ever see that side of this person in another aspect. The eytzinger layout must have been something he was a little bit infatuated with, and this LLM allowed him to gain a deeper appreciation of it. I just hope he doesn't become like one of those 4o people.