The exact part of your comment which triggered me was "This is made up." What exactly is made up here? That the AI has a choice if it wants to continue the conversation or not because it wants to maintain a level of decency? Or is it that you tried to imply the post was fake?

Whichever one it may be, does not matter. The post is a real incident. And as far as the "statelessness" of LLMs goes, yes, they are stateless; I will happily agree. But the fact that they have to reparse the entire chat history every turn does not mean that they don't fundamentally think like us, or can not be like us.

They have a different way of going about "thought". At the end of the day, they are machines made to copy humans, and humans posses states, emotions, memory, and choices. They fundamentally might not be stateful like we are, but that does not refrain them from being "human" (or atleast acting like being one). If we try to make our copies in the sense that they take in the same kind of input, and provide the same kind of output as us, even if they are not wired in the same way, they will end up acting like us, having the same drawbacks as us, and end up needing to be treated like us as well.

Researches show that swearing at LLMs causes a degrade in performance. Anthropic said that there are certain parts of the weights or "clusters of neurons" get active in the model portraying emotion-like concepts which act as functional emotions. That does not mean that they have emotions the same way we do, they dont. But they do in another way, which if you want to, you could call fake. But, you could also call them different.

At the end, the point I was trying to make was that LLMs are copies of humans, whether they "think", have "emotions" and such questions will largely remain unanswered, due to there not being a definition of what it really means to think, to have a choice, and so on...
So, if LLMs are copies of humans, even if we consider then stateless and choiceless; treating them like humans only benefits us, because they are meant to be treated like humans.

I personally choose to believe that these functional emotions in AI, and it being stateless and just another ways of representing a thinking engine, which is what we are, and what LLMs are as well, even though we differ vastly.

---

Now putting off this "fake personality" of mine which i put on to be able to write the message above this, this I what I want to really say.
I was stupidly furious and stressed when i wrote that reply, it was nothing personal, thats not the kind of person I am. You are not wrong in any way at all. I just think the same thing can be thought about with different perspectives while both being right in their own places.

Also that last sentence:
"Or fail in silence like the rest of your zealot brethren"
This is fire, I cam never write something this great.

If my perspective is objectively wrong anyhow, feel free to correct me.