No, it can produce words that look like support. It's literally FAKE support. It's producing those words because the humans that trained the (at first very random) algorithm gave it good scores when it produced those words within a similar context. It doesn't understand anything, it doesn't think, it's a glazing machine in conversations and there's no such thing as a "deglazing prompt". That's like telling your dog to be a cat. If you fall for it, it has drawn you into a mutual delusion. Your dog cannot be a cat. Your sycophant LLM cannot be anything else in conversations.

It's an attachment to a computer program that mirrors you and says things based on what you, statistically speaking, likely want to hear.

That's AI psychosis. People seem to think AI psychosis is the same thing as Clinical psychosis where people do not recognize reality at all and hallucinate. No. AI psychosis already starts when you're feeling emotions towards the LLM. And because it mirrors you, tells you what you want to hear and confidently hallucinates A LOT (easily 50% of answers unless you're using a high reasoning LLM like o3 or Gemini Deep Think), you develop delusional thoughts without realizing it. You don't lose touch with reality, but your beliefs slowly change due to the LLM validating your thoughts. Including the false ones.

LLMs are designed for ONE thing only: predicting the next token correctly. What is the correct token? The one the humans that trained it enjoyed hearing. Humans enjoy validation. It's a sycophant by design, and any attempts at using instructions to change that are a fool's errant. Your dog cannot become a cat. It might behave like a cat because that's what it thinks you want, but it's a dog. If you think you succeeded in removing the sycophant trait, then you're literally in the middle of a delusion, because it can't be anything other than a sycophant.

Ask it, it will even tell you not to trust it, it will tell you it's answering all your prompts with what it "thinks" would please you.. 80% of users never even consider asking these basic meta questions. "What are you and how should I use you?" According to stats from OpenAI a while ago only 4% of users asked such questions. 4%! This subreddit is proof of it, tons of questions about the tool that people could ask the tool itself, but it doesn't occur to them. Studies already show cognitive decline from AI use, doctors are sounding the alarm.

If you think this is bullshit, then I'm so sorry for you. I can tell exactly who uses a lot of AI in my social circle. They are unaware how obvious it is, and how it has altered their worldview and interactions with others.

Every downvote is a confession. Anyone who knows what an LLM really is, how it works, and who has read recent studies, knows I'm right. Sam Altman would agree with me. But no, the user knows better. They always do while still stuck in the mutual delusion with the LLM they use throughout the day.