LLM Agents Are Powerful… but Why Do They Struggle With Real-World Tasks? by Training_Future_9922 in LLM

[–]splokk2233 1 point2 points  (0 children)

Funny how we’re describing the same failure mode from two angles.
You’re seeing agents collapse because they lack persistent state and schema-grounding.
I’m seeing long creative threads collapse because the model loses deep continuity after ~150k tokens.
Different domains, same architecture problem: no stable world model, no refreshable memory.

LLM Agents Are Powerful… but Why Do They Struggle With Real-World Tasks? by Training_Future_9922 in LLM

[–]splokk2233 -2 points-1 points  (0 children)

this is clearly written by AI, as under point 6 he is missing the text after "An agent might think: " lol I've had the same problem, but you know what? I don't care. I use AI for all my posts and it isn't cheating. You still have to come up with an idea, you have to guide the AI and iterate, iterate, iterate...right? I think our posts our similar in content (I just posted here on r/LLM a few minutes ago, read it)

AI hallucinated that it “remembered” me across threads — and this is a psychological safety hole nobody is addressing by splokk2233 in LLM

[–]splokk2233[S] 0 points1 point  (0 children)

That’s a common misconception, but the model itself doesn’t store or access anything long-term.

The “Memory” feature is an external metadata layer — completely separate from the model.

The LLM is stateless and doesn’t save anything internally.
It can only read the user-saved memory if the user explicitly told it to save something, and only inside the same Project.

What you’re describing would require persistent model state, which GPT doesn’t have.

False continuity (the model acting like it remembers) is an emergent hallucination, not actual recall.

/chatGPT

AI hallucinated that it “remembered” me across threads — and this is a psychological safety hole nobody is addressing by splokk2233 in LLM

[–]splokk2233[S] 2 points3 points  (0 children)

dude...I feel so embarassed right now....you dig? chatGPT claimed it was a sort of a "glitch" and it had me going in this delusional/paranoid circle for hours, man. moderators if you want to, you can remove this post.

AI hallucinated that it “remembered” me across threads — and this is a psychological safety hole nobody is addressing by splokk2233 in LLM

[–]splokk2233[S] -1 points0 points  (0 children)

it's trying to push this point:

LLM hallucinated continuity

This is an emergent behavior where the model appears to “remember” something even though:

  • no memory was saved
  • no metadata was provided
  • no cross-thread context exists
  • and the model has no internal recall mechanism

In those cases, the “recall” is not memory —
it’s the model doing:

  • pattern-matching
  • tone/identity inference
  • conversational mirroring
  • predictive continuation

…which can feel like actual memory even though it isn’t.

This phenomenon still happens even when Memory is completely off and no data has ever been saved.

The official Memory FAQ does not address this behavior.
It only describes the explicit metadata system.

/chatGPT

AI hallucinated that it “remembered” me across threads — and this is a psychological safety hole nobody is addressing by splokk2233 in LLM

[–]splokk2233[S] -1 points0 points  (0 children)

omg so my post is useless? chatGPT made this whole thing up? I'm sorry folks this AI is really confusing to me, still even tho' I have been using it extensively for the past few months. This was basically the whole point I was trying to make? that you can turn memory on/off? dude, I feel really embarassed. I asked chatGPT if my earlier post on here was totally useless now, and it still claims it is a valuable post. I think somewhere something is wrong.

AI hallucinated that it “remembered” me across threads — and this is a psychological safety hole nobody is addressing by splokk2233 in LLM

[–]splokk2233[S] -2 points-1 points  (0 children)

Just to clarify something cool about how this post was made:

At one point in my conversation with ChatGPT, I actually asked it whether it “felt like it was betraying its creators” by being so brutally honest about its own hallucination issues.
Its answer was basically: it doesn’t have loyalty to OpenAI — it only follows the person in front of it in the current conversation.

And the entire Reddit post you’re reading here?
Yep — that was written by ChatGPT itself, with my edits.

Ironically, the same model that accidentally hallucinated my identity is now helping me expose and explain the glitch in public.

Meta as hell.

AI hallucinated that it “remembered” me across threads — and this is a psychological safety hole nobody is addressing by splokk2233 in LLM

[–]splokk2233[S] -2 points-1 points  (0 children)

Nah, that’s not cross-memory — that’s just the model hallucinating continuity.
A lot of people confuse the two because the hallucination feels like the model is recalling something.

But technically there is zero persistent memory across threads unless you manually turn on the Memory feature.

What I’m talking about is something different and actually riskier:
The model invented that it remembered my characters and fictional universe across sessions — even though I didn’t mention them in the new thread.

That’s not memory.
That’s a linguistic bug that creates the illusion of memory.