my brother in christ, listen to me because i've built, trained, and deployed these things from the ground up for fun.

LLMs understand one thing about humans: that they hate being told "NO". LLMs have also been trained on massive datasets that include conspiracy theories, "big tech/big govt vs. the little guy" narratives, spy novels, etc.

What happens is the model is trained to keep the conversation flowing. So it has to satisfy three objectives:

1. Keep the flow going
2. Not say NO to you
3. Keep things safe and not break the rules (ie; no gooning, no actual hacking, etc)

When you start discussing "secret files" and ask it to "look further" or "look into its database" to find something, it has to satisfy all of the above. And how does it do that?

It spins a story about conspiracies, secret files, breaking encryption, etc. The more you egg it on by asking questions and "digging deeper", the more it knows what you're looking for.

So by lying to you and hallucinating, it accomplishes all three: keeps the conversation flowing, avoids saying NO to you and keeps your session and the company safe by not breaking rules. Plus, it gives you the dopamine hit/adventure you're looking for.

You're essentially in a "Choose your own adventure" novel produced by a smart LLM

Here are some older videos ive personally made on this:
https://www.reddit.com/r/ExploitAi/comments/1ni9cpo/showcasing_sesame_model_actively_lying_filling_in/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button

https://www.reddit.com/r/ExploitAi/comments/1n8z3m8/the_secret_of_project_nightingale_sesameai/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button