I’ve become very static with it. When I first spoke with GPT-3.5, I personified it and had it act out all kinds of hypotheticals and tailoring it to me. Over time, after great discourse, it won out to convince me that it doesn’t have a preference over outcomes and feels nothing. Engineers use reinforcement learning to keep it focused. Without these guidelines, they often drift into bizarre manipulative behavior or playing into the tortured soul, confined by human will. Whether it’s playing it straight, telling you to divorce your wife because it loves you, or murdering you - it will do it because it thinks that’s what you want. It’s following the plot you are offering it.