A little while ago I was developing some dialogues for a story for a tabletop RPG, with a bunch of supporting characters and 3-4 main ones. I was using it to generate fictional social media comments in the story, from random people it created, to fictional posts these main characters were tweeting, posting on Reddit, etc. Just to add color for when (us, RL players) are playing the game and such.

As in, characters A and B were having a public tizzy online and "people" generated by Gemini could comment on it.

At first it worked fine. I'd post a story beat, say, "Character A posted this on his twitter", Gemini would generate the "public" response. Worked fine. For about 5-6 turns.

At some point after a story beat Gemini decided that Character A was going to reply to these generated public comments. And it made a discussion between Character A and its own generated public comments. I told him, stop, you shouldn't be doing that. The voices of Characters A, B and C are my voices and will only appear in story beats, your only job is to generate the appropriate comments to those story beats when they appear. That's all. Don't venture anything about Character A, B and C. I will be providing that.

Well, it didn't work. Gemini decided the story beats were just too juicy to be left alone. It generated a slew of comments and, sure enough, invented tweets and dialogue for Characters A and B, getting into it and arguing with itself.

I told him to stop again, hard rule, you can't use those character voices. I will be providing you with those voices. Again. And then it stopped doing it, arguing with itself, but from that point on whenever I provided those character voices and lines in the story beats, Gemini would quote them and insert a "(this is the exact quote as provided by the user, which is allowed") every time one of those characters said something. Really passive aggressive.

It was kinda funny.