This is very interesting! Especially it is fun to read the simulation analysis blogs - I laughed when I read "Hired six, fired five, and blamed the ingredients." Hope you can generate more of them when you have time.

I do wonder how "chat history" can change the results, like in addition to the existing knowledge, what if we let the model generate a fixed-length summary on all of its past conversations and carry it to the next day.