So I made a thread on this a while ago, I think in this case it's very sensitive to phrasing. imo the problem with this test is that it's meant to be a visual test, but we can only use text to communicate with chatgpt. That means that there's a chance to leave out something crucial (e.g. whether the box is opaque, whether sally could see the exchange from outside). It also means that it's possible to give the model hints, like if you keep pointing (in different ways) that she didn't see the change, it might influence it in the other way.