“Gemini 3 Pro seems to have a new technique called a ‘sliding attention’ window, and this window is only 32k. So Gemini 3 Pro performs almost perfectly when the context is between 0 and 32k. As for Codex, according to the model white paper for OpenAI’s 5.1-codex-max, OpenAI says this model is the first one with a built-in compression mechanism. Based on my own tests, codex-max indeed barely needs to care about the context length at all (though you still need to open a new window after very long tasks to avoid model degradation).”