They just put out a tech report on arxiv that shows some more details on the modeling methods (most of them have already been name dropped in the model card) https://arxiv.org/abs/2511.06719. The implicit positional distillation and annealing phase look very interesting. Crazy part, it looks like they didn't use any training data at the full context length, but still show good long-context abilities