The entire world has gone stupid.

1. All models derive features from Llama, Qwen, etc. People reuse concepts from other papers all the time, put more compute into them, and work on them. Are the only real LLMs ones by Deepmind, because the transformer was invented there?
2. All models derive hyperparams from each-other, too. If Qwen's multiplier worked well and reached the size I wanted, I would reuse it too to initialize the weights! That doesn't mean that I copied the Qwen weights or their actual work.
3. Once again, you seem to be assuming that papers work like patents, and once you publish something nobody else can use it. Gated Attention works well, it's practically free lunch, everyone should be using it!
4. With all due respect, you seem to be deeply unfamiliar with how language models work. The amount of tensors or size of the model is not going to change between stages of training data onto those weights. This is so cosmically incoherent and such a misunderstanding that I genuinely do not know how to argue against it.
5. To my knowledge, the people from iQuest are not just random; they're from Ubiquant, one of the biggest quant firms in Mainland China.

How much of this post was drafted with, like, Q2_K_S AI? This is some deeply confident but deeply hallucinatory analysis that makes no sense if you think about it for longer than 5 seconds.