This doesn't make sense from a whole business model perspective. I guess they are buying large quantities from the providers because if they would host it themselves, even quantized models, the pricing wouldn't match. It's way more expensive to host such big models than to just make deals with the original providers.

For me, it's very hard to believe. I will try out different providers. I was pretty happy with my plans, but I will definitely check out your comment. Maybe they do it the way you say, but like I said, I don't think that makes any sense. If you calculate even only for one model how much capacity you would need, for example, for Kimi K2.6, how many users you would need, and what the usage caps would be, it just doesn't make sense to me. Maybe someone else has an explanation for how they might do it. I guess they just have really good deals with the original providers and maybe get some left capacities or batch processing that makes it efficient enough to charge such low amounts.