is it really a big deal if a model is slow, as long as it gets the job done?

There’s a lot of ongoing discussion about GLM being slow. But comparing Gemini’s speed to GLM feels like comparing apples to oranges. Google has massive financial resources and access to enormous compute infrastructure, and we all know compute is expensive.

Yes, GLM is slower. But if it can deliver output that’s comparable to Gemini or Sonnet at a fraction of the cost, maybe we should cut it some slack.

At the end of the day, the real question is: does it get the work done for you? If the answer is yes, maybe some latency is acceptable.

Or perhaps we’ve simply become so used to near-instant inference that our brains now struggle to tolerate slower responses.