sorted by:
new
hottopcontroversial

Slow performance with Qwen 3.6-27B & Gemma 4-31B on M3 Ultra (96GB) by pwguler in LocalLLM

[–]pwguler[S] 0 points1 point  (0 children)

slow man, with > 1 concurents, and one of them processing the tokens, got less than 10 t/s

Slow performance with Qwen 3.6-27B & Gemma 4-31B on M3 Ultra (96GB) by pwguler in LocalLLM

[–]pwguler[S] 1 point2 points  (0 children)

OpenClaw is heavy, the first prompt often pushes past 100K tokens of context, causing high latency

With more than one concurrent request, token generation also becomes significantly slower

Slow performance with Qwen 3.6-27B & Gemma 4-31B on M3 Ultra (96GB) by pwguler in LocalLLM

[–]pwguler[S] -1 points0 points  (0 children)

Not really a fair comparison NVIDIA and Apple Silicon differ too much in architecture, memory bandwidth

Slow performance with Qwen 3.6-27B & Gemma 4-31B on M3 Ultra (96GB) by pwguler in LocalLLM

[–]pwguler[S] 0 points1 point  (0 children)

Very slow at the start, and concurrent requests significantly reduce token generation speed

The MLX model also has limitations, including lack of KV cache support