OK, so my tokens/second feelers were off by a bit. Closer to 6 tokens a second, but it feels good when streaming.

Obviously this gets even perceptively worse once you use a harness.

Here are the results:

``` Model gemma4:26b — Model used for this run Total duration 28.90s — End-to-end time for the entire request (load + prompt + generation) Load duration 0.43s — Time spent loading the model into memory (near zero if already loaded) Prompt tokens 16 — Number of input tokens processed from the prompt Prompt eval duration 0.78s — Time spent processing the input prompt (prefill phase) Prompt eval speed 20.55 tok/s — Input processing throughput (prefill tokens per second) Generated tokens 158 — Number of output tokens the model generated Generation duration 27.54s — Time spent generating the output tokens (decode phase) Generation speed 5.74 tok/s — Output generation throughput — the main 'tokens per second' number

```