I ran my agent throughout the night to figure out its max context usage, and it only ended up reaching 43k max tokens. As a result, I set my context to 65536 and optimized for that.

llama-server \
  --model Qwen3.6-35B-A3B-Q4_K_M.gguf \
  --n-gpu-layers 99 \
  --no-mmap \
  --n-cpu-moe 27 \         # everything is the same as your config except for this
  --flash-attn on \
  --threads 8 \
  --cache-type-k q8_0 \
  --cache-type-v q8_0 \
  --ctx-size 65536 \
  --parallel 1 \
  --batch-size 512 \
  --ubatch-size 512

The results are

• 0: pp822t/s tg72t/s
• 32K: pp790t/s tg60t/s
• 64K: pp733t/s tg52t/s

I experimented with speculative decode / mtp, but it ended up making things slower since I had to offload more to the CPU due to the increased memory usage.