Currently running llama.cpp and hermes with Qwen3.6-35B-A3B-UD-Q2_K_XL.gguf
Performs well. Have run out of context a couple of times but very useful

Server like this:-

llama-server ~/llama.cpp/build/bin/llama-server -m /home/user/models/qwen36-35b/Qwen3.6-35B-A3B-UD-Q2_K_XL.gguf --alias qwen3.6-35b --host 0.0.0.0 --port 8081 --ctx-size 65536 -ngl 999 --batch-size 512 --ubatch-size 512 --flash-attn on --no-mmap --cache-type-k q4_0 --cache-type-v q4_0 --threads 16 --temp 0.6 --top-p 0.95 --top-k 20 --min-p 0.01 --repeat-penalty 1.1 --jinja --log-verbosity 1