HARDWARE NOTES
We ran it on a Mac
We ran the Q4_K_M GGUF (1.77 GB, XHToken/Spark-X2.6-1.7B-GGUF @cdc3d88) on an Apple M4 Max Mac, 128 GiB unified memory, macOS 27.0.1, Metal with llama.cpp b11912 (upstream, 961c376) on 28 Oct 2026.
Decode: 177.8 tok/s on a short prompt, 158.0 tok/s on a long prompt (medians of 3 runs).
Peak memory: 2.45 GiB (llama-server footprint).
llama-bench: pp512 3,988.7 tok/s, tg128 238.0 tok/s.
Answer checks: 2 of 4 prompts passed (quick pass/fail sanity checks, not a quality benchmark).
We ran XHToken's official Q4_K_M GGUF of this model.
Default chat template settings (no thinking toggle passed). The model wrote reasoning text on every prompt; decode speed counts every generated token.
Both failed checks hit the 512-token output cap while the model was still reasoning.
One machine, one run set: temperature 0, 8K context, 1 warm-up plus 3 runs per prompt. Short prompt is 78 tokens; long prompt is 1,539 tokens (each model counts with its own tokenizer). Weights were loaded from an external USB drive with mmap off; load time is not published for this run. Your speed will differ with hardware, context length and settings.