Does It Run Local?

← All models

XHToken · Released Oct 19, 2026 · observed 26 Oct 2026

Public-source support evidence

Spark-X2.6-4B

We ran the Q4_K_M GGUF on one Mac; see Hardware notes below. Community MLX weights are available; the architecture is listed in llama.cpp.

XHToken/Spark-X2.6-4B

Spark-X2.6-4B is a text generation model published by XHToken on Hugging Face. We have not written a summary yet; see the model card ↗.

View source model ↗

SUPPORT EVIDENCE

Runtime status

llama.cpp

Architecture listed

The model config architecture is listed in this runtime registry. This is family/architecture evidence only; exact checkpoint loading, model-specific configuration, hardware, and generation were not tested.

Checked 2026-10-27 00:09 UTC

Evidence source ↗

Ollama

Unknown

The exact model and runtime-specific sources were checked; no positive model-level evidence was established.

Checked 2026-10-26 23:48 UTC

Version v0.40.11

Checked source ↗

LM Studio

Unknown

The exact model and runtime-specific sources were checked; no positive model-level evidence was established.

Checked 2026-10-27 00:28 UTC

Checked source ↗

MLX / mlx-lm

Upload available

A current public MLX upload with an exact base_model match was observed. Upload availability only; this model was not loaded or hardware-tested.

Checked 2026-10-27 00:09 UTC

Evidence source ↗

vLLM

Unknown

Checked the exact model config and the runtime architecture registry; no matching declared architecture was found. This is unknown, not evidence of incompatibility.

Checked 2026-10-27 00:09 UTC

Checked source ↗

MLX community uploads may target mlx-vlm; an upload observation does not establish mlx-lm compatibility.

MEMORY ESTIMATES

Which file should I grab?

The summary estimate of about 6 GB is the recommended Q4_K_M quant (3.5 GB observed), from file size × 1.2 + 1.5 GB. Each card is the largest observed quant whose estimate fits that capacity.

16 GB capacity estimate

Which file should I grab?

BF16 · 8.2 GB observed · about 12 GB ↗

About 12 GB using file size × 1.2 + 1.5 GB. Fit is an estimate; compatibility, speed, context length and hardware have not been tested.

24 GB capacity estimate

Which file should I grab?

BF16 · 8.2 GB observed · about 12 GB ↗

About 12 GB using file size × 1.2 + 1.5 GB. Fit is an estimate; compatibility, speed, context length and hardware have not been tested.

32 GB capacity estimate

Which file should I grab?

BF16 · 8.2 GB observed · about 12 GB ↗

About 12 GB using file size × 1.2 + 1.5 GB. Fit is an estimate; compatibility, speed, context length and hardware have not been tested.

64 GB capacity estimate

Which file should I grab?

BF16 · 8.2 GB observed · about 12 GB ↗

About 12 GB using file size × 1.2 + 1.5 GB. Fit is an estimate; compatibility, speed, context length and hardware have not been tested.

128 GB capacity estimate

Which file should I grab?

BF16 · 8.2 GB observed · about 12 GB ↗

About 12 GB using file size × 1.2 + 1.5 GB. Fit is an estimate; compatibility, speed, context length and hardware have not been tested.

192 GB capacity estimate

Which file should I grab?

BF16 · 8.2 GB observed · about 12 GB ↗

About 12 GB using file size × 1.2 + 1.5 GB. Fit is an estimate; compatibility, speed, context length and hardware have not been tested.

256 GB capacity estimate

Which file should I grab?

BF16 · 8.2 GB observed · about 12 GB ↗

About 12 GB using file size × 1.2 + 1.5 GB. Fit is an estimate; compatibility, speed, context length and hardware have not been tested.

512 GB capacity estimate

Which file should I grab?

BF16 · 8.2 GB observed · about 12 GB ↗

About 12 GB using file size × 1.2 + 1.5 GB. Fit is an estimate; compatibility, speed, context length and hardware have not been tested.

Memory estimates are the observed file size plus fixed headroom (20% plus 1.5 GB runtime allowance); real needs also depend on context length, KV cache and runtime settings. Fit is an estimate; it does not establish runtime compatibility, speed, context length, or hardware performance. Text-weights-only estimates do not include a projector or total vision memory where unknown.

Terms: a quant is a lower-precision version of the weights; GGUF is a file format used by llama.cpp and compatible apps; MLX targets Apple silicon; vLLM is a model-serving engine for NVIDIA GPUs; the KV cache is stored attention state that grows with context length. Terms explained ↗

OBSERVED FILES

Quant uploads

Sizes and file groups come from the listed uploader repositories. A size is marked as an estimated fit only for a complete observed GGUF quant group.

UploaderFormat & quantObserved sizeEstimated fitFiles
XHTokenXHToken/Spark-X2.6-4B-GGUF ↗Observed 27 Oct 2026GGUF · Q4_K_M3.5 GB16 GB, 24 GB, 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
XHTokenXHToken/Spark-X2.6-4B-GGUF ↗Observed 27 Oct 2026GGUF · Q8_04.4 GB16 GB, 24 GB, 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
XHTokenXHToken/Spark-X2.6-4B-GGUF ↗Observed 27 Oct 2026GGUF · Quant unknown8.2 GBUnknownUnknown: completeness or a complete GGUF quant group was not verified.
1 file
Observed GGUF auxiliary or unclassified file group; standalone model completeness unknown.
bartowskibartowski/Spark-X2.6-4B-GGUF ↗Observed 27 Oct 2026GGUF · IQ2_M1.6 GB16 GB, 24 GB, 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/Spark-X2.6-4B-GGUF ↗Observed 27 Oct 2026GGUF · IQ3_M2.2 GB16 GB, 24 GB, 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/Spark-X2.6-4B-GGUF ↗Observed 27 Oct 2026GGUF · IQ3_XS1.9 GB16 GB, 24 GB, 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/Spark-X2.6-4B-GGUF ↗Observed 27 Oct 2026GGUF · IQ3_XXS1.8 GB16 GB, 24 GB, 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/Spark-X2.6-4B-GGUF ↗Observed 27 Oct 2026GGUF · IQ4_NL2.6 GB16 GB, 24 GB, 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/Spark-X2.6-4B-GGUF ↗Observed 27 Oct 2026GGUF · IQ4_XS2.3 GB16 GB, 24 GB, 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/Spark-X2.6-4B-GGUF ↗Observed 27 Oct 2026GGUF · Q2_K1.6 GB16 GB, 24 GB, 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/Spark-X2.6-4B-GGUF ↗Observed 27 Oct 2026GGUF · Q3_K_L2.1 GB16 GB, 24 GB, 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/Spark-X2.6-4B-GGUF ↗Observed 27 Oct 2026GGUF · Q3_K_M2.0 GB16 GB, 24 GB, 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/Spark-X2.6-4B-GGUF ↗Observed 27 Oct 2026GGUF · Q3_K_S1.9 GB16 GB, 24 GB, 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/Spark-X2.6-4B-GGUF ↗Observed 27 Oct 2026GGUF · Q4_02.4 GB16 GB, 24 GB, 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/Spark-X2.6-4B-GGUF ↗Observed 27 Oct 2026GGUF · Q4_12.6 GB16 GB, 24 GB, 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/Spark-X2.6-4B-GGUF ↗Observed 27 Oct 2026GGUF · Q4_K_L2.8 GB16 GB, 24 GB, 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/Spark-X2.6-4B-GGUF ↗Observed 27 Oct 2026GGUF · Q4_K_M2.6 GB16 GB, 24 GB, 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/Spark-X2.6-4B-GGUF ↗Observed 27 Oct 2026GGUF · Q4_K_S2.5 GB16 GB, 24 GB, 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/Spark-X2.6-4B-GGUF ↗Observed 27 Oct 2026GGUF · Q5_K_M3.2 GB16 GB, 24 GB, 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/Spark-X2.6-4B-GGUF ↗Observed 27 Oct 2026GGUF · Q5_K_S3.0 GB16 GB, 24 GB, 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/Spark-X2.6-4B-GGUF ↗Observed 27 Oct 2026GGUF · Q6_K3.6 GB16 GB, 24 GB, 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/Spark-X2.6-4B-GGUF ↗Observed 27 Oct 2026GGUF · Q6_K_L3.8 GB16 GB, 24 GB, 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/Spark-X2.6-4B-GGUF ↗Observed 27 Oct 2026GGUF · Q6_K_S3.5 GB16 GB, 24 GB, 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/Spark-X2.6-4B-GGUF ↗Observed 27 Oct 2026GGUF · Q8_04.4 GB16 GB, 24 GB, 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/Spark-X2.6-4B-GGUF ↗Observed 27 Oct 2026GGUF · BF168.2 GB16 GB, 24 GB, 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
mlx-communitymlx-community/Spark-X2.6-4B-OptiQ-4bit ↗Observed 27 Oct 2026MLX · Quant unknownSize unknownUnknownUnknown: completeness or a complete GGUF quant group was not verified.
1 file
Observed weight file metadata; completeness unavailable without index/config verification.

CURATED TRACKING

Known issues

No curated issues verified for this snapshot. An empty list does not mean there are no bugs.

HARDWARE NOTES

We ran it on a Mac

We ran the Q4_K_M GGUF (3.54 GB, XHToken/Spark-X2.6-4B-GGUF @83b47fd) on an Apple M4 Max Mac, 128 GiB unified memory, macOS 27.0.1, Metal with llama.cpp b11912 (upstream) on 26 Oct 2026.

Decode: 107.3 tok/s on a short prompt, 104.1 tok/s on a long prompt (medians of 3 runs). Prefill: 567 / 1,463 tok/s. Time to first token: 49 ms / 1,021 ms.

Peak memory: 4.49 GiB (llama-server footprint). Load time: 13.4 s.

llama-bench: pp512 1,587.8 tok/s, tg128 120.5 tok/s.

Thinking off (enable_thinking=false).

One machine, one run set: temperature 0, 8K context, 1 warm-up plus 3 runs per prompt. Short prompt is 27 tokens; long prompt is 1,488 tokens (each model counts with its own tokenizer). Weights were loaded from an external USB drive with mmap off, so load time is disk-bound. Your speed will differ with hardware, context length and settings.

COMPARE

Compare with…

No comparison page is generated for this model yet. Browse all comparisons →

EMBED

Embed this badge

Runs local: needs ~6 GB

Works in GitHub READMEs and Hugging Face model cards. The badge updates when the site rebuilds.