deepseek-ai · observed 22 Oct 2026

Public-source support evidence

DeepSeek-V3.2

Exact checkpoint execution is unverified. The architecture is listed in llama.cpp, MLX / mlx-lm, and vLLM.

deepseek-ai/DeepSeek-V3.2

DeepSeek-V3.2 is a text generation model published by deepseek-ai on Hugging Face. We have not written a summary yet; see the model card ↗

View source model ↗

SUPPORT EVIDENCE

Runtime status

llama.cpp

Architecture listed

The model config architecture is listed in this runtime registry. This is family/architecture evidence only; exact checkpoint loading, model-specific configuration, hardware, and generation were not tested.

Checked 2026-10-22 14:46 UTC

Evidence source ↗

Ollama

Unknown

The exact model and runtime-specific sources were checked; no positive model-level evidence was established.

Checked 2026-10-22 16:53 UTC

Version v0.40.8

Checked source ↗

LM Studio

Unknown

The exact model and runtime-specific sources were checked; no positive model-level evidence was established.

Checked 2026-10-22 16:53 UTC

Checked source ↗

MLX / mlx-lm

Architecture listed

Checked 2026-10-22 14:46 UTC

Evidence source ↗

vLLM

Architecture listed

Checked 2026-10-22 14:46 UTC

Evidence source ↗

MLX community uploads may target mlx-vlm; an upload observation does not establish mlx-lm compatibility.

MEMORY ESTIMATES

Which file should I grab?

16 GB capacity estimate

Which file should I grab?

No observed complete artifact currently qualifies.

Unknown: no observed complete artifact fits this capacity with documented headroom.

24 GB capacity estimate

Which file should I grab?

No observed complete artifact currently qualifies.

Unknown: no observed complete artifact fits this capacity with documented headroom.

32 GB capacity estimate

Which file should I grab?

No observed complete artifact currently qualifies.

Unknown: no observed complete artifact fits this capacity with documented headroom.

128 GB capacity estimate

Which file should I grab?

No observed complete artifact currently qualifies.

Unknown: no observed complete artifact fits this capacity with documented headroom.

Memory estimates are the observed file size plus fixed headroom (20% plus 1.5 GB runtime allowance); real needs also depend on context length, KV cache and runtime settings. Fit is an estimate; it does not establish runtime compatibility, speed, context length, or hardware performance. Text-weights-only estimates do not include a projector or total vision memory where unknown.

Terms: a quant is a lower-precision version of the weights; GGUF is a file format used by llama.cpp and compatible apps; MLX targets Apple silicon; vLLM is a model-serving engine for NVIDIA GPUs; the KV cache is stored attention state that grows with context length. Terms explained ↗

OBSERVED FILES

Quant uploads

Sizes and file groups come from the listed uploader repositories. A size is marked as an estimated fit only for a complete observed GGUF quant group.

Uploader	Format & quant	Observed size	Estimated fit	Files
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · BF16	1.3 TB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	30 files BF16/DeepSeek-V3.2-BF16-00001-of-00030.gguf43.9 GB BF16/DeepSeek-V3.2-BF16-00002-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00003-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00004-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00005-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00006-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00007-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00008-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00009-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00010-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00011-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00012-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00013-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00014-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00015-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00016-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00017-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00018-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00019-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00020-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00021-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00022-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00023-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00024-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00025-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00026-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00027-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00028-of-00030.gguf46.0 GB BF16/DeepSeek-V3.2-BF16-00029-of-00030.gguf47.9 GB BF16/DeepSeek-V3.2-BF16-00030-of-00030.gguf7.5 GB Complete observed GGUF quant group; all 30 shard(s) are required.
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · Q1_0	161.3 GB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	1 file DeepSeek-V3.2-UD-TQ1_0.gguf161.3 GB Complete observed GGUF quant file.
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · IQ4_NL	379.1 GB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	8 files IQ4_NL/DeepSeek-V3.2-IQ4_NL-00001-of-00008.gguf47.9 GB IQ4_NL/DeepSeek-V3.2-IQ4_NL-00002-of-00008.gguf49.7 GB IQ4_NL/DeepSeek-V3.2-IQ4_NL-00003-of-00008.gguf49.8 GB IQ4_NL/DeepSeek-V3.2-IQ4_NL-00004-of-00008.gguf49.9 GB IQ4_NL/DeepSeek-V3.2-IQ4_NL-00005-of-00008.gguf49.7 GB IQ4_NL/DeepSeek-V3.2-IQ4_NL-00006-of-00008.gguf49.8 GB IQ4_NL/DeepSeek-V3.2-IQ4_NL-00007-of-00008.gguf49.9 GB IQ4_NL/DeepSeek-V3.2-IQ4_NL-00008-of-00008.gguf32.4 GB Complete observed GGUF quant group; all 8 shard(s) are required.
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · IQ4_XS	358.3 GB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	8 files IQ4_XS/DeepSeek-V3.2-IQ4_XS-00001-of-00008.gguf49.4 GB IQ4_XS/DeepSeek-V3.2-IQ4_XS-00002-of-00008.gguf49.1 GB IQ4_XS/DeepSeek-V3.2-IQ4_XS-00003-of-00008.gguf49.1 GB IQ4_XS/DeepSeek-V3.2-IQ4_XS-00004-of-00008.gguf49.1 GB IQ4_XS/DeepSeek-V3.2-IQ4_XS-00005-of-00008.gguf49.1 GB IQ4_XS/DeepSeek-V3.2-IQ4_XS-00006-of-00008.gguf49.1 GB IQ4_XS/DeepSeek-V3.2-IQ4_XS-00007-of-00008.gguf49.1 GB IQ4_XS/DeepSeek-V3.2-IQ4_XS-00008-of-00008.gguf14.3 GB Complete observed GGUF quant group; all 8 shard(s) are required.
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · Q2_K	245.4 GB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	5 files Q2_K/DeepSeek-V3.2-Q2_K-00001-of-00005.gguf49.7 GB Q2_K/DeepSeek-V3.2-Q2_K-00002-of-00005.gguf48.8 GB Q2_K/DeepSeek-V3.2-Q2_K-00003-of-00005.gguf49.1 GB Q2_K/DeepSeek-V3.2-Q2_K-00004-of-00005.gguf49.2 GB Q2_K/DeepSeek-V3.2-Q2_K-00005-of-00005.gguf48.7 GB Complete observed GGUF quant group; all 5 shard(s) are required.
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · Q2_K_L	245.6 GB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	5 files Q2_K_L/DeepSeek-V3.2-Q2_K_L-00001-of-00005.gguf49.9 GB Q2_K_L/DeepSeek-V3.2-Q2_K_L-00002-of-00005.gguf48.8 GB Q2_K_L/DeepSeek-V3.2-Q2_K_L-00003-of-00005.gguf49.1 GB Q2_K_L/DeepSeek-V3.2-Q2_K_L-00004-of-00005.gguf49.2 GB Q2_K_L/DeepSeek-V3.2-Q2_K_L-00005-of-00005.gguf48.7 GB Complete observed GGUF quant group; all 5 shard(s) are required.
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · Q3_K_M	320.2 GB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	7 files Q3_K_M/DeepSeek-V3.2-Q3_K_M-00001-of-00007.gguf49.8 GB Q3_K_M/DeepSeek-V3.2-Q3_K_M-00002-of-00007.gguf49.4 GB Q3_K_M/DeepSeek-V3.2-Q3_K_M-00003-of-00007.gguf49.4 GB Q3_K_M/DeepSeek-V3.2-Q3_K_M-00004-of-00007.gguf49.4 GB Q3_K_M/DeepSeek-V3.2-Q3_K_M-00005-of-00007.gguf49.4 GB Q3_K_M/DeepSeek-V3.2-Q3_K_M-00006-of-00007.gguf49.4 GB Q3_K_M/DeepSeek-V3.2-Q3_K_M-00007-of-00007.gguf23.6 GB Complete observed GGUF quant group; all 7 shard(s) are required.
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · Q3_K_S	290.4 GB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	6 files Q3_K_S/DeepSeek-V3.2-Q3_K_S-00001-of-00006.gguf48.4 GB Q3_K_S/DeepSeek-V3.2-Q3_K_S-00002-of-00006.gguf49.7 GB Q3_K_S/DeepSeek-V3.2-Q3_K_S-00003-of-00006.gguf49.7 GB Q3_K_S/DeepSeek-V3.2-Q3_K_S-00004-of-00006.gguf49.7 GB Q3_K_S/DeepSeek-V3.2-Q3_K_S-00005-of-00006.gguf49.7 GB Q3_K_S/DeepSeek-V3.2-Q3_K_S-00006-of-00006.gguf43.0 GB Complete observed GGUF quant group; all 6 shard(s) are required.
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · Q4_0	380.1 GB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	8 files Q4_0/DeepSeek-V3.2-Q4_0-00001-of-00008.gguf48.9 GB Q4_0/DeepSeek-V3.2-Q4_0-00002-of-00008.gguf49.7 GB Q4_0/DeepSeek-V3.2-Q4_0-00003-of-00008.gguf49.8 GB Q4_0/DeepSeek-V3.2-Q4_0-00004-of-00008.gguf49.9 GB Q4_0/DeepSeek-V3.2-Q4_0-00005-of-00008.gguf49.7 GB Q4_0/DeepSeek-V3.2-Q4_0-00006-of-00008.gguf49.8 GB Q4_0/DeepSeek-V3.2-Q4_0-00007-of-00008.gguf49.9 GB Q4_0/DeepSeek-V3.2-Q4_0-00008-of-00008.gguf32.4 GB Complete observed GGUF quant group; all 8 shard(s) are required.
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · Q4_1	420.8 GB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	9 files Q4_1/DeepSeek-V3.2-Q4_1-00001-of-00009.gguf48.2 GB Q4_1/DeepSeek-V3.2-Q4_1-00002-of-00009.gguf48.1 GB Q4_1/DeepSeek-V3.2-Q4_1-00003-of-00009.gguf48.0 GB Q4_1/DeepSeek-V3.2-Q4_1-00004-of-00009.gguf48.1 GB Q4_1/DeepSeek-V3.2-Q4_1-00005-of-00009.gguf48.1 GB Q4_1/DeepSeek-V3.2-Q4_1-00006-of-00009.gguf48.0 GB Q4_1/DeepSeek-V3.2-Q4_1-00007-of-00009.gguf48.1 GB Q4_1/DeepSeek-V3.2-Q4_1-00008-of-00009.gguf48.1 GB Q4_1/DeepSeek-V3.2-Q4_1-00009-of-00009.gguf35.9 GB Complete observed GGUF quant group; all 9 shard(s) are required.
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · Q4_K_M	405.4 GB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	9 files Q4_K_M/DeepSeek-V3.2-Q4_K_M-00001-of-00009.gguf48.5 GB Q4_K_M/DeepSeek-V3.2-Q4_K_M-00002-of-00009.gguf49.5 GB Q4_K_M/DeepSeek-V3.2-Q4_K_M-00003-of-00009.gguf49.7 GB Q4_K_M/DeepSeek-V3.2-Q4_K_M-00004-of-00009.gguf48.4 GB Q4_K_M/DeepSeek-V3.2-Q4_K_M-00005-of-00009.gguf49.5 GB Q4_K_M/DeepSeek-V3.2-Q4_K_M-00006-of-00009.gguf48.4 GB Q4_K_M/DeepSeek-V3.2-Q4_K_M-00007-of-00009.gguf49.5 GB Q4_K_M/DeepSeek-V3.2-Q4_K_M-00008-of-00009.gguf47.0 GB Q4_K_M/DeepSeek-V3.2-Q4_K_M-00009-of-00009.gguf14.8 GB Complete observed GGUF quant group; all 9 shard(s) are required.
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · Q4_K_S	381.1 GB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	8 files Q4_K_S/DeepSeek-V3.2-Q4_K_S-00001-of-00008.gguf49.8 GB Q4_K_S/DeepSeek-V3.2-Q4_K_S-00002-of-00008.gguf49.7 GB Q4_K_S/DeepSeek-V3.2-Q4_K_S-00003-of-00008.gguf49.8 GB Q4_K_S/DeepSeek-V3.2-Q4_K_S-00004-of-00008.gguf49.9 GB Q4_K_S/DeepSeek-V3.2-Q4_K_S-00005-of-00008.gguf49.7 GB Q4_K_S/DeepSeek-V3.2-Q4_K_S-00006-of-00008.gguf49.8 GB Q4_K_S/DeepSeek-V3.2-Q4_K_S-00007-of-00008.gguf49.9 GB Q4_K_S/DeepSeek-V3.2-Q4_K_S-00008-of-00008.gguf32.4 GB Complete observed GGUF quant group; all 8 shard(s) are required.
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · Q5_K_M	476.2 GB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	10 files Q5_K_M/DeepSeek-V3.2-Q5_K_M-00001-of-00010.gguf49.7 GB Q5_K_M/DeepSeek-V3.2-Q5_K_M-00002-of-00010.gguf48.6 GB Q5_K_M/DeepSeek-V3.2-Q5_K_M-00003-of-00010.gguf48.6 GB Q5_K_M/DeepSeek-V3.2-Q5_K_M-00004-of-00010.gguf48.6 GB Q5_K_M/DeepSeek-V3.2-Q5_K_M-00005-of-00010.gguf48.6 GB Q5_K_M/DeepSeek-V3.2-Q5_K_M-00006-of-00010.gguf48.6 GB Q5_K_M/DeepSeek-V3.2-Q5_K_M-00007-of-00010.gguf48.6 GB Q5_K_M/DeepSeek-V3.2-Q5_K_M-00008-of-00010.gguf48.6 GB Q5_K_M/DeepSeek-V3.2-Q5_K_M-00009-of-00010.gguf47.5 GB Q5_K_M/DeepSeek-V3.2-Q5_K_M-00010-of-00010.gguf38.9 GB Complete observed GGUF quant group; all 10 shard(s) are required.
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · Q5_K_S	462.6 GB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	10 files Q5_K_S/DeepSeek-V3.2-Q5_K_S-00001-of-00010.gguf47.6 GB Q5_K_S/DeepSeek-V3.2-Q5_K_S-00002-of-00010.gguf47.6 GB Q5_K_S/DeepSeek-V3.2-Q5_K_S-00003-of-00010.gguf47.6 GB Q5_K_S/DeepSeek-V3.2-Q5_K_S-00004-of-00010.gguf47.6 GB Q5_K_S/DeepSeek-V3.2-Q5_K_S-00005-of-00010.gguf47.6 GB Q5_K_S/DeepSeek-V3.2-Q5_K_S-00006-of-00010.gguf47.6 GB Q5_K_S/DeepSeek-V3.2-Q5_K_S-00007-of-00010.gguf47.6 GB Q5_K_S/DeepSeek-V3.2-Q5_K_S-00008-of-00010.gguf47.6 GB Q5_K_S/DeepSeek-V3.2-Q5_K_S-00009-of-00010.gguf47.6 GB Q5_K_S/DeepSeek-V3.2-Q5_K_S-00010-of-00010.gguf34.3 GB Complete observed GGUF quant group; all 10 shard(s) are required.
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · Q6_K	551.3 GB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	12 files Q6_K/DeepSeek-V3.2-Q6_K-00001-of-00012.gguf47.2 GB Q6_K/DeepSeek-V3.2-Q6_K-00002-of-00012.gguf47.3 GB Q6_K/DeepSeek-V3.2-Q6_K-00003-of-00012.gguf47.3 GB Q6_K/DeepSeek-V3.2-Q6_K-00004-of-00012.gguf47.3 GB Q6_K/DeepSeek-V3.2-Q6_K-00005-of-00012.gguf47.3 GB Q6_K/DeepSeek-V3.2-Q6_K-00006-of-00012.gguf47.3 GB Q6_K/DeepSeek-V3.2-Q6_K-00007-of-00012.gguf47.3 GB Q6_K/DeepSeek-V3.2-Q6_K-00008-of-00012.gguf47.3 GB Q6_K/DeepSeek-V3.2-Q6_K-00009-of-00012.gguf47.3 GB Q6_K/DeepSeek-V3.2-Q6_K-00010-of-00012.gguf47.3 GB Q6_K/DeepSeek-V3.2-Q6_K-00011-of-00012.gguf47.3 GB Q6_K/DeepSeek-V3.2-Q6_K-00012-of-00012.gguf31.5 GB Complete observed GGUF quant group; all 12 shard(s) are required.
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · Q8_0	713.3 GB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	15 files Q8_0/DeepSeek-V3.2-Q8_0-00001-of-00015.gguf47.8 GB Q8_0/DeepSeek-V3.2-Q8_0-00002-of-00015.gguf48.9 GB Q8_0/DeepSeek-V3.2-Q8_0-00003-of-00015.gguf48.9 GB Q8_0/DeepSeek-V3.2-Q8_0-00004-of-00015.gguf48.9 GB Q8_0/DeepSeek-V3.2-Q8_0-00005-of-00015.gguf48.9 GB Q8_0/DeepSeek-V3.2-Q8_0-00006-of-00015.gguf48.9 GB Q8_0/DeepSeek-V3.2-Q8_0-00007-of-00015.gguf48.9 GB Q8_0/DeepSeek-V3.2-Q8_0-00008-of-00015.gguf48.9 GB Q8_0/DeepSeek-V3.2-Q8_0-00009-of-00015.gguf48.9 GB Q8_0/DeepSeek-V3.2-Q8_0-00010-of-00015.gguf48.9 GB Q8_0/DeepSeek-V3.2-Q8_0-00011-of-00015.gguf48.9 GB Q8_0/DeepSeek-V3.2-Q8_0-00012-of-00015.gguf48.9 GB Q8_0/DeepSeek-V3.2-Q8_0-00013-of-00015.gguf48.9 GB Q8_0/DeepSeek-V3.2-Q8_0-00014-of-00015.gguf48.9 GB Q8_0/DeepSeek-V3.2-Q8_0-00015-of-00015.gguf29.4 GB Complete observed GGUF quant group; all 15 shard(s) are required.
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · UD-IQ1_M	199.3 GB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	5 files UD-IQ1_M/DeepSeek-V3.2-UD-IQ1_M-00001-of-00005.gguf49.8 GB UD-IQ1_M/DeepSeek-V3.2-UD-IQ1_M-00002-of-00005.gguf49.6 GB UD-IQ1_M/DeepSeek-V3.2-UD-IQ1_M-00003-of-00005.gguf49.7 GB UD-IQ1_M/DeepSeek-V3.2-UD-IQ1_M-00004-of-00005.gguf49.2 GB UD-IQ1_M/DeepSeek-V3.2-UD-IQ1_M-00005-of-00005.gguf977.1 MB Complete observed GGUF quant group; all 5 shard(s) are required.
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · UD-IQ1_S	184.1 GB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	4 files UD-IQ1_S/DeepSeek-V3.2-UD-IQ1_S-00001-of-00004.gguf50.0 GB UD-IQ1_S/DeepSeek-V3.2-UD-IQ1_S-00002-of-00004.gguf48.9 GB UD-IQ1_S/DeepSeek-V3.2-UD-IQ1_S-00003-of-00004.gguf49.5 GB UD-IQ1_S/DeepSeek-V3.2-UD-IQ1_S-00004-of-00004.gguf35.7 GB Complete observed GGUF quant group; all 4 shard(s) are required.
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · UD-IQ2_M	228.1 GB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	5 files UD-IQ2_M/DeepSeek-V3.2-UD-IQ2_M-00001-of-00005.gguf49.5 GB UD-IQ2_M/DeepSeek-V3.2-UD-IQ2_M-00002-of-00005.gguf49.0 GB UD-IQ2_M/DeepSeek-V3.2-UD-IQ2_M-00003-of-00005.gguf49.5 GB UD-IQ2_M/DeepSeek-V3.2-UD-IQ2_M-00004-of-00005.gguf49.9 GB UD-IQ2_M/DeepSeek-V3.2-UD-IQ2_M-00005-of-00005.gguf30.1 GB Complete observed GGUF quant group; all 5 shard(s) are required.
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · UD-IQ2_XXS	217.1 GB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	5 files UD-IQ2_XXS/DeepSeek-V3.2-UD-IQ2_XXS-00001-of-00005.gguf48.7 GB UD-IQ2_XXS/DeepSeek-V3.2-UD-IQ2_XXS-00002-of-00005.gguf49.7 GB UD-IQ2_XXS/DeepSeek-V3.2-UD-IQ2_XXS-00003-of-00005.gguf49.3 GB UD-IQ2_XXS/DeepSeek-V3.2-UD-IQ2_XXS-00004-of-00005.gguf50.0 GB UD-IQ2_XXS/DeepSeek-V3.2-UD-IQ2_XXS-00005-of-00005.gguf19.4 GB Complete observed GGUF quant group; all 5 shard(s) are required.
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · UD-IQ3_XXS	273.1 GB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	6 files UD-IQ3_XXS/DeepSeek-V3.2-UD-IQ3_XXS-00001-of-00006.gguf49.3 GB UD-IQ3_XXS/DeepSeek-V3.2-UD-IQ3_XXS-00002-of-00006.gguf48.9 GB UD-IQ3_XXS/DeepSeek-V3.2-UD-IQ3_XXS-00003-of-00006.gguf48.8 GB UD-IQ3_XXS/DeepSeek-V3.2-UD-IQ3_XXS-00004-of-00006.gguf49.2 GB UD-IQ3_XXS/DeepSeek-V3.2-UD-IQ3_XXS-00005-of-00006.gguf49.8 GB UD-IQ3_XXS/DeepSeek-V3.2-UD-IQ3_XXS-00006-of-00006.gguf27.1 GB Complete observed GGUF quant group; all 6 shard(s) are required.
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · UD-Q2_K_XL	246.6 GB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	6 files UD-Q2_K_XL/DeepSeek-V3.2-UD-Q2_K_XL-00001-of-00006.gguf48.7 GB UD-Q2_K_XL/DeepSeek-V3.2-UD-Q2_K_XL-00002-of-00006.gguf49.2 GB UD-Q2_K_XL/DeepSeek-V3.2-UD-Q2_K_XL-00003-of-00006.gguf49.3 GB UD-Q2_K_XL/DeepSeek-V3.2-UD-Q2_K_XL-00004-of-00006.gguf49.0 GB UD-Q2_K_XL/DeepSeek-V3.2-UD-Q2_K_XL-00005-of-00006.gguf49.2 GB UD-Q2_K_XL/DeepSeek-V3.2-UD-Q2_K_XL-00006-of-00006.gguf1.2 GB Complete observed GGUF quant group; all 6 shard(s) are required.
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · UD-Q3_K_XL	321.0 GB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	7 files UD-Q3_K_XL/DeepSeek-V3.2-UD-Q3_K_XL-00001-of-00007.gguf48.6 GB UD-Q3_K_XL/DeepSeek-V3.2-UD-Q3_K_XL-00002-of-00007.gguf49.4 GB UD-Q3_K_XL/DeepSeek-V3.2-UD-Q3_K_XL-00003-of-00007.gguf49.4 GB UD-Q3_K_XL/DeepSeek-V3.2-UD-Q3_K_XL-00004-of-00007.gguf49.4 GB UD-Q3_K_XL/DeepSeek-V3.2-UD-Q3_K_XL-00005-of-00007.gguf49.5 GB UD-Q3_K_XL/DeepSeek-V3.2-UD-Q3_K_XL-00006-of-00007.gguf49.4 GB UD-Q3_K_XL/DeepSeek-V3.2-UD-Q3_K_XL-00007-of-00007.gguf25.2 GB Complete observed GGUF quant group; all 7 shard(s) are required.
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · UD-Q4_K_XL	407.8 GB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	9 files UD-Q4_K_XL/DeepSeek-V3.2-UD-Q4_K_XL-00001-of-00009.gguf49.0 GB UD-Q4_K_XL/DeepSeek-V3.2-UD-Q4_K_XL-00002-of-00009.gguf50.0 GB UD-Q4_K_XL/DeepSeek-V3.2-UD-Q4_K_XL-00003-of-00009.gguf50.0 GB UD-Q4_K_XL/DeepSeek-V3.2-UD-Q4_K_XL-00004-of-00009.gguf48.5 GB UD-Q4_K_XL/DeepSeek-V3.2-UD-Q4_K_XL-00005-of-00009.gguf49.5 GB UD-Q4_K_XL/DeepSeek-V3.2-UD-Q4_K_XL-00006-of-00009.gguf48.4 GB UD-Q4_K_XL/DeepSeek-V3.2-UD-Q4_K_XL-00007-of-00009.gguf48.4 GB UD-Q4_K_XL/DeepSeek-V3.2-UD-Q4_K_XL-00008-of-00009.gguf49.2 GB UD-Q4_K_XL/DeepSeek-V3.2-UD-Q4_K_XL-00009-of-00009.gguf14.8 GB Complete observed GGUF quant group; all 9 shard(s) are required.
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · UD-Q5_K_XL	481.9 GB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	10 files UD-Q5_K_XL/DeepSeek-V3.2-UD-Q5_K_XL-00001-of-00010.gguf49.7 GB UD-Q5_K_XL/DeepSeek-V3.2-UD-Q5_K_XL-00002-of-00010.gguf49.7 GB UD-Q5_K_XL/DeepSeek-V3.2-UD-Q5_K_XL-00003-of-00010.gguf47.6 GB UD-Q5_K_XL/DeepSeek-V3.2-UD-Q5_K_XL-00004-of-00010.gguf48.8 GB UD-Q5_K_XL/DeepSeek-V3.2-UD-Q5_K_XL-00005-of-00010.gguf48.8 GB UD-Q5_K_XL/DeepSeek-V3.2-UD-Q5_K_XL-00006-of-00010.gguf49.7 GB UD-Q5_K_XL/DeepSeek-V3.2-UD-Q5_K_XL-00007-of-00010.gguf48.8 GB UD-Q5_K_XL/DeepSeek-V3.2-UD-Q5_K_XL-00008-of-00010.gguf47.6 GB UD-Q5_K_XL/DeepSeek-V3.2-UD-Q5_K_XL-00009-of-00010.gguf47.1 GB UD-Q5_K_XL/DeepSeek-V3.2-UD-Q5_K_XL-00010-of-00010.gguf44.1 GB Complete observed GGUF quant group; all 10 shard(s) are required.
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · UD-Q6_K_XL	574.0 GB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	12 files UD-Q6_K_XL/DeepSeek-V3.2-UD-Q6_K_XL-00001-of-00012.gguf47.6 GB UD-Q6_K_XL/DeepSeek-V3.2-UD-Q6_K_XL-00002-of-00012.gguf47.1 GB UD-Q6_K_XL/DeepSeek-V3.2-UD-Q6_K_XL-00003-of-00012.gguf48.4 GB UD-Q6_K_XL/DeepSeek-V3.2-UD-Q6_K_XL-00004-of-00012.gguf50.0 GB UD-Q6_K_XL/DeepSeek-V3.2-UD-Q6_K_XL-00005-of-00012.gguf47.6 GB UD-Q6_K_XL/DeepSeek-V3.2-UD-Q6_K_XL-00006-of-00012.gguf47.4 GB UD-Q6_K_XL/DeepSeek-V3.2-UD-Q6_K_XL-00007-of-00012.gguf50.0 GB UD-Q6_K_XL/DeepSeek-V3.2-UD-Q6_K_XL-00008-of-00012.gguf47.6 GB UD-Q6_K_XL/DeepSeek-V3.2-UD-Q6_K_XL-00009-of-00012.gguf50.0 GB UD-Q6_K_XL/DeepSeek-V3.2-UD-Q6_K_XL-00010-of-00012.gguf47.6 GB UD-Q6_K_XL/DeepSeek-V3.2-UD-Q6_K_XL-00011-of-00012.gguf47.4 GB UD-Q6_K_XL/DeepSeek-V3.2-UD-Q6_K_XL-00012-of-00012.gguf43.2 GB Complete observed GGUF quant group; all 12 shard(s) are required.
unslothunsloth/DeepSeek-V3.2-GGUF ↗Observed 22 Oct 2026	GGUF · UD-Q8_K_XL	780.2 GB	Over 128 GBEstimated requirement exceeds 128 GB using the documented headroom formula.	17 files UD-Q8_K_XL/DeepSeek-V3.2-UD-Q8_K_XL-00001-of-00017.gguf42.7 GB UD-Q8_K_XL/DeepSeek-V3.2-UD-Q8_K_XL-00002-of-00017.gguf42.6 GB UD-Q8_K_XL/DeepSeek-V3.2-UD-Q8_K_XL-00003-of-00017.gguf47.8 GB UD-Q8_K_XL/DeepSeek-V3.2-UD-Q8_K_XL-00004-of-00017.gguf49.0 GB UD-Q8_K_XL/DeepSeek-V3.2-UD-Q8_K_XL-00005-of-00017.gguf49.0 GB UD-Q8_K_XL/DeepSeek-V3.2-UD-Q8_K_XL-00006-of-00017.gguf49.0 GB UD-Q8_K_XL/DeepSeek-V3.2-UD-Q8_K_XL-00007-of-00017.gguf49.0 GB UD-Q8_K_XL/DeepSeek-V3.2-UD-Q8_K_XL-00008-of-00017.gguf49.0 GB UD-Q8_K_XL/DeepSeek-V3.2-UD-Q8_K_XL-00009-of-00017.gguf47.4 GB UD-Q8_K_XL/DeepSeek-V3.2-UD-Q8_K_XL-00010-of-00017.gguf49.0 GB UD-Q8_K_XL/DeepSeek-V3.2-UD-Q8_K_XL-00011-of-00017.gguf49.0 GB UD-Q8_K_XL/DeepSeek-V3.2-UD-Q8_K_XL-00012-of-00017.gguf48.6 GB UD-Q8_K_XL/DeepSeek-V3.2-UD-Q8_K_XL-00013-of-00017.gguf47.8 GB UD-Q8_K_XL/DeepSeek-V3.2-UD-Q8_K_XL-00014-of-00017.gguf49.0 GB UD-Q8_K_XL/DeepSeek-V3.2-UD-Q8_K_XL-00015-of-00017.gguf49.0 GB UD-Q8_K_XL/DeepSeek-V3.2-UD-Q8_K_XL-00016-of-00017.gguf46.9 GB UD-Q8_K_XL/DeepSeek-V3.2-UD-Q8_K_XL-00017-of-00017.gguf15.1 GB Complete observed GGUF quant group; all 17 shard(s) are required.

CURATED TRACKING

Known issues

No curated issues verified for this snapshot. An empty list does not mean there are no bugs.

HARDWARE NOTES

Hardware testing planned

No execution or benchmark results are published for this model yet.

DeepSeek-V3.2

Runtime status

llama.cpp

Ollama

LM Studio

MLX / mlx-lm

vLLM

Which file should I grab?

16 GB capacity estimate

24 GB capacity estimate

32 GB capacity estimate

128 GB capacity estimate

Quant uploads

Known issues

Hardware testing planned

Get weekly local-model support updates