Does It Run Local?

← All models

baidu · observed 22 Oct 2026

Public-source support evidence

ERNIE-4.5-21B-A3B-Thinking

Exact checkpoint execution is unverified. The architecture is listed in llama.cpp, MLX / mlx-lm, and vLLM.

baidu/ERNIE-4.5-21B-A3B-Thinking

ERNIE-4.5-21B-A3B-Thinking is a text generation model published by baidu on Hugging Face. We have not written a summary yet; see the model card ↗

View source model ↗

SUPPORT EVIDENCE

Runtime status

llama.cpp

Architecture listed

The model config architecture is listed in this runtime registry. This is family/architecture evidence only; exact checkpoint loading, model-specific configuration, hardware, and generation were not tested.

Checked 2026-10-22 14:56 UTC

Evidence source ↗

Ollama

Unknown

The exact model and runtime-specific sources were checked; no positive model-level evidence was established.

Checked 2026-10-22 16:53 UTC

Version v0.40.8

Checked source ↗

LM Studio

Unknown

The exact model and runtime-specific sources were checked; no positive model-level evidence was established.

Checked 2026-10-22 16:53 UTC

Checked source ↗

MLX / mlx-lm

Architecture listed

The model config architecture is listed in this runtime registry. This is family/architecture evidence only; exact checkpoint loading, model-specific configuration, hardware, and generation were not tested.

Checked 2026-10-22 14:56 UTC

Evidence source ↗

vLLM

Architecture listed

The model config architecture is listed in this runtime registry. This is family/architecture evidence only; exact checkpoint loading, model-specific configuration, hardware, and generation were not tested.

Checked 2026-10-22 14:56 UTC

Evidence source ↗

MLX community uploads may target mlx-vlm; an upload observation does not establish mlx-lm compatibility.

MEMORY ESTIMATES

Which file should I grab?

16 GB capacity estimate

Which file should I grab?

Q3_K_M · 10.5 GB observed ↗

Observed artifact size plus 20% headroom and 1.5 GB runtime allowance. Fit is an estimate; compatibility, speed, context length and hardware have not been tested.

24 GB capacity estimate

Which file should I grab?

Q6_K · 18.1 GB observed ↗

Observed artifact size plus 20% headroom and 1.5 GB runtime allowance. Fit is an estimate; compatibility, speed, context length and hardware have not been tested.

32 GB capacity estimate

Which file should I grab?

Q8_0 · 23.2 GB observed ↗

Observed artifact size plus 20% headroom and 1.5 GB runtime allowance. Fit is an estimate; compatibility, speed, context length and hardware have not been tested.

128 GB capacity estimate

Which file should I grab?

Q8_0 · 23.2 GB observed ↗

Observed artifact size plus 20% headroom and 1.5 GB runtime allowance. Fit is an estimate; compatibility, speed, context length and hardware have not been tested.

Memory estimates are the observed file size plus fixed headroom (20% plus 1.5 GB runtime allowance); real needs also depend on context length, KV cache and runtime settings. Fit is an estimate; it does not establish runtime compatibility, speed, context length, or hardware performance. Text-weights-only estimates do not include a projector or total vision memory where unknown.

Terms: a quant is a lower-precision version of the weights; GGUF is a file format used by llama.cpp and compatible apps; MLX targets Apple silicon; vLLM is a model-serving engine for NVIDIA GPUs; the KV cache is stored attention state that grows with context length. Terms explained ↗

OBSERVED FILES

Quant uploads

Sizes and file groups come from the listed uploader repositories. A size is marked as an estimated fit only for a complete observed GGUF quant group.

UploaderFormat & quantObserved sizeEstimated fitFiles
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · BF1643.7 GB128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · IQ4_NL12.5 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · IQ4_XS11.8 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q2_K8.2 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q2_K_L8.2 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q3_K_M10.5 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q3_K_S9.6 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q4_012.5 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q4_113.8 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q4_K_M13.3 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q4_K_S12.5 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q5_K_M15.6 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q5_K_S15.1 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q6_K18.0 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q8_023.2 GB32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · UD-IQ1_M7.2 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · UD-IQ1_S7.0 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · UD-IQ2_M8.0 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · UD-IQ2_XXS7.8 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · UD-IQ3_XXS9.5 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · UD-Q2_K_XL8.2 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · UD-Q3_K_XL10.6 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · UD-Q4_K_XL13.4 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · UD-Q5_K_XL15.7 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · UD-Q6_K_XL19.3 GB32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · UD-Q8_K_XL26.6 GB128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q1_06.5 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · IQ2_M7.2 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · IQ2_S6.4 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · IQ2_XS6.3 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · IQ2_XXS5.6 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · IQ3_M10.3 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · IQ3_XS9.4 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · IQ3_XXS9.0 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · IQ4_NL12.6 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · IQ4_XS12.0 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q2_K8.1 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q2_K_L8.2 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q3_K_L10.7 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q3_K_M10.3 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q3_K_S9.9 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q3_K_XL10.7 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q4_012.8 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q4_113.9 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q4_K_L13.6 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q4_K_M13.5 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q4_K_S13.0 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q5_K_L15.8 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q5_K_M15.8 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q5_K_S15.2 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q6_K18.1 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q6_K_L18.1 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · Q8_023.2 GB32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF ↗Observed 22 Oct 2026GGUF · BF1643.7 GB128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.

CURATED TRACKING

Known issues

No curated issues verified for this snapshot. An empty list does not mean there are no bugs.

HARDWARE NOTES

Hardware testing planned

No execution or benchmark results are published for this model yet.