Does It Run Local?

← All models

openbmb · observed 19 Oct 2026

Public-source support evidence

MiniCPM-V-4.7-35B-A3B

openbmb/MiniCPM-V-4.7-35B-A3B

No description recorded in this snapshot.

View source model ↗

SUPPORT EVIDENCE

Runtime status

llama.cpp

Architecture listed

The model config architecture is listed in this runtime registry. This is family/architecture evidence only; exact checkpoint loading, model-specific configuration, hardware, and generation were not tested.

Checked 2026-10-19 02:17 UTC

Evidence source ↗

Ollama

Upload available

Fresh Ollama publisher tags page exposes this exact local upload variant; availability only, not hardware-tested support.

Checked 2026-10-19 10:01 UTC

Evidence source ↗

LM Studio

Unknown

Targeted public search of the lmstudio-community namespace produced no exact matching model with base_model metadata; absence is not evidence of runtime incompatibility.

Checked 2026-10-19 10:01 UTC

Checked source ↗

MLX / mlx-lm

Upload available

Fresh exact base_model-tagged repository contains MLX community weight files and is tagged mlx-vlm. This establishes upload availability only; mlx-lm compatibility and execution were not tested.

Checked 2026-10-19 10:01 UTC

Evidence source ↗

vLLM

Merged · release unverified

Merged · release unverified. Official MiniCPM-V 4.7 deployment guide links this exact model ID and PR #58674; the support PR is merged, while an official release is not established.

Checked 2026-10-19 10:00 UTC

Evidence source ↗

MLX community uploads may target mlx-vlm; an upload observation does not establish mlx-lm compatibility.

MEMORY ESTIMATES

Which file should I grab?

16 GB memory

Which file should I grab?

IQ2_S · 12.0 GB observed ↗

Observed artifact size plus 20% headroom and 1.5 GB runtime allowance. Fit is an estimate; compatibility, speed, context length and hardware have not been tested. This estimates text weights only; vision projector and total vision memory are unknown.

24 GB memory

Which file should I grab?

Q3_K_M · 17.3 GB observed ↗

Observed artifact size plus 20% headroom and 1.5 GB runtime allowance. Fit is an estimate; compatibility, speed, context length and hardware have not been tested. This estimates text weights only; vision projector and total vision memory are unknown.

32 GB memory

Which file should I grab?

Q5_K_S · 25.1 GB observed ↗

Observed artifact size plus 20% headroom and 1.5 GB runtime allowance. Fit is an estimate; compatibility, speed, context length and hardware have not been tested. This estimates text weights only; vision projector and total vision memory are unknown.

128 GB memory

Which file should I grab?

Q8_0 · 36.9 GB observed ↗

Observed artifact size plus 20% headroom and 1.5 GB runtime allowance. Fit is an estimate; compatibility, speed, context length and hardware have not been tested. This estimates text weights only; vision projector and total vision memory are unknown.

Observed artifact size plus 20% headroom and 1.5 GB runtime allowance. Fit is an estimate; it does not establish runtime compatibility, speed, context length, or hardware performance. Text-weights-only estimates do not include a projector or total vision memory where unknown.

OBSERVED FILES

Quant uploads

Sizes and file groups come from the listed uploader repositories. A size is marked as an estimated fit only for a complete observed GGUF quant group.

UploaderFormat & quantObserved sizeEstimated fitFiles
bartowskibartowski/MiniCPM-V-4.7-35B-A3B-GGUF ↗Observed 19 Oct 2026GGUF · IQ2_M13.2 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/MiniCPM-V-4.7-35B-A3B-GGUF ↗Observed 19 Oct 2026GGUF · IQ2_S12.0 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/MiniCPM-V-4.7-35B-A3B-GGUF ↗Observed 19 Oct 2026GGUF · IQ2_XS11.3 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/MiniCPM-V-4.7-35B-A3B-GGUF ↗Observed 19 Oct 2026GGUF · IQ2_XXS10.8 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/MiniCPM-V-4.7-35B-A3B-GGUF ↗Observed 19 Oct 2026GGUF · IQ3_M19.0 GB32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/MiniCPM-V-4.7-35B-A3B-GGUF ↗Observed 19 Oct 2026GGUF · IQ3_XS16.3 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/MiniCPM-V-4.7-35B-A3B-GGUF ↗Observed 19 Oct 2026GGUF · IQ3_XXS15.6 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/MiniCPM-V-4.7-35B-A3B-GGUF ↗Observed 19 Oct 2026GGUF · IQ4_NL22.3 GB32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/MiniCPM-V-4.7-35B-A3B-GGUF ↗Observed 19 Oct 2026GGUF · IQ4_XS19.9 GB32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/MiniCPM-V-4.7-35B-A3B-GGUF ↗Observed 19 Oct 2026GGUF · Q2_K13.8 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/MiniCPM-V-4.7-35B-A3B-GGUF ↗Observed 19 Oct 2026GGUF · Q3_K_L18.3 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/MiniCPM-V-4.7-35B-A3B-GGUF ↗Observed 19 Oct 2026GGUF · Q3_K_M17.3 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/MiniCPM-V-4.7-35B-A3B-GGUF ↗Observed 19 Oct 2026GGUF · Q3_K_S16.3 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/MiniCPM-V-4.7-35B-A3B-GGUF ↗Observed 19 Oct 2026GGUF · Q4_019.9 GB32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/MiniCPM-V-4.7-35B-A3B-GGUF ↗Observed 19 Oct 2026GGUF · Q4_122.0 GB32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/MiniCPM-V-4.7-35B-A3B-GGUF ↗Observed 19 Oct 2026GGUF · Q4_K_L24.1 GB32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/MiniCPM-V-4.7-35B-A3B-GGUF ↗Observed 19 Oct 2026GGUF · Q4_K_M22.3 GB32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/MiniCPM-V-4.7-35B-A3B-GGUF ↗Observed 19 Oct 2026GGUF · Q4_K_S20.9 GB32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/MiniCPM-V-4.7-35B-A3B-GGUF ↗Observed 19 Oct 2026GGUF · Q5_K_M27.0 GB128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/MiniCPM-V-4.7-35B-A3B-GGUF ↗Observed 19 Oct 2026GGUF · Q5_K_S25.1 GB32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/MiniCPM-V-4.7-35B-A3B-GGUF ↗Observed 19 Oct 2026GGUF · Q6_K30.7 GB128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/MiniCPM-V-4.7-35B-A3B-GGUF ↗Observed 19 Oct 2026GGUF · Q6_K_L32.3 GB128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/MiniCPM-V-4.7-35B-A3B-GGUF ↗Observed 19 Oct 2026GGUF · Q6_K_S29.4 GB128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/MiniCPM-V-4.7-35B-A3B-GGUF ↗Observed 19 Oct 2026GGUF · Q8_036.9 GB128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/MiniCPM-V-4.7-35B-A3B-GGUF ↗Observed 19 Oct 2026GGUF · BF1669.4 GB128 GBEstimate only; requires the complete GGUF quant group.
2 files
Complete observed GGUF quant group; all 2 shard(s) are required.
mlx-communitymlx-community/MiniCPM-V-4.7-35B-A3B-mxfp4 ↗Observed 19 Oct 2026MLX · Quant unknownSize unknownUnknownUnknown: completeness or a complete GGUF quant group was not verified.
5 files
Observed weight file metadata; completeness unavailable without index/config verification.

CURATED TRACKING

Known issues

No curated issues verified for this snapshot. An empty list does not mean there are no bugs.

HARDWARE NOTES

Tested on DGX Spark / Mac Studio: coming soon

No hardware benchmark measurements are available in this snapshot.