The model config architecture is listed in this runtime registry. This is family/architecture evidence only; exact checkpoint loading, model-specific configuration, hardware, and generation were not tested.
The model config architecture is listed in this runtime registry. This is family/architecture evidence only; exact checkpoint loading, model-specific configuration, hardware, and generation were not tested.
MLX community uploads may target mlx-vlm; an upload observation does not establish mlx-lm compatibility.
MEMORY ESTIMATES
Which file should I grab?
16 GB capacity estimate
Which file should I grab?
No observed complete artifact currently qualifies.
Unknown: no observed complete artifact fits this capacity with documented headroom.
24 GB capacity estimate
Which file should I grab?
No observed complete artifact currently qualifies.
Unknown: no observed complete artifact fits this capacity with documented headroom.
32 GB capacity estimate
Which file should I grab?
No observed complete artifact currently qualifies.
Unknown: no observed complete artifact fits this capacity with documented headroom.
64 GB capacity estimate
Which file should I grab?
No observed complete artifact currently qualifies.
Unknown: no observed complete artifact fits this capacity with documented headroom.
128 GB capacity estimate
Which file should I grab?
No observed complete artifact currently qualifies.
Unknown: no observed complete artifact fits this capacity with documented headroom.
Memory estimates are the observed file size plus fixed headroom (20% plus 1.5 GB runtime allowance); real needs also depend on context length, KV cache and runtime settings. Fit is an estimate; it does not establish runtime compatibility, speed, context length, or hardware performance. Text-weights-only estimates do not include a projector or total vision memory where unknown.
Terms: a quant is a lower-precision version of the weights; GGUF is a file format used by llama.cpp and compatible apps; MLX targets Apple silicon; vLLM is a model-serving engine for NVIDIA GPUs; the KV cache is stored attention state that grows with context length. Terms explained ↗
OBSERVED FILES
Quant uploads
Sizes and file groups come from the listed uploader repositories. A size is marked as an estimated fit only for a complete observed GGUF quant group.