The model config architecture is listed in this runtime registry. This is family/architecture evidence only; exact checkpoint loading, model-specific configuration, hardware, and generation were not tested.
The model config architecture is listed in this runtime registry. This is family/architecture evidence only; exact checkpoint loading, model-specific configuration, hardware, and generation were not tested.
The model config architecture is listed in this runtime registry. This is family/architecture evidence only; exact checkpoint loading, model-specific configuration, hardware, and generation were not tested.
MLX community uploads may target mlx-vlm; an upload observation does not establish mlx-lm compatibility.
MEMORY ESTIMATES
Which file should I grab?
16 GB capacity estimate
Which file should I grab?
No observed complete artifact currently qualifies.
Unknown: no observed complete artifact fits this capacity with documented headroom.
24 GB capacity estimate
Which file should I grab?
No observed complete artifact currently qualifies.
Unknown: no observed complete artifact fits this capacity with documented headroom.
32 GB capacity estimate
Which file should I grab?
No observed complete artifact currently qualifies.
Unknown: no observed complete artifact fits this capacity with documented headroom.
64 GB capacity estimate
Which file should I grab?
No observed complete artifact currently qualifies.
Unknown: no observed complete artifact fits this capacity with documented headroom.
128 GB capacity estimate
Which file should I grab?
No observed complete artifact currently qualifies.
Unknown: no observed complete artifact fits this capacity with documented headroom.
192 GB capacity estimate
Which file should I grab?
No observed complete artifact currently qualifies.
Unknown: no observed complete artifact fits this capacity with documented headroom.
256 GB capacity estimate
Which file should I grab?
No observed complete artifact currently qualifies.
Unknown: no observed complete artifact fits this capacity with documented headroom.
512 GB capacity estimate
Which file should I grab?
No observed complete artifact currently qualifies.
Unknown: no observed complete artifact fits this capacity with documented headroom.
Memory estimates are the observed file size plus fixed headroom (20% plus 1.5 GB runtime allowance); real needs also depend on context length, KV cache and runtime settings. Fit is an estimate; it does not establish runtime compatibility, speed, context length, or hardware performance. Text-weights-only estimates do not include a projector or total vision memory where unknown.
Terms: a quant is a lower-precision version of the weights; GGUF is a file format used by llama.cpp and compatible apps; MLX targets Apple silicon; vLLM is a model-serving engine for NVIDIA GPUs; the KV cache is stored attention state that grows with context length. Terms explained ↗
OBSERVED FILES
Quant uploads
Sizes and file groups come from the listed uploader repositories. A size is marked as an estimated fit only for a complete observed GGUF quant group.
No observed quant uploads in this snapshot.
CURATED TRACKING
Known issues
No curated issues verified for this snapshot. An empty list does not mean there are no bugs.
HARDWARE NOTES
Hardware testing planned
No execution or benchmark results are published for this model yet.