ibm-granite · observed 22 Oct 2026
Public-source support evidence
granite-3.1-2b-instruct is listed for local download in Ollama. A separately observed community Q4_K_M GGUF gives an estimated memory budget of about 4 GB; actual use depends on runtime and context settings.
ibm-granite/granite-3.1-2b-instruct
granite-3.1-2b-instruct is a text generation model published by ibm-granite on Hugging Face. We have not written a summary yet; see the model card ↗
View source model ↗SUPPORT EVIDENCE
The model config architecture is listed in this runtime registry. This is family/architecture evidence only; exact checkpoint loading, model-specific configuration, hardware, and generation were not tested.
Checked 2026-10-22 14:53 UTC
Evidence source ↗In release. Ollama public library page exposes this exact size variant; catalog availability only, not hardware-tested support.
Checked 2026-10-22 17:04 UTC
Evidence source ↗A current public GGUF upload with an exact base_model match was observed. Upload availability only; this model was not loaded or hardware-tested.
Checked 2026-10-22 17:04 UTC
Evidence source ↗The model config architecture is listed in this runtime registry. This is family/architecture evidence only; exact checkpoint loading, model-specific configuration, hardware, and generation were not tested.
Checked 2026-10-22 14:53 UTC
Evidence source ↗The model config architecture is listed in this runtime registry. This is family/architecture evidence only; exact checkpoint loading, model-specific configuration, hardware, and generation were not tested.
Checked 2026-10-22 14:53 UTC
Evidence source ↗MLX community uploads may target mlx-vlm; an upload observation does not establish mlx-lm compatibility.
MEMORY ESTIMATES
Which file should I grab?
Q8_0 · 2.7 GB observed ↗Observed artifact size plus 20% headroom and 1.5 GB runtime allowance. Fit is an estimate; compatibility, speed, context length and hardware have not been tested.
Which file should I grab?
Q8_0 · 2.7 GB observed ↗Observed artifact size plus 20% headroom and 1.5 GB runtime allowance. Fit is an estimate; compatibility, speed, context length and hardware have not been tested.
Which file should I grab?
Q8_0 · 2.7 GB observed ↗Observed artifact size plus 20% headroom and 1.5 GB runtime allowance. Fit is an estimate; compatibility, speed, context length and hardware have not been tested.
Which file should I grab?
Q8_0 · 2.7 GB observed ↗Observed artifact size plus 20% headroom and 1.5 GB runtime allowance. Fit is an estimate; compatibility, speed, context length and hardware have not been tested.
Memory estimates are the observed file size plus fixed headroom (20% plus 1.5 GB runtime allowance); real needs also depend on context length, KV cache and runtime settings. Fit is an estimate; it does not establish runtime compatibility, speed, context length, or hardware performance. Text-weights-only estimates do not include a projector or total vision memory where unknown.
Terms: a quant is a lower-precision version of the weights; GGUF is a file format used by llama.cpp and compatible apps; MLX targets Apple silicon; vLLM is a model-serving engine for NVIDIA GPUs; the KV cache is stored attention state that grows with context length. Terms explained ↗
OBSERVED FILES
Sizes and file groups come from the listed uploader repositories. A size is marked as an estimated fit only for a complete observed GGUF quant group.
| Uploader | Format & quant | Observed size | Estimated fit | Files |
|---|---|---|---|---|
| bartowskibartowski/granite-3.1-2b-instruct-GGUF ↗Observed 22 Oct 2026 | GGUF · IQ2_M | 888.5 MB | 16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group. | 1 file |
| bartowskibartowski/granite-3.1-2b-instruct-GGUF ↗Observed 22 Oct 2026 | GGUF · IQ3_M | 1.2 GB | 16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group. | 1 file |
| bartowskibartowski/granite-3.1-2b-instruct-GGUF ↗Observed 22 Oct 2026 | GGUF · IQ3_XS | 1.1 GB | 16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group. | 1 file |
| bartowskibartowski/granite-3.1-2b-instruct-GGUF ↗Observed 22 Oct 2026 | GGUF · IQ4_NL | 1.5 GB | 16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group. | 1 file |
| bartowskibartowski/granite-3.1-2b-instruct-GGUF ↗Observed 22 Oct 2026 | GGUF · IQ4_XS | 1.4 GB | 16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group. | 1 file |
| bartowskibartowski/granite-3.1-2b-instruct-GGUF ↗Observed 22 Oct 2026 | GGUF · Q2_K | 978.2 MB | 16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group. | 1 file |
| bartowskibartowski/granite-3.1-2b-instruct-GGUF ↗Observed 22 Oct 2026 | GGUF · Q2_K_L | 1.0 GB | 16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group. | 1 file |
| bartowskibartowski/granite-3.1-2b-instruct-GGUF ↗Observed 22 Oct 2026 | GGUF · Q3_K_L | 1.4 GB | 16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group. | 1 file |
| bartowskibartowski/granite-3.1-2b-instruct-GGUF ↗Observed 22 Oct 2026 | GGUF · Q3_K_M | 1.3 GB | 16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group. | 1 file |
| bartowskibartowski/granite-3.1-2b-instruct-GGUF ↗Observed 22 Oct 2026 | GGUF · Q3_K_S | 1.1 GB | 16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group. | 1 file |
| bartowskibartowski/granite-3.1-2b-instruct-GGUF ↗Observed 22 Oct 2026 | GGUF · Q3_K_XL | 1.4 GB | 16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group. | 1 file |
| bartowskibartowski/granite-3.1-2b-instruct-GGUF ↗Observed 22 Oct 2026 | GGUF · Q4_0 | 1.5 GB | 16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group. | 1 file |
| bartowskibartowski/granite-3.1-2b-instruct-GGUF ↗Observed 22 Oct 2026 | GGUF · Q4_K_L | 1.6 GB | 16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group. | 1 file |
| bartowskibartowski/granite-3.1-2b-instruct-GGUF ↗Observed 22 Oct 2026 | GGUF · Q4_K_M | 1.5 GB | 16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group. | 1 file |
| bartowskibartowski/granite-3.1-2b-instruct-GGUF ↗Observed 22 Oct 2026 | GGUF · Q4_K_S | 1.5 GB | 16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group. | 1 file |
| bartowskibartowski/granite-3.1-2b-instruct-GGUF ↗Observed 22 Oct 2026 | GGUF · Q5_K_L | 1.8 GB | 16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group. | 1 file |
| bartowskibartowski/granite-3.1-2b-instruct-GGUF ↗Observed 22 Oct 2026 | GGUF · Q5_K_M | 1.8 GB | 16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group. | 1 file |
| bartowskibartowski/granite-3.1-2b-instruct-GGUF ↗Observed 22 Oct 2026 | GGUF · Q5_K_S | 1.8 GB | 16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group. | 1 file |
| bartowskibartowski/granite-3.1-2b-instruct-GGUF ↗Observed 22 Oct 2026 | GGUF · Q6_K | 2.1 GB | 16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group. | 1 file |
| bartowskibartowski/granite-3.1-2b-instruct-GGUF ↗Observed 22 Oct 2026 | GGUF · Q6_K_L | 2.1 GB | 16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group. | 1 file |
| bartowskibartowski/granite-3.1-2b-instruct-GGUF ↗Observed 22 Oct 2026 | GGUF · Q8_0 | 2.7 GB | 16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group. | 1 file |
| bartowskibartowski/granite-3.1-2b-instruct-GGUF ↗Observed 22 Oct 2026 | GGUF · F16 | 5.1 GB | 16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group. | 1 file |
| lmstudio-communitylmstudio-community/granite-3.1-2b-instruct-GGUF ↗Observed 22 Oct 2026 | GGUF · Q3_K_L | 1.4 GB | 16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group. | 1 file |
| lmstudio-communitylmstudio-community/granite-3.1-2b-instruct-GGUF ↗Observed 22 Oct 2026 | GGUF · Q4_K_M | 1.5 GB | 16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group. | 1 file |
| lmstudio-communitylmstudio-community/granite-3.1-2b-instruct-GGUF ↗Observed 22 Oct 2026 | GGUF · Q6_K | 2.1 GB | 16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group. | 1 file |
| lmstudio-communitylmstudio-community/granite-3.1-2b-instruct-GGUF ↗Observed 22 Oct 2026 | GGUF · Q8_0 | 2.7 GB | 16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group. | 1 file |
CURATED TRACKING
No curated issues verified for this snapshot. An empty list does not mean there are no bugs.
HARDWARE NOTES
No execution or benchmark results are published for this model yet.