Aleph-Alpha · Released Oct 2, 2026 · observed 28 Oct 2026
Public-source support evidence
We ran the Q4_K_M GGUF on one Mac; see Hardware notes below. The architecture is listed in llama.cpp and vLLM.
Aleph-Alpha/Kolibri-1-BF16
Kolibri-1-BF16 is a text generation model published by Aleph-Alpha on Hugging Face. We have not written a summary yet; see the model card ↗.
View source model ↗SUPPORT EVIDENCE
The model config architecture is listed in this runtime registry. This is family/architecture evidence only; exact checkpoint loading, model-specific configuration, hardware, and generation were not tested.
Checked 2026-10-28 04:06 UTC
Evidence source ↗The exact model and runtime-specific sources were checked; no positive model-level evidence was established.
Checked 2026-10-28 04:06 UTC
Version v0.40.12
Checked source ↗The exact model and runtime-specific sources were checked; no positive model-level evidence was established.
Checked 2026-10-28 04:06 UTC
Checked source ↗Checked the exact model config and the runtime architecture registry; no matching declared architecture was found. This is unknown, not evidence of incompatibility.
Checked 2026-10-28 04:06 UTC
Checked source ↗The model config architecture is listed in this runtime registry. This is family/architecture evidence only; exact checkpoint loading, model-specific configuration, hardware, and generation were not tested.
Checked 2026-10-28 04:06 UTC
Evidence source ↗MLX community uploads may target mlx-vlm; an upload observation does not establish mlx-lm compatibility.
MEMORY ESTIMATES
The summary estimate of about 62 GB is the recommended Q4_K_M quant (49.8 GB observed), from file size × 1.2 + 1.5 GB. Each card is the largest observed quant whose estimate fits that capacity.
Which file should I grab?
doesn't fitNo observed complete quant fits this capacity using file size × 1.2 + 1.5 GB.
Which file should I grab?
IQ1_S · 17.6 GB observed · about 23 GB ↗About 23 GB using file size × 1.2 + 1.5 GB. Fit is an estimate; compatibility, speed, context length and hardware have not been tested.
Which file should I grab?
IQ2_XS · 24.3 GB observed · about 31 GB ↗About 31 GB using file size × 1.2 + 1.5 GB. Fit is an estimate; compatibility, speed, context length and hardware have not been tested.
Which file should I grab?
Q4_K_M · 49.8 GB observed · about 62 GB ↗About 62 GB using file size × 1.2 + 1.5 GB. Fit is an estimate; compatibility, speed, context length and hardware have not been tested.
Which file should I grab?
Q8_0 · 83.1 GB observed · about 102 GB ↗About 102 GB using file size × 1.2 + 1.5 GB. Fit is an estimate; compatibility, speed, context length and hardware have not been tested. Link points to shard 1; all 3 linked shards are required.
Which file should I grab?
BF16 · 156.3 GB observed · about 190 GB ↗About 190 GB using file size × 1.2 + 1.5 GB. Fit is an estimate; compatibility, speed, context length and hardware have not been tested. Link points to shard 1; all 4 linked shards are required.
Which file should I grab?
BF16 · 156.3 GB observed · about 190 GB ↗About 190 GB using file size × 1.2 + 1.5 GB. Fit is an estimate; compatibility, speed, context length and hardware have not been tested. Link points to shard 1; all 4 linked shards are required.
Which file should I grab?
BF16 · 156.3 GB observed · about 190 GB ↗About 190 GB using file size × 1.2 + 1.5 GB. Fit is an estimate; compatibility, speed, context length and hardware have not been tested. Link points to shard 1; all 4 linked shards are required.
Memory estimates are the observed file size plus fixed headroom (20% plus 1.5 GB runtime allowance); real needs also depend on context length, KV cache and runtime settings. Fit is an estimate; it does not establish runtime compatibility, speed, context length, or hardware performance. Text-weights-only estimates do not include a projector or total vision memory where unknown.
Terms: a quant is a lower-precision version of the weights; GGUF is a file format used by llama.cpp and compatible apps; MLX targets Apple silicon; vLLM is a model-serving engine for NVIDIA GPUs; the KV cache is stored attention state that grows with context length. Terms explained ↗
OBSERVED FILES
Sizes and file groups come from the listed uploader repositories. A size is marked as an estimated fit only for a complete observed GGUF quant group.
| Uploader | Format & quant | Observed size | Estimated fit | Files |
|---|---|---|---|---|
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · IQ1_M | 19.8 GB | 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | 1 file
|
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · IQ1_S | 17.6 GB | 24 GB, 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | 1 file
|
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · IQ2_M | 28.1 GB | 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | 1 file
|
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · IQ2_S | 25.6 GB | 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | 1 file
|
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · IQ2_XS | 24.3 GB | 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | 1 file
|
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · IQ2_XXS | 22.8 GB | 32 GB, 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | 1 file
|
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · IQ3_M | 40.7 GB | 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | 1 file
|
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · IQ3_XS | 35.5 GB | 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | 1 file
|
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · IQ3_XXS | 33.7 GB | 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | 1 file
|
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · IQ4_NL | 49.8 GB | 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | 1 file
|
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · IQ4_XS | 43.6 GB | 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | 1 file
|
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · Q2_K | 29.9 GB | 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | 1 file
|
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · Q3_K_L | 39.8 GB | 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | 1 file
|
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · Q3_K_M | 37.6 GB | 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | 1 file
|
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · Q3_K_S | 35.9 GB | 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | 1 file
|
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · Q4_0 | 44.6 GB | 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | 1 file
|
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · Q4_1 | 49.2 GB | 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | 1 file
|
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · Q4_K_L | 53.5 GB | 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | 1 file
|
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · Q4_K_M | 49.8 GB | 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | 1 file
|
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · Q4_K_S | 46.4 GB | 64 GB, 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | 1 file
|
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · Q5_K_M | 60.3 GB | 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | Complete observed GGUF quant group; all 2 shard(s) are required. |
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · Q5_K_S | 55.8 GB | 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | Complete observed GGUF quant group; all 2 shard(s) are required. |
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · Q6_K | 69.0 GB | 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | Complete observed GGUF quant group; all 2 shard(s) are required. |
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · Q6_K_L | 72.5 GB | 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | Complete observed GGUF quant group; all 2 shard(s) are required. |
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · Q6_K_S | 65.8 GB | 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | Complete observed GGUF quant group; all 2 shard(s) are required. |
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · Q8_0 | 83.1 GB | 128 GB, 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | Complete observed GGUF quant group; all 3 shard(s) are required. |
| bartowskibartowski/Kolibri-1-GGUF ↗Observed 28 Oct 2026 | GGUF · BF16 | 156.3 GB | 192 GB, 256 GB, 512 GBEstimate only; requires the complete GGUF quant group. | Complete observed GGUF quant group; all 4 shard(s) are required. |
CURATED TRACKING
No curated issues verified for this snapshot. An empty list does not mean there are no bugs.
HARDWARE NOTES
We ran the Q4_K_M GGUF (49.76 GB, bartowski/Kolibri-1-GGUF @ffd6001) on an Apple M4 Max Mac, 128 GiB unified memory, macOS 27.0.1, Metal with llama.cpp b11912 (upstream, 961c376) on 27 Oct 2026.
Decode: 84.6 tok/s on a short prompt, 82.8 tok/s on a long prompt (medians of 3 runs).
Peak memory: 48.0 GiB (llama-server footprint).
llama-bench: pp512 1,319.2 tok/s, tg128 86.0 tok/s.
Answer checks: 1 of 4 prompts passed (quick pass/fail sanity checks, not a quality benchmark).
We ran bartowski's Q4_K_M GGUF of this model, made from the BF16 weights on this page (not Aleph Alpha's FP8 release).
Default chat template settings (no thinking toggle passed). The model wrote reasoning text on every prompt; decode speed counts every generated token.
All three failed checks hit the 512-token output cap while the model was still reasoning.
One machine, one run set: temperature 0, 8K context, 1 warm-up plus 3 runs per prompt. Short prompt is 60 tokens; long prompt is 1,448 tokens (each model counts with its own tokenizer). Weights were loaded from an external USB drive with mmap off; load time is not published for this run. Your speed will differ with hardware, context length and settings.
COMPARE
No comparison page is generated for this model yet. Browse all comparisons →
EMBED
Works in GitHub READMEs and Hugging Face model cards. The badge updates when the site rebuilds.