Does It Run Local?

← All models

LiquidAI · observed 19 Oct 2026

Public-source support evidence

LFM2.5-24B-A2B

LiquidAI/LFM2.5-24B-A2B

No description recorded in this snapshot.

View source model ↗

SUPPORT EVIDENCE

Runtime status

llama.cpp

Architecture listed

The model config architecture is listed in this runtime registry. This is family/architecture evidence only; exact checkpoint loading, model-specific configuration, hardware, and generation were not tested.

Checked 2026-10-19 02:17 UTC

Evidence source ↗

Ollama

In release

In release. Fresh Ollama curated library tags page exposes this exact local model variant; catalog availability only, not hardware-tested support.

Checked 2026-10-19 10:01 UTC

Evidence source ↗

LM Studio

Unknown

Targeted public search of the lmstudio-community namespace produced no exact matching model with base_model metadata; absence is not evidence of runtime incompatibility.

Checked 2026-10-19 10:01 UTC

Checked source ↗

MLX / mlx-lm

Upload available

Fresh exact base_model-tagged public repository contains weight files in a format used by mlx_lm. This establishes upload availability only; model compatibility and execution were not tested.

Checked 2026-10-19 10:01 UTC

Evidence source ↗

vLLM

Architecture listed

The model config architecture is listed in this runtime registry. This is family/architecture evidence only; exact checkpoint loading, model-specific configuration, hardware, and generation were not tested.

Checked 2026-10-19 02:17 UTC

Evidence source ↗

MLX community uploads may target mlx-vlm; an upload observation does not establish mlx-lm compatibility.

MEMORY ESTIMATES

Which file should I grab?

16 GB memory

Which file should I grab?

Q3_K_M · 11.6 GB observed ↗

Observed artifact size plus 20% headroom and 1.5 GB runtime allowance. Fit is an estimate; compatibility, speed, context length and hardware have not been tested.

24 GB memory

Which file should I grab?

Q5_K_M · 18.5 GB observed ↗

Observed artifact size plus 20% headroom and 1.5 GB runtime allowance. Fit is an estimate; compatibility, speed, context length and hardware have not been tested.

32 GB memory

Which file should I grab?

Q6_K · 21.2 GB observed ↗

Observed artifact size plus 20% headroom and 1.5 GB runtime allowance. Fit is an estimate; compatibility, speed, context length and hardware have not been tested.

128 GB memory

Which file should I grab?

Q8_0 · 25.5 GB observed ↗

Observed artifact size plus 20% headroom and 1.5 GB runtime allowance. Fit is an estimate; compatibility, speed, context length and hardware have not been tested.

Observed artifact size plus 20% headroom and 1.5 GB runtime allowance. Fit is an estimate; it does not establish runtime compatibility, speed, context length, or hardware performance. Text-weights-only estimates do not include a projector or total vision memory where unknown.

OBSERVED FILES

Quant uploads

Sizes and file groups come from the listed uploader repositories. A size is marked as an estimated fit only for a complete observed GGUF quant group.

UploaderFormat & quantObserved sizeEstimated fitFiles
unslothunsloth/LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · BF1648.0 GB128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · Q8_025.5 GB128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · UD-IQ2_M7.5 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · UD-IQ2_XXS7.5 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · UD-IQ3_XXS9.0 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · UD-Q2_K_XL8.0 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · UD-Q3_K_XL10.9 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · UD-Q4_K_XL14.9 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · UD-Q5_K_XL17.9 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
unslothunsloth/LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · UD-Q6_K_XL21.9 GB32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/LiquidAI_LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · IQ2_M8.8 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/LiquidAI_LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · IQ2_S8.0 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/LiquidAI_LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · IQ2_XS7.5 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/LiquidAI_LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · IQ3_M12.6 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/LiquidAI_LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · IQ3_XS10.9 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/LiquidAI_LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · IQ3_XXS10.3 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/LiquidAI_LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · IQ4_NL15.2 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/LiquidAI_LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · IQ4_XS13.4 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/LiquidAI_LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · Q2_K9.2 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/LiquidAI_LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · Q3_K_L12.2 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/LiquidAI_LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · Q3_K_M11.6 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/LiquidAI_LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · Q3_K_S11.0 GB16 GB, 24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/LiquidAI_LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · Q4_013.6 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/LiquidAI_LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · Q4_115.1 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/LiquidAI_LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · Q4_K_L16.4 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/LiquidAI_LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · Q4_K_M15.4 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/LiquidAI_LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · Q4_K_S14.3 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/LiquidAI_LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · Q5_K_M18.5 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/LiquidAI_LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · Q5_K_S17.2 GB24 GB, 32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/LiquidAI_LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · Q6_K21.2 GB32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/LiquidAI_LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · Q6_K_L22.2 GB32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/LiquidAI_LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · Q6_K_S20.2 GB32 GB, 128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/LiquidAI_LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · Q8_025.5 GB128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
bartowskibartowski/LiquidAI_LFM2.5-24B-A2B-GGUF ↗Observed 19 Oct 2026GGUF · BF1648.0 GB128 GBEstimate only; requires the complete GGUF quant group.
1 file
Complete observed GGUF quant file.
mlx-communitymlx-community/LFM2.5-24B-A2B-OptiQ-4bit ↗Observed 19 Oct 2026MLX · Quant unknownSize unknownUnknownUnknown: completeness or a complete GGUF quant group was not verified.
4 files
Observed weight file metadata; completeness unavailable without index/config verification.

CURATED TRACKING

Known issues

No curated issues verified for this snapshot. An empty list does not mean there are no bugs.

HARDWARE NOTES

Tested on DGX Spark / Mac Studio: coming soon

No hardware benchmark measurements are available in this snapshot.