Does It Run Local?

← All comparisons

MODEL COMPARISON

Llama-3.1-8B-Instruct vs Apertus-8B-Instruct-2509

Llama-3.1-8B-Instruct and Apertus-8B-Instruct-2509 need about the same memory (within 1 GB): about 8 GB and about 8 GB. Llama-3.1-8B-Instruct has one runtime in release (Ollama). Apertus-8B-Instruct-2509 has no runtime listed as in release.

SIDE BY SIDE

CompareLlama-3.1-8B-InstructApertus-8B-Instruct-2509
Memory neededabout 8 GB · Up to 8 GB (laptop)about 8 GB · Up to 8 GB (laptop)
Recommended quantQ4_K_M · 4.9 GBQ4_K_M · 5.1 GB
llama.cpp supportArchitecture listedChecked 24 Oct 2026Architecture listedChecked 24 Oct 2026
Ollama supportReleasedChecked 24 Oct 2026UnknownVersion v0.40.10 · Checked 24 Oct 2026
LM Studio supportUpload availableChecked 24 Oct 2026UnknownChecked 24 Oct 2026
MLX / mlx-lm supportUpload availableChecked 24 Oct 2026Upload availableChecked 24 Oct 2026
vLLM supportArchitecture listedChecked 24 Oct 2026Architecture listedChecked 24 Oct 2026
ReleasedJul 18, 2024Aug 13, 2025
LicenseNot recorded in this snapshot — see the model card ↗Not recorded in this snapshot — see the model card ↗
Publishermeta-llamaswiss-ai
Downloads4.9M420.7K
Model pageOpen Llama-3.1-8B-Instruct ↗Open Apertus-8B-Instruct-2509 ↗
Fits these setups
  • Mac 16 GBRuns well
  • Mac 24 GBRuns well
  • Mac 32 GBRuns well
  • Mac 64 GBRuns well
  • GPU 8 GB + 32 GB RAMRuns well
  • GPU 12 GB + 32 GB RAMRuns well
  • GPU 16 GB + 32 GB RAMRuns well
  • GPU 24 GB + 64 GB RAMRuns well
  • CPU 32 GBRuns well
  • CPU 64 GBRuns well
  • Mac 16 GBRuns well
  • Mac 24 GBRuns well
  • Mac 32 GBRuns well
  • Mac 64 GBRuns well
  • GPU 8 GB + 32 GB RAMRuns well
  • GPU 12 GB + 32 GB RAMRuns well
  • GPU 16 GB + 32 GB RAMRuns well
  • GPU 24 GB + 64 GB RAMRuns well
  • CPU 32 GBRuns well
  • CPU 64 GBRuns well

Memory needed is the same estimate shown on each model page: the recommended observed file plus 20% headroom and a 1.5 GB runtime allowance. See which setups fit →

These are estimates from observed file sizes, not benchmarks. They don’t account for long contexts or the KV cache, and fitting does not establish runtime compatibility or speed.