The summary estimate of about 487 GB is the recommended Q4_K_M quant (404.4 GB observed), from file size × 1.2 + 1.5 GB. Each card is the largest observed quant whose estimate fits that capacity.
16 GB capacity estimate
Which file should I grab?
doesn't fitNo observed complete quant fits this capacity using file size × 1.2 + 1.5 GB.
24 GB capacity estimate
Which file should I grab?
doesn't fitNo observed complete quant fits this capacity using file size × 1.2 + 1.5 GB.
32 GB capacity estimate
Which file should I grab?
doesn't fitNo observed complete quant fits this capacity using file size × 1.2 + 1.5 GB.
64 GB capacity estimate
Which file should I grab?
doesn't fitNo observed complete quant fits this capacity using file size × 1.2 + 1.5 GB.
128 GB capacity estimate
Which file should I grab?
doesn't fitNo observed complete quant fits this capacity using file size × 1.2 + 1.5 GB.
192 GB capacity estimate
Which file should I grab?
doesn't fitNo observed complete quant fits this capacity using file size × 1.2 + 1.5 GB.
256 GB capacity estimate
Which file should I grab?
doesn't fitNo observed complete quant fits this capacity using file size × 1.2 + 1.5 GB.
512 GB capacity estimate
Which file should I grab?
Q4_K_M · 404.4 GB observed · about 487 GB ↗About 487 GB using file size × 1.2 + 1.5 GB. Fit is an estimate; compatibility, speed, context length and hardware have not been tested. Link points to shard 1; all 9 linked shards are required.
Memory estimates are the observed file size plus fixed headroom (20% plus 1.5 GB runtime allowance); real needs also depend on context length, KV cache and runtime settings. Fit is an estimate; it does not establish runtime compatibility, speed, context length, or hardware performance. Text-weights-only estimates do not include a projector or total vision memory where unknown.