Can I run command-a-plus-05-2026-bf16?

command-a-plus-05-2026-bf16 needs about 153.5 GB of memory at Q4_K_M, so it does not fit any single consumer GPU we track. The cheapest Mac or mini PC that holds it is the Mac Studio M5 Ultra 256GB (256 GB, $9499). 2 of the 82 devices we track run it fully at Q4. These are estimates, not measured benchmarks.

218.8B parameters, by CohereLabs. License: apache-2.0. Model card (params from HF API, retrieved 2026-11-04) · How much VRAM for 200B–300B models · Q4 vs Q8 vs FP16 · MoE: 25.0B active per token

Q4_K_M needs

153.5 GB 132.6 GB weights

Q8_0 needs

268.3 GB 232.4 GB weights

FP16 needs

504.1 GB 437.5 GB weights

2 of 82 tracked GPUs and Macs run it fully at Q4.

Memory by context length

Longer chats and documents need more memory for the KV cache. Only 8 of its 32 layers keep a cache that grows with context (24 use a 4096-token sliding window), so it stays lean at long contexts. Sizes assume an FP16 KV cache; a Q8 cache roughly halves the cache part.

From the model's config.json (8 full-attention layers × 8 KV heads × 128 head size, retrieved 2026-11-04). Check the model card for its maximum supported context. Try other sizes in the VRAM calculator or compare models in our context length guide.

Which hardware runs it

We may earn a commission when you buy through these links, at no extra cost to you.