Can I run MiMo-V2.6-Pro-MOPD?
MiMo-V2.6-Pro-MOPD needs about 715.1 GB of memory at Q4_K_M, so it does not fit any single consumer GPU we track. 0 of the 82 devices we track run it fully at Q4. These are estimates, not measured benchmarks.
- Q4_K_M needs
- 715.1 GB 620.9 GB weights
- Q8_0 needs
- 1252.5 GB 1088.2 GB weights
- FP16 needs
- 2356.7 GB 2048.4 GB weights
0 of 82 tracked GPUs and Macs run it fully at Q4.
Memory by context length
Longer chats and documents need more memory for the KV cache. All 70 layers keep a full cache. Sizes assume an FP16 KV cache; a Q8 cache roughly halves the cache part.
| Context | KV cache (FP16) | Total at Q4_K_M | Total at Q8_0 |
|---|---|---|---|
| 4k tokens | 1.8 GB | 715.1 GB | 1252.5 GB |
| 8k tokens | 3.5 GB | 716.8 GB | 1254.2 GB |
| 16k tokens | 7.0 GB | 720.4 GB | 1257.7 GB |
| 32k tokens | 14.1 GB | 727.4 GB | 1264.8 GB |
| 64k tokens | 28.2 GB | 741.5 GB | 1278.9 GB |
| 128k tokens | 56.4 GB | 769.7 GB | 1307.1 GB |
Which hardware runs it
Bar: Q4 memory needed vs. usable memory. The tick marks 90%, our comfort line.FitsTightWon’t fit
| Hardware | Q4 need vs. usable | Q4 / Q8 / FP16 | Check price |
|---|---|---|---|
| GeForce RTX 3050 8GB8 GB usable | 715.1 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3060 12GB12 GB usable | 715.1 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3060 Ti8 GB usable | 715.1 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 30708 GB usable | 715.1 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3080 10GB10 GB usable | 715.1 / 10.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3080 Ti12 GB usable | 715.1 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 309024 GB usable | 715.1 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3090 Ti24 GB usable | 715.1 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 40608 GB usable | 715.1 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 4060 Ti 16GB16 GB usable | 715.1 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 407012 GB usable | 715.1 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 4070 Super12 GB usable | 715.1 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 4070 Ti Super16 GB usable | 715.1 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 4080 Super16 GB usable | 715.1 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 409024 GB usable | 715.1 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 507012 GB usable | 715.1 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 508016 GB usable | 715.1 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 509032 GB usable | 715.1 / 32.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 7600 XT16 GB usable | 715.1 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 7800 XT16 GB usable | 715.1 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 7900 XT20 GB usable | 715.1 / 20.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 7900 XTX24 GB usable | 715.1 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Intel Arc B58012 GB usable | 715.1 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Intel Arc Pro B70 32GB32 GB usable | 715.1 / 32.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac mini M4 16GB12 GB usable | 715.1 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac mini M6 16GB12 GB usable | 715.1 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac mini M6 24GB18 GB usable | 715.1 / 18.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac mini M6 32GB24 GB usable | 715.1 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac mini M5 Pro 64GB48 GB usable | 715.1 / 48.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| MacBook Pro M4 Max 128GB96 GB usable | 715.1 / 96.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| MacBook Pro M5 Max 128GB96 GB usable | 715.1 / 96.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| MacBook Pro M6 32GB24 GB usable | 715.1 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac Studio M5 Ultra 256GB192 GB usable | 715.1 / 192.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac Studio M5 Ultra 512GB384 GB usable | 715.1 / 384.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Framework Desktop (Ryzen AI Max+ 395) 128GB96 GB usable | 715.1 / 96.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA DGX Spark 64GB48 GB usable | 715.1 / 48.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA DGX Spark 128GB96 GB usable | 715.1 / 96.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 2060 6GB6 GB usable | 715.1 / 6.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 2060 12GB12 GB usable | 715.1 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 2060 Super8 GB usable | 715.1 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 20708 GB usable | 715.1 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 2070 Super8 GB usable | 715.1 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 20808 GB usable | 715.1 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 2080 Super8 GB usable | 715.1 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 2080 Ti11 GB usable | 715.1 / 11.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA Titan RTX24 GB usable | 715.1 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3070 Ti8 GB usable | 715.1 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3080 12GB12 GB usable | 715.1 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 4060 Ti 8GB8 GB usable | 715.1 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 4070 Ti12 GB usable | 715.1 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 408016 GB usable | 715.1 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 50608 GB usable | 715.1 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 5060 Ti 8GB8 GB usable | 715.1 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 5060 Ti 16GB16 GB usable | 715.1 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 5070 Ti16 GB usable | 715.1 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 6700 XT12 GB usable | 715.1 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 6750 XT12 GB usable | 715.1 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 680016 GB usable | 715.1 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 6800 XT16 GB usable | 715.1 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 6900 XT16 GB usable | 715.1 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 6950 XT16 GB usable | 715.1 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 76008 GB usable | 715.1 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 7700 XT12 GB usable | 715.1 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 7900 GRE16 GB usable | 715.1 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 9060 XT 8GB8 GB usable | 715.1 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 9060 XT 16GB16 GB usable | 715.1 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 907016 GB usable | 715.1 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 9070 XT16 GB usable | 715.1 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Intel Arc A7508 GB usable | 715.1 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Intel Arc A770 16GB16 GB usable | 715.1 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Intel Arc B57010 GB usable | 715.1 / 10.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX A400016 GB usable | 715.1 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX A500024 GB usable | 715.1 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX A600048 GB usable | 715.1 / 48.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX 2000 Ada 16GB16 GB usable | 715.1 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX 4000 Ada 20GB20 GB usable | 715.1 / 20.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX 6000 Ada 48GB48 GB usable | 715.1 / 48.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX Pro 6000 Blackwell 96GB96 GB usable | 715.1 / 96.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA Tesla P40 24GB24 GB usable | 715.1 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA Tesla V100 32GB (PCIe)32 GB usable | 715.1 / 32.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| AMD Radeon Instinct MI50 32GB32 GB usable | 715.1 / 32.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| AMD Radeon Instinct MI60 32GB32 GB usable | 715.1 / 32.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
We may earn a commission when you buy through these links, at no extra cost to you.
Quick answers
- How much VRAM does MiMo-V2.6-Pro-MOPD need?
- About 715.1 GB at Q4_K_M, 1252.5 GB at Q8_0 and 2356.7 GB at FP16. These are estimates: weights plus about 15% for the KV cache at a ~4k context, plus 1 GB for the runtime.
- What is the cheapest GPU that runs MiMo-V2.6-Pro-MOPD?
- None of the single consumer GPUs we track can hold it at Q4. You need a large unified-memory machine, several GPUs, or CPU offload (slow).
- How much VRAM does MiMo-V2.6-Pro-MOPD need for 32k context?
- About 727.4 GB at Q4_K_M with an FP16 KV cache (14.1 GB of that is the cache), or 769.7 GB at 128k. Estimated from the model's published config.
- How many GPUs and Macs can run MiMo-V2.6-Pro-MOPD?
- 0 of the 82 GPUs and Macs we track run it fully at Q4.