Can I run DeepSeek-V3-0324?
DeepSeek-V3-0324 needs about 478.2 GB of memory at Q4_K_M, so it does not fit any single consumer GPU we track. 0 of the 82 devices we track run it fully at Q4. These are estimates, not measured benchmarks.
- Q4_K_M needs
- 478.2 GB 415.0 GB weights
- Q8_0 needs
- 837.4 GB 727.3 GB weights
- FP16 needs
- 1575.4 GB 1369.1 GB weights
0 of 82 tracked GPUs and Macs run it fully at Q4.
Which hardware runs it
Bar: Q4 memory needed vs. usable memory. The tick marks 90%, our comfort line.FitsTightWon’t fit
| Hardware | Q4 need vs. usable | Q4 / Q8 / FP16 | Check price |
|---|---|---|---|
| GeForce RTX 3050 8GB8 GB usable | 478.2 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3060 12GB12 GB usable | 478.2 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3060 Ti8 GB usable | 478.2 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 30708 GB usable | 478.2 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3080 10GB10 GB usable | 478.2 / 10.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3080 Ti12 GB usable | 478.2 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 309024 GB usable | 478.2 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3090 Ti24 GB usable | 478.2 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 40608 GB usable | 478.2 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 4060 Ti 16GB16 GB usable | 478.2 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 407012 GB usable | 478.2 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 4070 Super12 GB usable | 478.2 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 4070 Ti Super16 GB usable | 478.2 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 4080 Super16 GB usable | 478.2 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 409024 GB usable | 478.2 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 507012 GB usable | 478.2 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 508016 GB usable | 478.2 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 509032 GB usable | 478.2 / 32.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 7600 XT16 GB usable | 478.2 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 7800 XT16 GB usable | 478.2 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 7900 XT20 GB usable | 478.2 / 20.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 7900 XTX24 GB usable | 478.2 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Intel Arc B58012 GB usable | 478.2 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Intel Arc Pro B70 32GB32 GB usable | 478.2 / 32.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac mini M4 16GB12 GB usable | 478.2 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac mini M6 16GB12 GB usable | 478.2 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac mini M6 24GB18 GB usable | 478.2 / 18.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac mini M6 32GB24 GB usable | 478.2 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac mini M5 Pro 64GB48 GB usable | 478.2 / 48.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| MacBook Pro M4 Max 128GB96 GB usable | 478.2 / 96.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| MacBook Pro M5 Max 128GB96 GB usable | 478.2 / 96.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| MacBook Pro M6 32GB24 GB usable | 478.2 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac Studio M5 Ultra 256GB192 GB usable | 478.2 / 192.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac Studio M5 Ultra 512GB384 GB usable | 478.2 / 384.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Framework Desktop (Ryzen AI Max+ 395) 128GB96 GB usable | 478.2 / 96.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA DGX Spark 64GB48 GB usable | 478.2 / 48.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA DGX Spark 128GB96 GB usable | 478.2 / 96.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 2060 6GB6 GB usable | 478.2 / 6.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 2060 12GB12 GB usable | 478.2 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 2060 Super8 GB usable | 478.2 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 20708 GB usable | 478.2 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 2070 Super8 GB usable | 478.2 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 20808 GB usable | 478.2 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 2080 Super8 GB usable | 478.2 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 2080 Ti11 GB usable | 478.2 / 11.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA Titan RTX24 GB usable | 478.2 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3070 Ti8 GB usable | 478.2 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3080 12GB12 GB usable | 478.2 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 4060 Ti 8GB8 GB usable | 478.2 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 4070 Ti12 GB usable | 478.2 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 408016 GB usable | 478.2 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 50608 GB usable | 478.2 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 5060 Ti 8GB8 GB usable | 478.2 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 5060 Ti 16GB16 GB usable | 478.2 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 5070 Ti16 GB usable | 478.2 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 6700 XT12 GB usable | 478.2 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 6750 XT12 GB usable | 478.2 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 680016 GB usable | 478.2 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 6800 XT16 GB usable | 478.2 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 6900 XT16 GB usable | 478.2 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 6950 XT16 GB usable | 478.2 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 76008 GB usable | 478.2 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 7700 XT12 GB usable | 478.2 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 7900 GRE16 GB usable | 478.2 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 9060 XT 8GB8 GB usable | 478.2 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 9060 XT 16GB16 GB usable | 478.2 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 907016 GB usable | 478.2 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 9070 XT16 GB usable | 478.2 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Intel Arc A7508 GB usable | 478.2 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Intel Arc A770 16GB16 GB usable | 478.2 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Intel Arc B57010 GB usable | 478.2 / 10.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX A400016 GB usable | 478.2 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX A500024 GB usable | 478.2 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX A600048 GB usable | 478.2 / 48.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX 2000 Ada 16GB16 GB usable | 478.2 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX 4000 Ada 20GB20 GB usable | 478.2 / 20.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX 6000 Ada 48GB48 GB usable | 478.2 / 48.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX Pro 6000 Blackwell 96GB96 GB usable | 478.2 / 96.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA Tesla P40 24GB24 GB usable | 478.2 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA Tesla V100 32GB (PCIe)32 GB usable | 478.2 / 32.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| AMD Radeon Instinct MI50 32GB32 GB usable | 478.2 / 32.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| AMD Radeon Instinct MI60 32GB32 GB usable | 478.2 / 32.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
We may earn a commission when you buy through these links, at no extra cost to you.
Quick answers
- How much VRAM does DeepSeek-V3-0324 need?
- About 478.2 GB at Q4_K_M, 837.4 GB at Q8_0 and 1575.4 GB at FP16. These are estimates: weights plus about 15% for the KV cache at a ~4k context, plus 1 GB for the runtime.
- What is the cheapest GPU that runs DeepSeek-V3-0324?
- None of the single consumer GPUs we track can hold it at Q4. You need a large unified-memory machine, several GPUs, or CPU offload (slow).
- How many GPUs and Macs can run DeepSeek-V3-0324?
- 0 of the 82 GPUs and Macs we track run it fully at Q4.