Can I run Qwen3-235B-A22B?
Qwen3-235B-A22B needs about 164.9 GB of memory at Q4_K_M, so it does not fit any single consumer GPU we track. The cheapest Mac or mini PC that holds it is the Mac Studio M5 Ultra 256GB (256 GB, $9499). 2 of the 82 devices we track run it fully at Q4. These are estimates, not measured benchmarks.
- Q4_K_M needs
- 164.9 GB 142.5 GB weights
- Q8_0 needs
- 288.3 GB 249.8 GB weights
- FP16 needs
- 541.7 GB 470.2 GB weights
2 of 82 tracked GPUs and Macs run it fully at Q4.
Memory by context length
Longer chats and documents need more memory for the KV cache. All 94 layers keep a full cache. Sizes assume an FP16 KV cache; a Q8 cache roughly halves the cache part.
| Context | KV cache (FP16) | Total at Q4_K_M | Total at Q8_0 |
|---|---|---|---|
| 4k tokens | 0.8 GB | 164.9 GB | 288.3 GB |
| 8k tokens | 1.6 GB | 165.7 GB | 289.0 GB |
| 16k tokens | 3.2 GB | 167.3 GB | 290.6 GB |
| 32k tokens | 6.3 GB | 170.4 GB | 293.8 GB |
| 64k tokens | 12.6 GB | 176.7 GB | 300.1 GB |
| 128k tokens | 25.2 GB | 189.3 GB | 312.7 GB |
Can I run Qwen3-235B on a specific GPU or Mac?
Direct yes-or-no checks for popular hardware, with the quant that fits and an estimated tokens/sec range.
- Can I run Qwen3-235B on a Mac Studio 256GB?Q4Fits
- Can I run Qwen3-235B on a Mac Studio 512GB?Q8Fits
- Can I run Qwen3-235B on dual RTX 3090s?Q4Won’t fit
- Can I run Qwen3-235B on an RTX 5090?Q4Won’t fit
- Can I run Qwen3-235B on an RTX 4090?Q4Won’t fit
- Can I run Qwen3-235B on a Mac mini 64GB?Q4Won’t fit
Which hardware runs it
| Hardware | Q4 need vs. usable | Q4 / Q8 / FP16 | Check price |
|---|---|---|---|
| GeForce RTX 3050 8GB8 GB usable | 164.9 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3060 12GB12 GB usable | 164.9 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3060 Ti8 GB usable | 164.9 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 30708 GB usable | 164.9 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3080 10GB10 GB usable | 164.9 / 10.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3080 Ti12 GB usable | 164.9 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 309024 GB usable | 164.9 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3090 Ti24 GB usable | 164.9 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 40608 GB usable | 164.9 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 4060 Ti 16GB16 GB usable | 164.9 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 407012 GB usable | 164.9 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 4070 Super12 GB usable | 164.9 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 4070 Ti Super16 GB usable | 164.9 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 4080 Super16 GB usable | 164.9 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 409024 GB usable | 164.9 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 507012 GB usable | 164.9 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 508016 GB usable | 164.9 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 509032 GB usable | 164.9 / 32.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 7600 XT16 GB usable | 164.9 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 7800 XT16 GB usable | 164.9 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 7900 XT20 GB usable | 164.9 / 20.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 7900 XTX24 GB usable | 164.9 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Intel Arc B58012 GB usable | 164.9 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Intel Arc Pro B70 32GB32 GB usable | 164.9 / 32.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac mini M4 16GB12 GB usable | 164.9 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac mini M6 16GB12 GB usable | 164.9 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac mini M6 24GB18 GB usable | 164.9 / 18.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac mini M6 32GB24 GB usable | 164.9 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac mini M5 Pro 64GB48 GB usable | 164.9 / 48.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| MacBook Pro M4 Max 128GB96 GB usable | 164.9 / 96.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| MacBook Pro M5 Max 128GB96 GB usable | 164.9 / 96.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| MacBook Pro M6 32GB24 GB usable | 164.9 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac Studio M5 Ultra 256GB192 GB usable | 164.9 / 192.0 GB | Q4FitsQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac Studio M5 Ultra 512GB384 GB usable | 164.9 / 384.0 GB | Q4FitsQ8FitsFP16Won’t fit | AmazoneBay |
| Framework Desktop (Ryzen AI Max+ 395) 128GB96 GB usable | 164.9 / 96.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA DGX Spark 64GB48 GB usable | 164.9 / 48.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA DGX Spark 128GB96 GB usable | 164.9 / 96.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 2060 6GB6 GB usable | 164.9 / 6.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 2060 12GB12 GB usable | 164.9 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 2060 Super8 GB usable | 164.9 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 20708 GB usable | 164.9 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 2070 Super8 GB usable | 164.9 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 20808 GB usable | 164.9 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 2080 Super8 GB usable | 164.9 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 2080 Ti11 GB usable | 164.9 / 11.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA Titan RTX24 GB usable | 164.9 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3070 Ti8 GB usable | 164.9 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3080 12GB12 GB usable | 164.9 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 4060 Ti 8GB8 GB usable | 164.9 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 4070 Ti12 GB usable | 164.9 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 408016 GB usable | 164.9 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 50608 GB usable | 164.9 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 5060 Ti 8GB8 GB usable | 164.9 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 5060 Ti 16GB16 GB usable | 164.9 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 5070 Ti16 GB usable | 164.9 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 6700 XT12 GB usable | 164.9 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 6750 XT12 GB usable | 164.9 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 680016 GB usable | 164.9 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 6800 XT16 GB usable | 164.9 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 6900 XT16 GB usable | 164.9 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 6950 XT16 GB usable | 164.9 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 76008 GB usable | 164.9 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 7700 XT12 GB usable | 164.9 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 7900 GRE16 GB usable | 164.9 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 9060 XT 8GB8 GB usable | 164.9 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 9060 XT 16GB16 GB usable | 164.9 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 907016 GB usable | 164.9 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 9070 XT16 GB usable | 164.9 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Intel Arc A7508 GB usable | 164.9 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Intel Arc A770 16GB16 GB usable | 164.9 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Intel Arc B57010 GB usable | 164.9 / 10.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX A400016 GB usable | 164.9 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX A500024 GB usable | 164.9 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX A600048 GB usable | 164.9 / 48.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX 2000 Ada 16GB16 GB usable | 164.9 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX 4000 Ada 20GB20 GB usable | 164.9 / 20.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX 6000 Ada 48GB48 GB usable | 164.9 / 48.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX Pro 6000 Blackwell 96GB96 GB usable | 164.9 / 96.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA Tesla P40 24GB24 GB usable | 164.9 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA Tesla V100 32GB (PCIe)32 GB usable | 164.9 / 32.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| AMD Radeon Instinct MI50 32GB32 GB usable | 164.9 / 32.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| AMD Radeon Instinct MI60 32GB32 GB usable | 164.9 / 32.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
We may earn a commission when you buy through these links, at no extra cost to you.
Quick answers
- How much VRAM does Qwen3-235B-A22B need?
- About 164.9 GB at Q4_K_M, 288.3 GB at Q8_0 and 541.7 GB at FP16. These are estimates: weights plus about 15% for the KV cache at a ~4k context, plus 1 GB for the runtime.
- What is the cheapest GPU that runs Qwen3-235B-A22B?
- None of the single consumer GPUs we track can hold it at Q4. You need a large unified-memory machine, several GPUs, or CPU offload (slow).
- Can a Mac or mini PC run Qwen3-235B-A22B?
- Yes. The cheapest Mac or unified-memory mini PC we track that runs it at Q4 is the Mac Studio M5 Ultra 256GB (256 GB, 192.0 GB usable for models, $9499).
- How much VRAM does Qwen3-235B-A22B need for 32k context?
- About 170.4 GB at Q4_K_M with an FP16 KV cache (6.3 GB of that is the cache), or 189.3 GB at 128k. Estimated from the model's published config.
- How many GPUs and Macs can run Qwen3-235B-A22B?
- 2 of the 82 GPUs and Macs we track run it fully at Q4.