# Can I run Qwen3-32B locally? | What Can I Run AI? > Qwen3-32B needs about 23.8 GB VRAM at Q4. Cheapest GPU we track that holds it: Intel Arc Pro B70 32GB. See which GPUs and Macs can run it. Source: https://whatcanirunai.vercel.app/models/qwen3-32b/ # Can I run Qwen3-32B? Qwen3-32B needs about 23.8 GB of memory at Q4\_K\_M, and the cheapest GPU we track that holds it is the Intel Arc Pro B70 32GB (32 GB, $949 list price). 16 of the 82 devices we track run it fully at Q4\. These are estimates, not measured benchmarks. 32.8B parameters, by Qwen. License: apache-2.0\. [Model card](https://huggingface.co/Qwen/Qwen3-32B) (params from HF API, retrieved 2026-10-19) · [How much VRAM for 30B–32B models](https://whatcanirunai.vercel.app/how-much-vram/32b/) · [Best GPU for Qwen3](https://whatcanirunai.vercel.app/best-gpu-for/qwen3/) · [Tokens per second by device](https://whatcanirunai.vercel.app/tokens-per-second/#qwen3-32b) · [Ollama VRAM (qwen3:32b)](https://whatcanirunai.vercel.app/ollama-vram-requirements/) · [GGUF sizes Q3–Q8 (llama.cpp)](https://whatcanirunai.vercel.app/gguf-vram-requirements/#qwen3-32b) · [Q4 vs Q8 vs FP16](https://whatcanirunai.vercel.app/quantization/) Q4\_K\_M needs 23.8 GB 19.9 GB weights Q8\_0 needs 41.0 GB 34.8 GB weights FP16 needs 76.4 GB 65.5 GB weights **16 of 82** tracked GPUs and Macs run it fully at Q4. ## Memory by context length Longer chats and documents need more memory for the KV cache. All 64 layers keep a full cache. Sizes assume an FP16 KV cache; a Q8 cache roughly halves the cache part. __Memory needed for Qwen3-32B by context length__ | Context | KV cache (FP16) | Total at Q4\_K\_M | Total at Q8\_0 | | ----------- | --------------- | ----------------- | -------------- | | 4k tokens | 1.1 GB | 23.8 GB | 41.0 GB | | 8k tokens | 2.1 GB | 24.9 GB | 42.1 GB | | 16k tokens | 4.3 GB | 27.1 GB | 44.3 GB | | 32k tokens | 8.6 GB | 31.4 GB | 48.5 GB | | 64k tokens | 17.2 GB | 39.9 GB | 57.1 GB | | 128k tokens | 34.4 GB | 57.1 GB | 74.3 GB | From the model's [config.json](https://huggingface.co/Qwen/Qwen3-32B/blob/main/config.json) (64 full-attention layers × 8 KV heads × 128 head size, retrieved 2026-10-25). Check the model card for its maximum supported context. Try other sizes in the [VRAM calculator](https://whatcanirunai.vercel.app/vram-calculator/?ctx=32768) or compare models in our [context length guide](https://whatcanirunai.vercel.app/context-length/). Compare: [Qwen3.8-27B vs Qwen3-32B](https://whatcanirunai.vercel.app/compare/qwen3.8-27b-vs-qwen3-32b/) · [DeepSeek-R1-Distill-Qwen-32B vs Qwen3-32B](https://whatcanirunai.vercel.app/compare/deepseek-r1-distill-qwen-32b-vs-qwen3-32b/) ## Can I run Qwen3-32B on a specific GPU or Mac? Direct yes-or-no checks for popular hardware, with the quant that fits and an estimated tokens/sec range. * [Can I run Qwen3-32B on an RTX 3060 12GB?](https://whatcanirunai.vercel.app/can-i-run/qwen3-32b/rtx-3060-12gb/)Q4Won’t fit * [Can I run Qwen3-32B on an RTX 3070 Ti?](https://whatcanirunai.vercel.app/can-i-run/qwen3-32b/rtx-3070-ti/)Q4Won’t fit * [Can I run Qwen3-32B on an RTX 3080?](https://whatcanirunai.vercel.app/can-i-run/qwen3-32b/rtx-3080-10gb/)Q4Won’t fit * [Can I run Qwen3-32B on an RTX 3090?](https://whatcanirunai.vercel.app/can-i-run/qwen3-32b/rtx-3090/)Q4Tight * [Can I run Qwen3-32B on an RTX 4060 Ti 16GB?](https://whatcanirunai.vercel.app/can-i-run/qwen3-32b/rtx-4060-ti-16gb/)Q4Won’t fit * [Can I run Qwen3-32B on an RTX 4070 Ti Super?](https://whatcanirunai.vercel.app/can-i-run/qwen3-32b/rtx-4070-ti-super/)Q4Won’t fit * [Can I run Qwen3-32B on an RTX 4090?](https://whatcanirunai.vercel.app/can-i-run/qwen3-32b/rtx-4090/)Q4Tight * [Can I run Qwen3-32B on an RTX 5070 Ti?](https://whatcanirunai.vercel.app/can-i-run/qwen3-32b/rtx-5070-ti/)Q4Won’t fit * [Can I run Qwen3-32B on an RTX 5080?](https://whatcanirunai.vercel.app/can-i-run/qwen3-32b/rtx-5080/)Q4Won’t fit * [Can I run Qwen3-32B on an RTX 5090?](https://whatcanirunai.vercel.app/can-i-run/qwen3-32b/rtx-5090/)Q4Fits * [Can I run Qwen3-32B on an RX 7900 XTX?](https://whatcanirunai.vercel.app/can-i-run/qwen3-32b/rx-7900-xtx/)Q4Tight * [Can I run Qwen3-32B on an Arc B580?](https://whatcanirunai.vercel.app/can-i-run/qwen3-32b/arc-b580/)Q4Won’t fit * [Can I run Qwen3-32B on a Mac mini 16GB?](https://whatcanirunai.vercel.app/can-i-run/qwen3-32b/mac-mini-m6-16/)Q4Won’t fit * [Can I run Qwen3-32B on a Mac mini 24GB?](https://whatcanirunai.vercel.app/can-i-run/qwen3-32b/mac-mini-m6-24/)Q4Won’t fit * [Can I run Qwen3-32B on a Mac mini 32GB?](https://whatcanirunai.vercel.app/can-i-run/qwen3-32b/mac-mini-m6-32/)Q4Tight ## Which hardware runs it Bar: Q4 memory needed vs. usable memory. The tick marks 90%, our comfort line.FitsTightWon’t fit | Hardware | Q4 need vs. usable | Q4 / Q8 / FP16 | Check price | | ------------------------------------------------------------------------------------------- | ------------------- | ----------------------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | [GeForce RTX 3050 8GB](https://whatcanirunai.vercel.app/hardware/rtx-3050-8gb/)8 GB usable | **23.8** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203050%208GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203050%208GB) | | [GeForce RTX 3060 12GB](https://whatcanirunai.vercel.app/hardware/rtx-3060-12gb/)12 GB usable | **23.8** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203060%2012GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203060%2012GB) | | [GeForce RTX 3060 Ti](https://whatcanirunai.vercel.app/hardware/rtx-3060-ti/)8 GB usable | **23.8** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203060%20Ti&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203060%20Ti) | | [GeForce RTX 3070](https://whatcanirunai.vercel.app/hardware/rtx-3070/)8 GB usable | **23.8** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203070&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203070) | | [GeForce RTX 3080 10GB](https://whatcanirunai.vercel.app/hardware/rtx-3080-10gb/)10 GB usable | **23.8** / 10.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203080%2010GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203080%2010GB) | | [GeForce RTX 3080 Ti](https://whatcanirunai.vercel.app/hardware/rtx-3080-ti/)12 GB usable | **23.8** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203080%20Ti&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203080%20Ti) | | [GeForce RTX 3090](https://whatcanirunai.vercel.app/hardware/rtx-3090/)24 GB usable | **23.8** / 24.0 GB | Q4TightQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203090&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203090) | | [GeForce RTX 3090 Ti](https://whatcanirunai.vercel.app/hardware/rtx-3090-ti/)24 GB usable | **23.8** / 24.0 GB | Q4TightQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203090%20Ti&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203090%20Ti) | | [GeForce RTX 4060](https://whatcanirunai.vercel.app/hardware/rtx-4060/)8 GB usable | **23.8** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204060&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204060) | | [GeForce RTX 4060 Ti 16GB](https://whatcanirunai.vercel.app/hardware/rtx-4060-ti-16gb/)16 GB usable | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204060%20Ti%2016GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204060%20Ti%2016GB) | | [GeForce RTX 4070](https://whatcanirunai.vercel.app/hardware/rtx-4070/)12 GB usable | **23.8** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204070&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204070) | | [GeForce RTX 4070 Super](https://whatcanirunai.vercel.app/hardware/rtx-4070-super/)12 GB usable | **23.8** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204070%20Super&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204070%20Super) | | [GeForce RTX 4070 Ti Super](https://whatcanirunai.vercel.app/hardware/rtx-4070-ti-super/)16 GB usable | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204070%20Ti%20Super&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204070%20Ti%20Super) | | [GeForce RTX 4080 Super](https://whatcanirunai.vercel.app/hardware/rtx-4080-super/)16 GB usable | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204080%20Super&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204080%20Super) | | [GeForce RTX 4090](https://whatcanirunai.vercel.app/hardware/rtx-4090/)24 GB usable | **23.8** / 24.0 GB | Q4TightQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204090&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204090) | | [GeForce RTX 5070](https://whatcanirunai.vercel.app/hardware/rtx-5070/)12 GB usable | **23.8** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%205070&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%205070) | | [GeForce RTX 5080](https://whatcanirunai.vercel.app/hardware/rtx-5080/)16 GB usable | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%205080&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%205080) | | [GeForce RTX 5090](https://whatcanirunai.vercel.app/hardware/rtx-5090/)32 GB usable | **23.8** / 32.0 GB | Q4FitsQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%205090&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%205090) | | [Radeon RX 7600 XT](https://whatcanirunai.vercel.app/hardware/rx-7600-xt/)16 GB usable | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%207600%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%207600%20XT) | | [Radeon RX 7800 XT](https://whatcanirunai.vercel.app/hardware/rx-7800-xt/)16 GB usable | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%207800%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%207800%20XT) | | [Radeon RX 7900 XT](https://whatcanirunai.vercel.app/hardware/rx-7900-xt/)20 GB usable | **23.8** / 20.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%207900%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%207900%20XT) | | [Radeon RX 7900 XTX](https://whatcanirunai.vercel.app/hardware/rx-7900-xtx/)24 GB usable | **23.8** / 24.0 GB | Q4TightQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%207900%20XTX&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%207900%20XTX) | | [Intel Arc B580](https://whatcanirunai.vercel.app/hardware/arc-b580/)12 GB usable | **23.8** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Intel%20Arc%20B580&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Intel%20Arc%20B580) | | [Intel Arc Pro B70 32GB](https://whatcanirunai.vercel.app/hardware/arc-pro-b70/)32 GB usable | **23.8** / 32.0 GB | Q4FitsQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Intel%20Arc%20Pro%20B70%2032GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Intel%20Arc%20Pro%20B70%2032GB) | | [Mac mini M4 16GB](https://whatcanirunai.vercel.app/hardware/mac-mini-m4-16/)12 GB usable | **23.8** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Mac%20mini%20M4%2016GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Mac%20mini%20M4%2016GB) | | [Mac mini M6 16GB](https://whatcanirunai.vercel.app/hardware/mac-mini-m6-16/)12 GB usable | **23.8** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Mac%20mini%20M6%2016GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Mac%20mini%20M6%2016GB) | | [Mac mini M6 24GB](https://whatcanirunai.vercel.app/hardware/mac-mini-m6-24/)18 GB usable | **23.8** / 18.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Mac%20mini%20M6%2024GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Mac%20mini%20M6%2024GB) | | [Mac mini M6 32GB](https://whatcanirunai.vercel.app/hardware/mac-mini-m6-32/)24 GB usable | **23.8** / 24.0 GB | Q4TightQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Mac%20mini%20M6%2032GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Mac%20mini%20M6%2032GB) | | [Mac mini M5 Pro 64GB](https://whatcanirunai.vercel.app/hardware/mac-mini-m5-pro-64/)48 GB usable | **23.8** / 48.0 GB | Q4FitsQ8FitsFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Mac%20mini%20M5%20Pro%2064GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Mac%20mini%20M5%20Pro%2064GB) | | [MacBook Pro M4 Max 128GB](https://whatcanirunai.vercel.app/hardware/macbook-pro-m4-max-128/)96 GB usable | **23.8** / 96.0 GB | Q4FitsQ8FitsFP16Fits | [Amazon](https://www.amazon.com/s?k=MacBook%20Pro%20M4%20Max%20128GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=MacBook%20Pro%20M4%20Max%20128GB) | | [MacBook Pro M5 Max 128GB](https://whatcanirunai.vercel.app/hardware/macbook-pro-m5-max-128/)96 GB usable | **23.8** / 96.0 GB | Q4FitsQ8FitsFP16Fits | [Amazon](https://www.amazon.com/s?k=MacBook%20Pro%20M5%20Max%20128GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=MacBook%20Pro%20M5%20Max%20128GB) | | [MacBook Pro M6 32GB](https://whatcanirunai.vercel.app/hardware/macbook-pro-m6-32/)24 GB usable | **23.8** / 24.0 GB | Q4TightQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=MacBook%20Pro%20M6%2032GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=MacBook%20Pro%20M6%2032GB) | | [Mac Studio M5 Ultra 256GB](https://whatcanirunai.vercel.app/hardware/mac-studio-m5-ultra-256/)192 GB usable | **23.8** / 192.0 GB | Q4FitsQ8FitsFP16Fits | [Amazon](https://www.amazon.com/s?k=Mac%20Studio%20M5%20Ultra%20256GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Mac%20Studio%20M5%20Ultra%20256GB) | | [Mac Studio M5 Ultra 512GB](https://whatcanirunai.vercel.app/hardware/mac-studio-m5-ultra-512/)384 GB usable | **23.8** / 384.0 GB | Q4FitsQ8FitsFP16Fits | [Amazon](https://www.amazon.com/s?k=Mac%20Studio%20M5%20Ultra%20512GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Mac%20Studio%20M5%20Ultra%20512GB) | | [Framework Desktop (Ryzen AI Max+ 395) 128GB](https://whatcanirunai.vercel.app/hardware/framework-desktop-128/)96 GB usable | **23.8** / 96.0 GB | Q4FitsQ8FitsFP16Fits | [Amazon](https://www.amazon.com/s?k=Framework%20Desktop%20%28Ryzen%20AI%20Max%2B%20395%29%20128GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Framework%20Desktop%20%28Ryzen%20AI%20Max%2B%20395%29%20128GB) | | [NVIDIA DGX Spark 64GB](https://whatcanirunai.vercel.app/hardware/dgx-spark-64/)48 GB usable | **23.8** / 48.0 GB | Q4FitsQ8FitsFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20DGX%20Spark%2064GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20DGX%20Spark%2064GB) | | [NVIDIA DGX Spark 128GB](https://whatcanirunai.vercel.app/hardware/dgx-spark-128/)96 GB usable | **23.8** / 96.0 GB | Q4FitsQ8FitsFP16Fits | [Amazon](https://www.amazon.com/s?k=NVIDIA%20DGX%20Spark%20128GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20DGX%20Spark%20128GB) | | [GeForce RTX 2060 6GB](https://whatcanirunai.vercel.app/hardware/rtx-2060/)6 GB usable | **23.8** / 6.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%202060%206GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%202060%206GB) | | [GeForce RTX 2060 12GB](https://whatcanirunai.vercel.app/hardware/rtx-2060-12gb/)12 GB usable | **23.8** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%202060%2012GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%202060%2012GB) | | [GeForce RTX 2060 Super](https://whatcanirunai.vercel.app/hardware/rtx-2060-super/)8 GB usable | **23.8** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%202060%20Super&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%202060%20Super) | | [GeForce RTX 2070](https://whatcanirunai.vercel.app/hardware/rtx-2070/)8 GB usable | **23.8** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%202070&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%202070) | | [GeForce RTX 2070 Super](https://whatcanirunai.vercel.app/hardware/rtx-2070-super/)8 GB usable | **23.8** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%202070%20Super&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%202070%20Super) | | [GeForce RTX 2080](https://whatcanirunai.vercel.app/hardware/rtx-2080/)8 GB usable | **23.8** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%202080&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%202080) | | [GeForce RTX 2080 Super](https://whatcanirunai.vercel.app/hardware/rtx-2080-super/)8 GB usable | **23.8** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%202080%20Super&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%202080%20Super) | | [GeForce RTX 2080 Ti](https://whatcanirunai.vercel.app/hardware/rtx-2080-ti/)11 GB usable | **23.8** / 11.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%202080%20Ti&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%202080%20Ti) | | [NVIDIA Titan RTX](https://whatcanirunai.vercel.app/hardware/titan-rtx/)24 GB usable | **23.8** / 24.0 GB | Q4TightQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20Titan%20RTX&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20Titan%20RTX) | | [GeForce RTX 3070 Ti](https://whatcanirunai.vercel.app/hardware/rtx-3070-ti/)8 GB usable | **23.8** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203070%20Ti&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203070%20Ti) | | [GeForce RTX 3080 12GB](https://whatcanirunai.vercel.app/hardware/rtx-3080-12gb/)12 GB usable | **23.8** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203080%2012GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203080%2012GB) | | [GeForce RTX 4060 Ti 8GB](https://whatcanirunai.vercel.app/hardware/rtx-4060-ti-8gb/)8 GB usable | **23.8** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204060%20Ti%208GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204060%20Ti%208GB) | | [GeForce RTX 4070 Ti](https://whatcanirunai.vercel.app/hardware/rtx-4070-ti/)12 GB usable | **23.8** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204070%20Ti&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204070%20Ti) | | [GeForce RTX 4080](https://whatcanirunai.vercel.app/hardware/rtx-4080/)16 GB usable | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204080&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204080) | | [GeForce RTX 5060](https://whatcanirunai.vercel.app/hardware/rtx-5060/)8 GB usable | **23.8** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%205060&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%205060) | | [GeForce RTX 5060 Ti 8GB](https://whatcanirunai.vercel.app/hardware/rtx-5060-ti-8gb/)8 GB usable | **23.8** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%205060%20Ti%208GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%205060%20Ti%208GB) | | [GeForce RTX 5060 Ti 16GB](https://whatcanirunai.vercel.app/hardware/rtx-5060-ti-16gb/)16 GB usable | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%205060%20Ti%2016GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%205060%20Ti%2016GB) | | [GeForce RTX 5070 Ti](https://whatcanirunai.vercel.app/hardware/rtx-5070-ti/)16 GB usable | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%205070%20Ti&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%205070%20Ti) | | [Radeon RX 6700 XT](https://whatcanirunai.vercel.app/hardware/rx-6700-xt/)12 GB usable | **23.8** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%206700%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%206700%20XT) | | [Radeon RX 6750 XT](https://whatcanirunai.vercel.app/hardware/rx-6750-xt/)12 GB usable | **23.8** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%206750%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%206750%20XT) | | [Radeon RX 6800](https://whatcanirunai.vercel.app/hardware/rx-6800/)16 GB usable | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%206800&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%206800) | | [Radeon RX 6800 XT](https://whatcanirunai.vercel.app/hardware/rx-6800-xt/)16 GB usable | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%206800%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%206800%20XT) | | [Radeon RX 6900 XT](https://whatcanirunai.vercel.app/hardware/rx-6900-xt/)16 GB usable | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%206900%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%206900%20XT) | | [Radeon RX 6950 XT](https://whatcanirunai.vercel.app/hardware/rx-6950-xt/)16 GB usable | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%206950%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%206950%20XT) | | [Radeon RX 7600](https://whatcanirunai.vercel.app/hardware/rx-7600/)8 GB usable | **23.8** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%207600&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%207600) | | [Radeon RX 7700 XT](https://whatcanirunai.vercel.app/hardware/rx-7700-xt/)12 GB usable | **23.8** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%207700%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%207700%20XT) | | [Radeon RX 7900 GRE](https://whatcanirunai.vercel.app/hardware/rx-7900-gre/)16 GB usable | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%207900%20GRE&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%207900%20GRE) | | [Radeon RX 9060 XT 8GB](https://whatcanirunai.vercel.app/hardware/rx-9060-xt-8gb/)8 GB usable | **23.8** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%209060%20XT%208GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%209060%20XT%208GB) | | [Radeon RX 9060 XT 16GB](https://whatcanirunai.vercel.app/hardware/rx-9060-xt-16gb/)16 GB usable | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%209060%20XT%2016GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%209060%20XT%2016GB) | | [Radeon RX 9070](https://whatcanirunai.vercel.app/hardware/rx-9070/)16 GB usable | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%209070&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%209070) | | [Radeon RX 9070 XT](https://whatcanirunai.vercel.app/hardware/rx-9070-xt/)16 GB usable | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%209070%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%209070%20XT) | | [Intel Arc A750](https://whatcanirunai.vercel.app/hardware/arc-a750/)8 GB usable | **23.8** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Intel%20Arc%20A750&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Intel%20Arc%20A750) | | [Intel Arc A770 16GB](https://whatcanirunai.vercel.app/hardware/arc-a770-16gb/)16 GB usable | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Intel%20Arc%20A770%2016GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Intel%20Arc%20A770%2016GB) | | [Intel Arc B570](https://whatcanirunai.vercel.app/hardware/arc-b570/)10 GB usable | **23.8** / 10.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Intel%20Arc%20B570&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Intel%20Arc%20B570) | | [NVIDIA RTX A4000](https://whatcanirunai.vercel.app/hardware/rtx-a4000/)16 GB usable | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20RTX%20A4000&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20RTX%20A4000) | | [NVIDIA RTX A5000](https://whatcanirunai.vercel.app/hardware/rtx-a5000/)24 GB usable | **23.8** / 24.0 GB | Q4TightQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20RTX%20A5000&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20RTX%20A5000) | | [NVIDIA RTX A6000](https://whatcanirunai.vercel.app/hardware/rtx-a6000/)48 GB usable | **23.8** / 48.0 GB | Q4FitsQ8FitsFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20RTX%20A6000&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20RTX%20A6000) | | [NVIDIA RTX 2000 Ada 16GB](https://whatcanirunai.vercel.app/hardware/rtx-2000-ada/)16 GB usable | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20RTX%202000%20Ada%2016GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20RTX%202000%20Ada%2016GB) | | [NVIDIA RTX 4000 Ada 20GB](https://whatcanirunai.vercel.app/hardware/rtx-4000-ada/)20 GB usable | **23.8** / 20.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20RTX%204000%20Ada%2020GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20RTX%204000%20Ada%2020GB) | | [NVIDIA RTX 6000 Ada 48GB](https://whatcanirunai.vercel.app/hardware/rtx-6000-ada/)48 GB usable | **23.8** / 48.0 GB | Q4FitsQ8FitsFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20RTX%206000%20Ada%2048GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20RTX%206000%20Ada%2048GB) | | [NVIDIA RTX Pro 6000 Blackwell 96GB](https://whatcanirunai.vercel.app/hardware/rtx-pro-6000-blackwell/)96 GB usable | **23.8** / 96.0 GB | Q4FitsQ8FitsFP16Fits | [Amazon](https://www.amazon.com/s?k=NVIDIA%20RTX%20Pro%206000%20Blackwell%2096GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20RTX%20Pro%206000%20Blackwell%2096GB) | | [NVIDIA Tesla P40 24GB](https://whatcanirunai.vercel.app/hardware/tesla-p40/)24 GB usable | **23.8** / 24.0 GB | Q4TightQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20Tesla%20P40%2024GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20Tesla%20P40%2024GB) | | [NVIDIA Tesla V100 32GB (PCIe)](https://whatcanirunai.vercel.app/hardware/tesla-v100-32gb/)32 GB usable | **23.8** / 32.0 GB | Q4FitsQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20Tesla%20V100%2032GB%20%28PCIe%29&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20Tesla%20V100%2032GB%20%28PCIe%29) | | [AMD Radeon Instinct MI50 32GB](https://whatcanirunai.vercel.app/hardware/instinct-mi50-32gb/)32 GB usable | **23.8** / 32.0 GB | Q4FitsQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=AMD%20Radeon%20Instinct%20MI50%2032GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=AMD%20Radeon%20Instinct%20MI50%2032GB) | | [AMD Radeon Instinct MI60 32GB](https://whatcanirunai.vercel.app/hardware/instinct-mi60/)32 GB usable | **23.8** / 32.0 GB | Q4FitsQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=AMD%20Radeon%20Instinct%20MI60%2032GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=AMD%20Radeon%20Instinct%20MI60%2032GB) | We may earn a commission when you buy through these links, at no extra cost to you. ## Quick answers How much VRAM does Qwen3-32B need? About 23.8 GB at Q4\_K\_M, 41.0 GB at Q8\_0 and 76.4 GB at FP16\. These are estimates: weights plus about 15% for the KV cache at a \~4k context, plus 1 GB for the runtime. What is the cheapest GPU that runs Qwen3-32B? Of the GPUs we track, the Intel Arc Pro B70 32GB (32 GB, $949 list price) is the cheapest one that runs it fully on the GPU at Q4. Can a Mac or mini PC run Qwen3-32B? Yes. The cheapest Mac or unified-memory mini PC we track that runs it at Q4 is the Mac mini M5 Pro 64GB (64 GB, 48.0 GB usable for models, $3199). How much VRAM does Qwen3-32B need for 32k context? About 31.4 GB at Q4\_K\_M with an FP16 KV cache (8.6 GB of that is the cache), or 57.1 GB at 128k. Estimated from the model's published config. How many GPUs and Macs can run Qwen3-32B? 16 of the 82 GPUs and Macs we track run it fully at Q4. --- Agent guide: https://whatcanirunai.vercel.app/llms.txt · JSON API: https://whatcanirunai.vercel.app/developers/