What Can I Run AI?

Can I run Gemma 4 31B?

Gemma 4 31B needs about 22.8 GB of memory at Q4_K_M, and the cheapest GPU we track that holds it is the Intel Arc Pro B70 32GB (32 GB, $949 list price). 16 of the 82 devices we track run it fully at Q4. These are estimates, not measured benchmarks.

31.3B parameters, by google. License: apache-2.0. Model card (params from HF API, retrieved 2026-10-26) · How much VRAM for 30B–32B models · Best GPU for Gemma 4 · Ollama VRAM (gemma4:31b) · GGUF sizes Q3–Q8 (llama.cpp) · Q4 vs Q8 vs FP16

Q4_K_M needs
22.8 GB 19.0 GB weights
Q8_0 needs
39.2 GB 33.2 GB weights
FP16 needs
72.9 GB 62.5 GB weights

16 of 82 tracked GPUs and Macs run it fully at Q4.

Compare: Qwen3.8-27B vs Gemma 4 31B · Gemma 4 31B vs gemma-3-27b-it

Can I run Gemma 4 31B on a specific GPU or Mac?

Direct yes-or-no checks for popular hardware, with the quant that fits and an estimated tokens/sec range.

Which hardware runs it

Bar: Q4 memory needed vs. usable memory. The tick marks 90%, our comfort line.FitsTightWon’t fit
HardwareQ4 need vs. usableQ4 / Q8 / FP16Check price
GeForce RTX 3050 8GB8 GB usable22.8 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 3060 12GB12 GB usable22.8 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 3060 Ti8 GB usable22.8 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 30708 GB usable22.8 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 3080 10GB10 GB usable22.8 / 10.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 3080 Ti12 GB usable22.8 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 309024 GB usable22.8 / 24.0 GBQ4TightQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 3090 Ti24 GB usable22.8 / 24.0 GBQ4TightQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 40608 GB usable22.8 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 4060 Ti 16GB16 GB usable22.8 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 407012 GB usable22.8 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 4070 Super12 GB usable22.8 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 4070 Ti Super16 GB usable22.8 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 4080 Super16 GB usable22.8 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 409024 GB usable22.8 / 24.0 GBQ4TightQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 507012 GB usable22.8 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 508016 GB usable22.8 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 509032 GB usable22.8 / 32.0 GBQ4FitsQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 7600 XT16 GB usable22.8 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 7800 XT16 GB usable22.8 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 7900 XT20 GB usable22.8 / 20.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 7900 XTX24 GB usable22.8 / 24.0 GBQ4TightQ8Won’t fitFP16Won’t fitAmazoneBay
Intel Arc B58012 GB usable22.8 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Intel Arc Pro B70 32GB32 GB usable22.8 / 32.0 GBQ4FitsQ8Won’t fitFP16Won’t fitAmazoneBay
Mac mini M4 16GB12 GB usable22.8 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Mac mini M6 16GB12 GB usable22.8 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Mac mini M6 24GB18 GB usable22.8 / 18.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Mac mini M6 32GB24 GB usable22.8 / 24.0 GBQ4TightQ8Won’t fitFP16Won’t fitAmazoneBay
Mac mini M5 Pro 64GB48 GB usable22.8 / 48.0 GBQ4FitsQ8FitsFP16Won’t fitAmazoneBay
MacBook Pro M4 Max 128GB96 GB usable22.8 / 96.0 GBQ4FitsQ8FitsFP16FitsAmazoneBay
MacBook Pro M5 Max 128GB96 GB usable22.8 / 96.0 GBQ4FitsQ8FitsFP16FitsAmazoneBay
MacBook Pro M6 32GB24 GB usable22.8 / 24.0 GBQ4TightQ8Won’t fitFP16Won’t fitAmazoneBay
Mac Studio M5 Ultra 256GB192 GB usable22.8 / 192.0 GBQ4FitsQ8FitsFP16FitsAmazoneBay
Mac Studio M5 Ultra 512GB384 GB usable22.8 / 384.0 GBQ4FitsQ8FitsFP16FitsAmazoneBay
Framework Desktop (Ryzen AI Max+ 395) 128GB96 GB usable22.8 / 96.0 GBQ4FitsQ8FitsFP16FitsAmazoneBay
NVIDIA DGX Spark 64GB48 GB usable22.8 / 48.0 GBQ4FitsQ8FitsFP16Won’t fitAmazoneBay
NVIDIA DGX Spark 128GB96 GB usable22.8 / 96.0 GBQ4FitsQ8FitsFP16FitsAmazoneBay
GeForce RTX 2060 6GB6 GB usable22.8 / 6.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 2060 12GB12 GB usable22.8 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 2060 Super8 GB usable22.8 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 20708 GB usable22.8 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 2070 Super8 GB usable22.8 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 20808 GB usable22.8 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 2080 Super8 GB usable22.8 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 2080 Ti11 GB usable22.8 / 11.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
NVIDIA Titan RTX24 GB usable22.8 / 24.0 GBQ4TightQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 3070 Ti8 GB usable22.8 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 3080 12GB12 GB usable22.8 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 4060 Ti 8GB8 GB usable22.8 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 4070 Ti12 GB usable22.8 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 408016 GB usable22.8 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 50608 GB usable22.8 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 5060 Ti 8GB8 GB usable22.8 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 5060 Ti 16GB16 GB usable22.8 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 5070 Ti16 GB usable22.8 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 6700 XT12 GB usable22.8 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 6750 XT12 GB usable22.8 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 680016 GB usable22.8 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 6800 XT16 GB usable22.8 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 6900 XT16 GB usable22.8 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 6950 XT16 GB usable22.8 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 76008 GB usable22.8 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 7700 XT12 GB usable22.8 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 7900 GRE16 GB usable22.8 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 9060 XT 8GB8 GB usable22.8 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 9060 XT 16GB16 GB usable22.8 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 907016 GB usable22.8 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 9070 XT16 GB usable22.8 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Intel Arc A7508 GB usable22.8 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Intel Arc A770 16GB16 GB usable22.8 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Intel Arc B57010 GB usable22.8 / 10.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
NVIDIA RTX A400016 GB usable22.8 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
NVIDIA RTX A500024 GB usable22.8 / 24.0 GBQ4TightQ8Won’t fitFP16Won’t fitAmazoneBay
NVIDIA RTX A600048 GB usable22.8 / 48.0 GBQ4FitsQ8FitsFP16Won’t fitAmazoneBay
NVIDIA RTX 2000 Ada 16GB16 GB usable22.8 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
NVIDIA RTX 4000 Ada 20GB20 GB usable22.8 / 20.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
NVIDIA RTX 6000 Ada 48GB48 GB usable22.8 / 48.0 GBQ4FitsQ8FitsFP16Won’t fitAmazoneBay
NVIDIA RTX Pro 6000 Blackwell 96GB96 GB usable22.8 / 96.0 GBQ4FitsQ8FitsFP16FitsAmazoneBay
NVIDIA Tesla P40 24GB24 GB usable22.8 / 24.0 GBQ4TightQ8Won’t fitFP16Won’t fitAmazoneBay
NVIDIA Tesla V100 32GB (PCIe)32 GB usable22.8 / 32.0 GBQ4FitsQ8Won’t fitFP16Won’t fitAmazoneBay
AMD Radeon Instinct MI50 32GB32 GB usable22.8 / 32.0 GBQ4FitsQ8Won’t fitFP16Won’t fitAmazoneBay
AMD Radeon Instinct MI60 32GB32 GB usable22.8 / 32.0 GBQ4FitsQ8Won’t fitFP16Won’t fitAmazoneBay

We may earn a commission when you buy through these links, at no extra cost to you.

Quick answers

How much VRAM does Gemma 4 31B need?
About 22.8 GB at Q4_K_M, 39.2 GB at Q8_0 and 72.9 GB at FP16. These are estimates: weights plus about 15% for the KV cache at a ~4k context, plus 1 GB for the runtime.
What is the cheapest GPU that runs Gemma 4 31B?
Of the GPUs we track, the Intel Arc Pro B70 32GB (32 GB, $949 list price) is the cheapest one that runs it fully on the GPU at Q4.
Can a Mac or mini PC run Gemma 4 31B?
Yes. The cheapest Mac or unified-memory mini PC we track that runs it at Q4 is the Mac mini M5 Pro 64GB (64 GB, 48.0 GB usable for models, $3199).
How many GPUs and Macs can run Gemma 4 31B?
16 of the 82 GPUs and Macs we track run it fully at Q4.

New models, and what they need to run

One short email a week: fresh open models with their VRAM numbers, plus hardware worth watching.