What Can I Run AI?

Qwen3.8-27B vs Gemma 4 31B: VRAM and speed for running locally

Side by side: how much memory each model needs at Q4, Q8 and FP16, how the KV cache grows with context, the cheapest GPU and Mac that run each, and estimated speed on 11 common machines.

Qwen3.8-27B is lighter: about 20.4 GB at Q4 against 22.8 GB for Gemma 4 31B, so it runs on 25 tracked devices vs 16. It should also be faster on the same hardware, since it reads 27.8B parameters per token against 31.3B. Which one gives better answers depends on your task, so check benchmarks for that; this page covers what it takes to run them.

Qwen3.8-27B vs Gemma 4 31B: specs and memory
Qwen3.8-27BGemma 4 31B
MakerQwengoogle
Licenseapache-2.0apache-2.0
TypeDenseDense
Total parameters27.8B31.3B
Active per token27.8B all31.3B all
Memory at Q4_K_M20.4 GB22.8 GB
Memory at Q8_034.9 GB39.2 GB
Memory at FP1664.9 GB72.9 GB
KV cache growth66 MB per 1k tokens, FP16not modeled
Memory at Q4, 32k context22.2 GB 2.1 GB cachecache not modeled
Cheapest GPU at Q4Intel Arc Pro B70 32GB $949Intel Arc Pro B70 32GB $949
Cheapest Mac / mini PC at Q4Mac mini M6 32GB $1,799Mac mini M5 Pro 64GB $3,199
Cheapest GPU at Q8NVIDIA RTX 6000 Ada 48GB $6,799NVIDIA RTX 6000 Ada 48GB $6,799
Tracked devices that run it at Q425 of 8216 of 82

Estimated speed on the same hardware

Decode tokens per second at Q4_K_M from memory bandwidth (how we estimate). MoE figures are upper bounds ("up to"). Estimates, not benchmarks.

Estimated tokens per second, Qwen3.8-27B vs Gemma 4 31B
DeviceQwen3.8-27BGemma 4 31B
GeForce RTX 3060 12GB12 GB usable · 360 GB/s · $329doesn’t fitdoesn’t fit
GeForce RTX 4060 Ti 16GB16 GB usable · 288 GB/s · $499doesn’t fitdoesn’t fit
GeForce RTX 508016 GB usable · 960 GB/s · $999doesn’t fitdoesn’t fit
GeForce RTX 309024 GB usable · 936 GB/s · $1,49933–47tight fit
Radeon RX 7900 XTX24 GB usable · 960 GB/s · $99934–48tight fit
GeForce RTX 509032 GB usable · 1792 GB/s · $1,99964–9057–80
Mac mini M6 24GB18 GB usable · 170 GB/s · $1,299doesn’t fitdoesn’t fit
Mac mini M6 32GB24 GB usable · 170 GB/s · $1,7995–8tight fit
Mac mini M5 Pro 64GB48 GB usable · 307 GB/s · $3,1998–157–13
Framework Desktop (Ryzen AI Max+ 395) 128GB96 GB usable · 256 GB/s · $3,4497–126–11
MacBook Pro M5 Max 128GB96 GB usable · 614 GB/s · $6,69916–2915–26

Hardware that runs only one of them

Run Qwen3.8-27B but not Gemma 4 31B: Radeon RX 7900 XTX, GeForce RTX 3090, GeForce RTX 4090, Mac mini M6 32GB, GeForce RTX 3090 Ti, MacBook Pro M6 32GB.

Current priced devices, cheapest first, at Q4 with ~4k context.

Quick answers

Which needs less VRAM, Qwen3.8-27B or Gemma 4 31B?
Qwen3.8-27B: about 20.4 GB at Q4_K_M, against 22.8 GB for Gemma 4 31B. At Q8_0 it's 34.9 GB vs 39.2 GB.
Which is faster locally, Qwen3.8-27B or Gemma 4 31B?
Decode speed is limited by how many bytes are read per token. Qwen3.8-27B reads 27.8B parameters per token and Gemma 4 31B reads 31.3B, so Qwen3.8-27B should be faster on the same machine. Our estimate on the GeForce RTX 5090 at Q4 is 64–90 tok/s vs 57–80 tok/s. These are estimates, not benchmarks.
What is the cheapest GPU for Qwen3.8-27B and Gemma 4 31B?
At Q4: Intel Arc Pro B70 32GB ($949) for Qwen3.8-27B; Intel Arc Pro B70 32GB ($949) for Gemma 4 31B. Prices are dated list-price snapshots.
Can a Mac run Qwen3.8-27B and Gemma 4 31B?
The cheapest Mac or mini PC we track for Qwen3.8-27B is the Mac mini M6 32GB ($1,799). For Gemma 4 31B it's the Mac mini M5 Pro 64GB ($3,199).
Which is better, Qwen3.8-27B or Gemma 4 31B?
We don't score answer quality. This comparison covers memory, context cache, hardware and speed. Pick the one that fits your hardware, then test both on your own prompts.

Related comparisons

All comparisons · MoE vs dense · Q4 vs Q8 vs FP16 · Context length and VRAM · VRAM calculator

New models, and what they need to run

One short email a week: fresh open models with their VRAM numbers, plus hardware worth watching.