What Can I Run AI?

Gemma 4 E4B vs Qwen3-4B: VRAM and speed for running locally

Side by side: how much memory each model needs at Q4, Q8 and FP16, how the KV cache grows with context, the cheapest GPU and Mac that run each, and estimated speed on 11 common machines.

Qwen3-4B is lighter: about 3.8 GB at Q4 against 6.6 GB for Gemma 4 E4B, so it runs on 82 tracked devices vs 81. It should also be faster on the same hardware, since it reads 4.0B parameters per token against 8.0B. Which one gives better answers depends on your task, so check benchmarks for that; this page covers what it takes to run them.

Gemma 4 E4B vs Qwen3-4B: specs and memory
Gemma 4 E4BQwen3-4B
MakergoogleQwen
Licenseapache-2.0apache-2.0
TypeDenseDense
Total parameters8.0B4.0B
Active per token8.0B all4.0B all
Memory at Q4_K_M6.6 GB3.8 GB
Memory at Q8_010.8 GB5.9 GB
Memory at FP1619.4 GB10.3 GB
KV cache growthnot modeled147 MB per 1k tokens, FP16
Memory at Q4, 32k contextcache not modeled8.0 GB 4.8 GB cache
Cheapest GPU at Q4Intel Arc B570 $219Intel Arc B570 $219
Cheapest Mac / mini PC at Q4Mac mini M6 16GB $899Mac mini M6 16GB $899
Cheapest GPU at Q8Intel Arc B580 $249Intel Arc B570 $219
Tracked devices that run it at Q481 of 8282 of 82

Estimated speed on the same hardware

Decode tokens per second at Q4_K_M from memory bandwidth (how we estimate). MoE figures are upper bounds ("up to"). Estimates, not benchmarks.

Estimated tokens per second, Gemma 4 E4B vs Qwen3-4B
DeviceGemma 4 E4BQwen3-4B
GeForce RTX 3060 12GB12 GB usable · 360 GB/s · $32945–6389–125
GeForce RTX 4060 Ti 16GB16 GB usable · 288 GB/s · $49936–5071–100
GeForce RTX 508016 GB usable · 960 GB/s · $999119–168236–335
GeForce RTX 309024 GB usable · 936 GB/s · $1,499116–164230–326
Radeon RX 7900 XTX24 GB usable · 960 GB/s · $999119–168236–335
GeForce RTX 509032 GB usable · 1792 GB/s · $1,999222–314441–625
Mac mini M6 24GB18 GB usable · 170 GB/s · $1,29916–2831–56
Mac mini M6 32GB24 GB usable · 170 GB/s · $1,79916–2831–56
Mac mini M5 Pro 64GB48 GB usable · 307 GB/s · $3,19928–5157–101
Framework Desktop (Ryzen AI Max+ 395) 128GB96 GB usable · 256 GB/s · $3,44924–4247–84
MacBook Pro M5 Max 128GB96 GB usable · 614 GB/s · $6,69957–101113–201

Quick answers

Which needs less VRAM, Gemma 4 E4B or Qwen3-4B?
Qwen3-4B: about 3.8 GB at Q4_K_M, against 6.6 GB for Gemma 4 E4B. At Q8_0 it's 5.9 GB vs 10.8 GB.
Which is faster locally, Gemma 4 E4B or Qwen3-4B?
Decode speed is limited by how many bytes are read per token. Qwen3-4B reads 4.0B parameters per token and Gemma 4 E4B reads 8.0B, so Qwen3-4B should be faster on the same machine. Our estimate on the GeForce RTX 3060 12GB at Q4 is 89–125 tok/s vs 45–63 tok/s. These are estimates, not benchmarks.
What is the cheapest GPU for Gemma 4 E4B and Qwen3-4B?
At Q4: Intel Arc B570 ($219) for Gemma 4 E4B; Intel Arc B570 ($219) for Qwen3-4B. Prices are dated list-price snapshots.
Can a Mac run Gemma 4 E4B and Qwen3-4B?
The cheapest Mac or mini PC we track for Gemma 4 E4B is the Mac mini M6 16GB ($899). For Qwen3-4B it's the Mac mini M6 16GB ($899).
Which is better, Gemma 4 E4B or Qwen3-4B?
We don't score answer quality. This comparison covers memory, context cache, hardware and speed. Pick the one that fits your hardware, then test both on your own prompts.

All comparisons · MoE vs dense · Q4 vs Q8 vs FP16 · Context length and VRAM · VRAM calculator

New models, and what they need to run

One short email a week: fresh open models with their VRAM numbers, plus hardware worth watching.