What Can I Run AI?

Qwen3-Coder-30B-A3B-Instruct vs Recursive Flint: VRAM and speed for running locally

Side by side: how much memory each model needs at Q4, Q8 and FP16, how the KV cache grows with context, the cheapest GPU and Mac that run each, and estimated speed on 11 common machines.

Qwen3-Coder-30B-A3B-Instruct is lighter: about 22.3 GB at Q4 against 28.7 GB for Recursive Flint, though both run on 16 of the devices we track. Recursive Flint should be faster on the same hardware, since it reads 2.5B parameters per token against 3.0B. Which one gives better answers depends on your task, so check benchmarks for that; this page covers what it takes to run them.

Qwen3-Coder-30B-A3B-Instruct vs Recursive Flint: specs and memory
Qwen3-Coder-30B-A3B-InstructRecursive Flint
MakerQwenRecursiveSI
Licenseapache-2.0apache-2.0
TypeMixture of expertsMixture of experts
Total parameters30.5B39.8B
Active per token3.0B2.5B
Memory at Q4_K_M22.3 GB28.7 GB
Memory at Q8_038.3 GB49.6 GB
Memory at FP1671.2 GB92.5 GB
KV cache growth98 MB per 1k tokens, FP16100 MB per 1k tokens, FP16
Memory at Q4, 32k context25.1 GB 3.2 GB cache29.6 GB 1.0 GB cache
Cheapest GPU at Q4Intel Arc Pro B70 32GB $949Intel Arc Pro B70 32GB $949
Cheapest Mac / mini PC at Q4Mac mini M5 Pro 64GB $3,199Mac mini M5 Pro 64GB $3,199
Cheapest GPU at Q8NVIDIA RTX 6000 Ada 48GB $6,799NVIDIA RTX Pro 6000 Blackwell 96GB $8,565
Tracked devices that run it at Q416 of 8216 of 82

Estimated speed on the same hardware

Decode tokens per second at Q4_K_M from memory bandwidth (how we estimate). MoE figures are upper bounds ("up to"). Estimates, not benchmarks.

Estimated tokens per second, Qwen3-Coder-30B-A3B-Instruct vs Recursive Flint
DeviceQwen3-Coder-30B-A3B-InstructRecursive Flint
GeForce RTX 3060 12GB12 GB usable · 360 GB/s · $329doesn’t fitdoesn’t fit
GeForce RTX 4060 Ti 16GB16 GB usable · 288 GB/s · $499doesn’t fitdoesn’t fit
GeForce RTX 508016 GB usable · 960 GB/s · $999doesn’t fitdoesn’t fit
GeForce RTX 309024 GB usable · 936 GB/s · $1,499tight fitdoesn’t fit
Radeon RX 7900 XTX24 GB usable · 960 GB/s · $999tight fitdoesn’t fit
GeForce RTX 509032 GB usable · 1792 GB/s · $1,999up to 837up to 1005
Mac mini M6 24GB18 GB usable · 170 GB/s · $1,299doesn’t fitdoesn’t fit
Mac mini M6 32GB24 GB usable · 170 GB/s · $1,799tight fitdoesn’t fit
Mac mini M5 Pro 64GB48 GB usable · 307 GB/s · $3,199up to 135up to 162
Framework Desktop (Ryzen AI Max+ 395) 128GB96 GB usable · 256 GB/s · $3,449up to 113up to 135
MacBook Pro M5 Max 128GB96 GB usable · 614 GB/s · $6,699up to 270up to 324

Quick answers

Which needs less VRAM, Qwen3-Coder-30B-A3B-Instruct or Recursive Flint?
Qwen3-Coder-30B-A3B-Instruct: about 22.3 GB at Q4_K_M, against 28.7 GB for Recursive Flint. At Q8_0 it's 38.3 GB vs 49.6 GB.
Which is faster locally, Qwen3-Coder-30B-A3B-Instruct or Recursive Flint?
Decode speed is limited by how many bytes are read per token. Recursive Flint reads 2.5B parameters per token and Qwen3-Coder-30B-A3B-Instruct reads 3.0B, so Recursive Flint should be faster on the same machine. Our estimate on the GeForce RTX 5090 at Q4 is up to 1005 tok/s vs up to 837 tok/s. These are estimates, not benchmarks.
What is the cheapest GPU for Qwen3-Coder-30B-A3B-Instruct and Recursive Flint?
At Q4: Intel Arc Pro B70 32GB ($949) for Qwen3-Coder-30B-A3B-Instruct; Intel Arc Pro B70 32GB ($949) for Recursive Flint. Prices are dated list-price snapshots.
Can a Mac run Qwen3-Coder-30B-A3B-Instruct and Recursive Flint?
The cheapest Mac or mini PC we track for Qwen3-Coder-30B-A3B-Instruct is the Mac mini M5 Pro 64GB ($3,199). For Recursive Flint it's the Mac mini M5 Pro 64GB ($3,199).
Which is better, Qwen3-Coder-30B-A3B-Instruct or Recursive Flint?
We don't score answer quality. This comparison covers memory, context cache, hardware and speed. Pick the one that fits your hardware, then test both on your own prompts.

All comparisons · MoE vs dense · Q4 vs Q8 vs FP16 · Context length and VRAM · VRAM calculator

New models, and what they need to run

One short email a week: fresh open models with their VRAM numbers, plus hardware worth watching.