What Can I Run AI?

HomeCan I run it?Qwen3-32BQwen3-32B on an RX 7900 XTX

Yes, but it is tight. Qwen3-32B at Q4_K_M needs about 23.8 GB, and the Radeon RX 7900 XTX has 24.0 GB usable at a ~4k context.

Can I run Qwen3-32B on an RX 7900 XTX?

Qwen3-32B at Q4_K_M needs about 23.8 GB, and the Radeon RX 7900 XTX has 24.0 GB usable. That figure is 24 GB of VRAM on the spec sheet, of which 24.0 GB is usable for weights and cache, at 960 GB/s memory bandwidth. Alibaba’s dense 32B Qwen3, a common “best quality that still fits a 24 GB card” pick. These are estimates from our formula, not measured benchmarks.

Quant that fits
Q4_K_M Fits, short context only
Memory needed
23.8 GB at Q4_K_M, ~4k context
Usable VRAM
24.0 GB of 24 GB VRAM
Est. tokens/sec
29–41 estimate

Qwen3-32B · Radeon RX 7900 XTX · Everything this machine runs · Q4 vs Q8 vs FP16

Memory at each quant

QuantNeed vs 24.0 GBVerdict
Q4_K_M23.8 GBQ4Tight
Q8_041.0 GBQ8Won’t fit
FP1676.4 GBFP16Won’t fit

Estimated tokens per second

Estimate: 29–41 tokens/sec at Q4_K_M. This is a bandwidth-derived range, not a bench. Efficiency is a 60–85% GPU band from How we calculate.

Context headroom

At Q4_K_M, this machine has headroom out to about 4k tokens under our KV estimate. Longer chats need more memory for the cache. Figures assume an FP16 KV cache.

Context headroom for Qwen3-32B on an RX 7900 XTX at Q4_K_M
ContextKV cache (FP16)Total at Q4_K_MVerdict
4k1.1 GB23.8 GBTight
8k2.1 GB24.9 GBWon’t fit
16k4.3 GB27.1 GBWon’t fit
32k8.6 GB31.4 GBWon’t fit
64k17.2 GB39.9 GBWon’t fit
128k34.4 GB57.1 GBWon’t fit

From the model’s config. Try other sizes in the VRAM calculator or see the context length guide.

What to do instead

Other hardware for Qwen3-32B

Other models on an RX 7900 XTX

Quick answers

Can I run Qwen3-32B on an RX 7900 XTX?
Yes, but it is tight. Qwen3-32B at Q4_K_M needs about 23.8 GB, and the Radeon RX 7900 XTX has 24.0 GB usable.
How much VRAM does Qwen3-32B need?
About 23.8 GB at Q4_K_M, 41.0 GB at Q8_0 and 76.4 GB at FP16, estimated for a ~4k context.
How fast is Qwen3-32B on an RX 7900 XTX?
Our estimate is 29–41 tokens per second at Q4_K_M. It is not a measured benchmark.
What context length can I use?
At Q4_K_M, our KV estimate supports up to about 4k tokens before the cache pushes the total over usable memory.

New models, and what they need to run

One short email a week: fresh open models with their VRAM numbers, plus hardware worth watching.