What Can I Run AI?

HomeCan I run it?DeepSeek-V3.2DeepSeek-V3.2 on an RTX 5090

No. DeepSeek-V3.2 at Q4_K_M needs about 478.8 GB, and the GeForce RTX 5090 has 32.0 GB usable at a ~4k context.

Can I run DeepSeek-V3.2 on an RTX 5090?

DeepSeek-V3.2 at Q4_K_M needs about 478.8 GB, and the GeForce RTX 5090 has 32.0 GB usable. That figure is 32 GB of VRAM on the spec sheet, of which 32.0 GB is usable for weights and cache, at 1792 GB/s memory bandwidth. DeepSeek’s large V3.2 model. Like full R1, it is far beyond a single consumer GPU or current Mac Studio at Q4. These are estimates from our formula, not measured benchmarks.

Quant that fits
None of Q4, Q8 or FP16 needs 478.8 GB
Memory needed
478.8 GB at Q4_K_M, ~4k context
Usable VRAM
32.0 GB of 32 GB VRAM
Est. tokens/sec
n/a does not fit

DeepSeek-V3.2 · GeForce RTX 5090 · Everything this machine runs · Q4 vs Q8 vs FP16

Memory at each quant

QuantNeed vs 32.0 GBVerdict
Q4_K_M478.8 GBQ4Won’t fit
Q8_0838.4 GBQ8Won’t fit
FP161577.3 GBFP16Won’t fit

Estimated tokens per second

No speed estimate: DeepSeek-V3.2 does not fit in the 32.0 GB this machine can use, so we do not publish a tokens/sec figure for CPU offload.

Context headroom

We do not have a published KV config for this model, so the memory need is the ~4k-context estimate only. Use the VRAM calculator to explore longer chats.

What to do instead

Other hardware for DeepSeek-V3.2

Other models on an RTX 5090

Quick answers

Can I run DeepSeek-V3.2 on an RTX 5090?
No. DeepSeek-V3.2 at Q4_K_M needs about 478.8 GB, and the GeForce RTX 5090 has 32.0 GB usable.
How much VRAM does DeepSeek-V3.2 need?
About 478.8 GB at Q4_K_M, 838.4 GB at Q8_0 and 1577.3 GB at FP16, estimated for a ~4k context.
How fast is DeepSeek-V3.2 on an RTX 5090?
We do not estimate tokens/sec when the model does not fit. CPU offload is possible but slow.

New models, and what they need to run

One short email a week: fresh open models with their VRAM numbers, plus hardware worth watching.