What Can I Run AI?

HomeCan I run it?Qwen3-14BQwen3-14B on an RTX 3070 Ti

No. Qwen3-14B at Q4_K_M needs about 11.3 GB, and the GeForce RTX 3070 Ti has 8.0 GB usable at a ~4k context.

Can I run Qwen3-14B on an RTX 3070 Ti?

Qwen3-14B at Q4_K_M needs about 11.3 GB, and the GeForce RTX 3070 Ti has 8.0 GB usable. That figure is 8 GB of VRAM on the spec sheet, of which 8.0 GB is usable for weights and cache, at 608 GB/s memory bandwidth. Alibaba’s 14B Qwen3. It sits in the sweet spot for 12–16 GB cards that want more quality than an 8B. These are estimates from our formula, not measured benchmarks.

Quant that fits
None of Q4, Q8 or FP16 needs 11.3 GB
Memory needed
11.3 GB at Q4_K_M, ~4k context
Usable VRAM
8.0 GB of 8 GB VRAM
Est. tokens/sec
n/a does not fit

Qwen3-14B · GeForce RTX 3070 Ti · Everything this machine runs · Q4 vs Q8 vs FP16

Memory at each quant

QuantNeed vs 8.0 GBVerdict
Q4_K_M11.3 GBQ4Won’t fit
Q8_019.0 GBQ8Won’t fit
FP1635.0 GBFP16Won’t fit

Estimated tokens per second

No speed estimate: Qwen3-14B does not fit in the 8.0 GB this machine can use, so we do not publish a tokens/sec figure for CPU offload.

Context headroom

Even at a short ~4k context, the weights do not fit. Extending context would only increase the gap.

Context headroom for Qwen3-14B on an RTX 3070 Ti at Q4_K_M
ContextKV cache (FP16)Total at Q4_K_MVerdict
4k0.7 GB11.3 GBWon’t fit
8k1.3 GB12.0 GBWon’t fit
16k2.7 GB13.3 GBWon’t fit
32k5.4 GB16.0 GBWon’t fit
64k10.7 GB21.4 GBWon’t fit
128k21.5 GB32.1 GBWon’t fit

From the model’s config. Try other sizes in the VRAM calculator or see the context length guide.

What to do instead

Other hardware for Qwen3-14B

Other models on an RTX 3070 Ti

Quick answers

Can I run Qwen3-14B on an RTX 3070 Ti?
No. Qwen3-14B at Q4_K_M needs about 11.3 GB, and the GeForce RTX 3070 Ti has 8.0 GB usable.
How much VRAM does Qwen3-14B need?
About 11.3 GB at Q4_K_M, 19.0 GB at Q8_0 and 35.0 GB at FP16, estimated for a ~4k context.
How fast is Qwen3-14B on an RTX 3070 Ti?
We do not estimate tokens/sec when the model does not fit. CPU offload is possible but slow.
What context length can I use?
The weights already do not fit, so longer context is not the limiting factor.

New models, and what they need to run

One short email a week: fresh open models with their VRAM numbers, plus hardware worth watching.