What Can I Run AI?

Can I run Ling-3.0-flash-VL?

Ling-3.0-flash-VL needs about 88.0 GB of memory at Q4_K_M, so it does not fit any single consumer GPU we track. The cheapest Mac or mini PC that holds it is the Mac Studio M5 Ultra 256GB (256 GB, $9499). 2 of the 82 devices we track run it fully at Q4. These are estimates, not measured benchmarks.

124.8B parameters, by inclusionAI. License: mit. Model card (params from HF API, retrieved 2026-11-04) · How much VRAM for 120B models · Q4 vs Q8 vs FP16 · MoE: 5.5B active per token

Q4_K_M needs
88.0 GB 75.7 GB weights
Q8_0 needs
153.5 GB 132.7 GB weights
FP16 needs
288.2 GB 249.7 GB weights

2 of 82 tracked GPUs and Macs run it fully at Q4.

Which hardware runs it

Bar: Q4 memory needed vs. usable memory. The tick marks 90%, our comfort line.FitsTightWon’t fit
HardwareQ4 need vs. usableQ4 / Q8 / FP16Check price
GeForce RTX 3050 8GB8 GB usable88.0 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 3060 12GB12 GB usable88.0 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 3060 Ti8 GB usable88.0 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 30708 GB usable88.0 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 3080 10GB10 GB usable88.0 / 10.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 3080 Ti12 GB usable88.0 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 309024 GB usable88.0 / 24.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 3090 Ti24 GB usable88.0 / 24.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 40608 GB usable88.0 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 4060 Ti 16GB16 GB usable88.0 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 407012 GB usable88.0 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 4070 Super12 GB usable88.0 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 4070 Ti Super16 GB usable88.0 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 4080 Super16 GB usable88.0 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 409024 GB usable88.0 / 24.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 507012 GB usable88.0 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 508016 GB usable88.0 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 509032 GB usable88.0 / 32.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 7600 XT16 GB usable88.0 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 7800 XT16 GB usable88.0 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 7900 XT20 GB usable88.0 / 20.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 7900 XTX24 GB usable88.0 / 24.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Intel Arc B58012 GB usable88.0 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Intel Arc Pro B70 32GB32 GB usable88.0 / 32.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Mac mini M4 16GB12 GB usable88.0 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Mac mini M6 16GB12 GB usable88.0 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Mac mini M6 24GB18 GB usable88.0 / 18.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Mac mini M6 32GB24 GB usable88.0 / 24.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Mac mini M5 Pro 64GB48 GB usable88.0 / 48.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
MacBook Pro M4 Max 128GB96 GB usable88.0 / 96.0 GBQ4TightQ8Won’t fitFP16Won’t fitAmazoneBay
MacBook Pro M5 Max 128GB96 GB usable88.0 / 96.0 GBQ4TightQ8Won’t fitFP16Won’t fitAmazoneBay
MacBook Pro M6 32GB24 GB usable88.0 / 24.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Mac Studio M5 Ultra 256GB192 GB usable88.0 / 192.0 GBQ4FitsQ8FitsFP16Won’t fitAmazoneBay
Mac Studio M5 Ultra 512GB384 GB usable88.0 / 384.0 GBQ4FitsQ8FitsFP16FitsAmazoneBay
Framework Desktop (Ryzen AI Max+ 395) 128GB96 GB usable88.0 / 96.0 GBQ4TightQ8Won’t fitFP16Won’t fitAmazoneBay
NVIDIA DGX Spark 64GB48 GB usable88.0 / 48.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
NVIDIA DGX Spark 128GB96 GB usable88.0 / 96.0 GBQ4TightQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 2060 6GB6 GB usable88.0 / 6.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 2060 12GB12 GB usable88.0 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 2060 Super8 GB usable88.0 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 20708 GB usable88.0 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 2070 Super8 GB usable88.0 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 20808 GB usable88.0 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 2080 Super8 GB usable88.0 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 2080 Ti11 GB usable88.0 / 11.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
NVIDIA Titan RTX24 GB usable88.0 / 24.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 3070 Ti8 GB usable88.0 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 3080 12GB12 GB usable88.0 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 4060 Ti 8GB8 GB usable88.0 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 4070 Ti12 GB usable88.0 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 408016 GB usable88.0 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 50608 GB usable88.0 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 5060 Ti 8GB8 GB usable88.0 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 5060 Ti 16GB16 GB usable88.0 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
GeForce RTX 5070 Ti16 GB usable88.0 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 6700 XT12 GB usable88.0 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 6750 XT12 GB usable88.0 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 680016 GB usable88.0 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 6800 XT16 GB usable88.0 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 6900 XT16 GB usable88.0 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 6950 XT16 GB usable88.0 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 76008 GB usable88.0 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 7700 XT12 GB usable88.0 / 12.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 7900 GRE16 GB usable88.0 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 9060 XT 8GB8 GB usable88.0 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 9060 XT 16GB16 GB usable88.0 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 907016 GB usable88.0 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Radeon RX 9070 XT16 GB usable88.0 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Intel Arc A7508 GB usable88.0 / 8.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Intel Arc A770 16GB16 GB usable88.0 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
Intel Arc B57010 GB usable88.0 / 10.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
NVIDIA RTX A400016 GB usable88.0 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
NVIDIA RTX A500024 GB usable88.0 / 24.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
NVIDIA RTX A600048 GB usable88.0 / 48.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
NVIDIA RTX 2000 Ada 16GB16 GB usable88.0 / 16.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
NVIDIA RTX 4000 Ada 20GB20 GB usable88.0 / 20.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
NVIDIA RTX 6000 Ada 48GB48 GB usable88.0 / 48.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
NVIDIA RTX Pro 6000 Blackwell 96GB96 GB usable88.0 / 96.0 GBQ4TightQ8Won’t fitFP16Won’t fitAmazoneBay
NVIDIA Tesla P40 24GB24 GB usable88.0 / 24.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
NVIDIA Tesla V100 32GB (PCIe)32 GB usable88.0 / 32.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
AMD Radeon Instinct MI50 32GB32 GB usable88.0 / 32.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay
AMD Radeon Instinct MI60 32GB32 GB usable88.0 / 32.0 GBQ4Won’t fitQ8Won’t fitFP16Won’t fitAmazoneBay

We may earn a commission when you buy through these links, at no extra cost to you.

Quick answers

How much VRAM does Ling-3.0-flash-VL need?
About 88.0 GB at Q4_K_M, 153.5 GB at Q8_0 and 288.2 GB at FP16. These are estimates: weights plus about 15% for the KV cache at a ~4k context, plus 1 GB for the runtime.
What is the cheapest GPU that runs Ling-3.0-flash-VL?
None of the single consumer GPUs we track can hold it at Q4. You need a large unified-memory machine, several GPUs, or CPU offload (slow).
Can a Mac or mini PC run Ling-3.0-flash-VL?
Yes. The cheapest Mac or unified-memory mini PC we track that runs it at Q4 is the Mac Studio M5 Ultra 256GB (256 GB, 192.0 GB usable for models, $9499).
How many GPUs and Macs can run Ling-3.0-flash-VL?
2 of the 82 GPUs and Macs we track run it fully at Q4.

New models, and what they need to run

One short email a week: fresh open models with their VRAM numbers, plus hardware worth watching.

Or subscribe here