Can I run GLM-4.5-Air?
GLM-4.5-Air needs about 78.0 GB of memory at Q4_K_M, and the cheapest GPU we track that holds it is the NVIDIA RTX Pro 6000 Blackwell 96GB (96 GB, $8565 list price). 7 of the 82 devices we track run it fully at Q4. These are estimates, not measured benchmarks.
- Q4_K_M needs
- 78.0 GB 67.0 GB weights
- Q8_0 needs
- 136.0 GB 117.4 GB weights
- FP16 needs
- 255.1 GB 220.9 GB weights
7 of 82 tracked GPUs and Macs run it fully at Q4.
Memory by context length
Longer chats and documents need more memory for the KV cache. All 46 layers keep a full cache. Sizes assume an FP16 KV cache; a Q8 cache roughly halves the cache part.
| Context | KV cache (FP16) | Total at Q4_K_M | Total at Q8_0 |
|---|---|---|---|
| 4k tokens | 0.8 GB | 78.0 GB | 136.0 GB |
| 8k tokens | 1.5 GB | 78.8 GB | 136.8 GB |
| 16k tokens | 3.1 GB | 80.3 GB | 138.3 GB |
| 32k tokens | 6.2 GB | 83.4 GB | 141.4 GB |
| 64k tokens | 12.3 GB | 89.6 GB | 147.6 GB |
| 128k tokens | 24.7 GB | 101.9 GB | 159.9 GB |
Can I run GLM-4.5-Air on a specific GPU or Mac?
Direct yes-or-no checks for popular hardware, with the quant that fits and an estimated tokens/sec range.
- Can I run GLM-4.5-Air on an RTX 4090?Q4Won’t fit
- Can I run GLM-4.5-Air on an RTX 5090?Q4Won’t fit
- Can I run GLM-4.5-Air on dual RTX 3090s?Q4Won’t fit
- Can I run GLM-4.5-Air on a Mac mini 64GB?Q4Won’t fit
- Can I run GLM-4.5-Air on a Mac Studio 256GB?Q8Fits
- Can I run GLM-4.5-Air on an RTX 3090?Q4Won’t fit
Which hardware runs it
| Hardware | Q4 need vs. usable | Q4 / Q8 / FP16 | Check price |
|---|---|---|---|
| GeForce RTX 3050 8GB8 GB usable | 78.0 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3060 12GB12 GB usable | 78.0 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3060 Ti8 GB usable | 78.0 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 30708 GB usable | 78.0 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3080 10GB10 GB usable | 78.0 / 10.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3080 Ti12 GB usable | 78.0 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 309024 GB usable | 78.0 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3090 Ti24 GB usable | 78.0 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 40608 GB usable | 78.0 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 4060 Ti 16GB16 GB usable | 78.0 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 407012 GB usable | 78.0 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 4070 Super12 GB usable | 78.0 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 4070 Ti Super16 GB usable | 78.0 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 4080 Super16 GB usable | 78.0 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 409024 GB usable | 78.0 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 507012 GB usable | 78.0 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 508016 GB usable | 78.0 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 509032 GB usable | 78.0 / 32.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 7600 XT16 GB usable | 78.0 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 7800 XT16 GB usable | 78.0 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 7900 XT20 GB usable | 78.0 / 20.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 7900 XTX24 GB usable | 78.0 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Intel Arc B58012 GB usable | 78.0 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Intel Arc Pro B70 32GB32 GB usable | 78.0 / 32.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac mini M4 16GB12 GB usable | 78.0 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac mini M6 16GB12 GB usable | 78.0 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac mini M6 24GB18 GB usable | 78.0 / 18.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac mini M6 32GB24 GB usable | 78.0 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac mini M5 Pro 64GB48 GB usable | 78.0 / 48.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| MacBook Pro M4 Max 128GB96 GB usable | 78.0 / 96.0 GB | Q4FitsQ8Won’t fitFP16Won’t fit | AmazoneBay |
| MacBook Pro M5 Max 128GB96 GB usable | 78.0 / 96.0 GB | Q4FitsQ8Won’t fitFP16Won’t fit | AmazoneBay |
| MacBook Pro M6 32GB24 GB usable | 78.0 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Mac Studio M5 Ultra 256GB192 GB usable | 78.0 / 192.0 GB | Q4FitsQ8FitsFP16Won’t fit | AmazoneBay |
| Mac Studio M5 Ultra 512GB384 GB usable | 78.0 / 384.0 GB | Q4FitsQ8FitsFP16Fits | AmazoneBay |
| Framework Desktop (Ryzen AI Max+ 395) 128GB96 GB usable | 78.0 / 96.0 GB | Q4FitsQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA DGX Spark 64GB48 GB usable | 78.0 / 48.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA DGX Spark 128GB96 GB usable | 78.0 / 96.0 GB | Q4FitsQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 2060 6GB6 GB usable | 78.0 / 6.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 2060 12GB12 GB usable | 78.0 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 2060 Super8 GB usable | 78.0 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 20708 GB usable | 78.0 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 2070 Super8 GB usable | 78.0 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 20808 GB usable | 78.0 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 2080 Super8 GB usable | 78.0 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 2080 Ti11 GB usable | 78.0 / 11.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA Titan RTX24 GB usable | 78.0 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3070 Ti8 GB usable | 78.0 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 3080 12GB12 GB usable | 78.0 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 4060 Ti 8GB8 GB usable | 78.0 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 4070 Ti12 GB usable | 78.0 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 408016 GB usable | 78.0 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 50608 GB usable | 78.0 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 5060 Ti 8GB8 GB usable | 78.0 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 5060 Ti 16GB16 GB usable | 78.0 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| GeForce RTX 5070 Ti16 GB usable | 78.0 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 6700 XT12 GB usable | 78.0 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 6750 XT12 GB usable | 78.0 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 680016 GB usable | 78.0 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 6800 XT16 GB usable | 78.0 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 6900 XT16 GB usable | 78.0 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 6950 XT16 GB usable | 78.0 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 76008 GB usable | 78.0 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 7700 XT12 GB usable | 78.0 / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 7900 GRE16 GB usable | 78.0 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 9060 XT 8GB8 GB usable | 78.0 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 9060 XT 16GB16 GB usable | 78.0 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 907016 GB usable | 78.0 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Radeon RX 9070 XT16 GB usable | 78.0 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Intel Arc A7508 GB usable | 78.0 / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Intel Arc A770 16GB16 GB usable | 78.0 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| Intel Arc B57010 GB usable | 78.0 / 10.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX A400016 GB usable | 78.0 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX A500024 GB usable | 78.0 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX A600048 GB usable | 78.0 / 48.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX 2000 Ada 16GB16 GB usable | 78.0 / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX 4000 Ada 20GB20 GB usable | 78.0 / 20.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX 6000 Ada 48GB48 GB usable | 78.0 / 48.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA RTX Pro 6000 Blackwell 96GB96 GB usable | 78.0 / 96.0 GB | Q4FitsQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA Tesla P40 24GB24 GB usable | 78.0 / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| NVIDIA Tesla V100 32GB (PCIe)32 GB usable | 78.0 / 32.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| AMD Radeon Instinct MI50 32GB32 GB usable | 78.0 / 32.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
| AMD Radeon Instinct MI60 32GB32 GB usable | 78.0 / 32.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | AmazoneBay |
We may earn a commission when you buy through these links, at no extra cost to you.
Quick answers
- How much VRAM does GLM-4.5-Air need?
- About 78.0 GB at Q4_K_M, 136.0 GB at Q8_0 and 255.1 GB at FP16. These are estimates: weights plus about 15% for the KV cache at a ~4k context, plus 1 GB for the runtime.
- What is the cheapest GPU that runs GLM-4.5-Air?
- Of the GPUs we track, the NVIDIA RTX Pro 6000 Blackwell 96GB (96 GB, $8565 list price) is the cheapest one that runs it fully on the GPU at Q4.
- Can a Mac or mini PC run GLM-4.5-Air?
- Yes. The cheapest Mac or unified-memory mini PC we track that runs it at Q4 is the Framework Desktop (Ryzen AI Max+ 395) 128GB (128 GB, 96.0 GB usable for models, $3449).
- How much VRAM does GLM-4.5-Air need for 32k context?
- About 83.4 GB at Q4_K_M with an FP16 KV cache (6.2 GB of that is the cache), or 101.9 GB at 128k. Estimated from the model's published config.
- How many GPUs and Macs can run GLM-4.5-Air?
- 7 of the 82 GPUs and Macs we track run it fully at Q4.