RTX 5090 single-GPU build (32 GB)
The fastest single consumer card for decode: 1,792 GB/s and 32 GB.
- Total
- $4,533
- Usable memory
- 32.0 GB
- Qwen3-32B Q4
- Fits
- Est. tok/s
- 54–77
- PSU needed
- 1050 W
- $ per tok/s
- $69
Parts
| Part | Item | Price | Buy |
|---|---|---|---|
| GPU | GeForce RTX 5090 | $1,999list price (MSRP) | Amazon |
| CPU | AMD Ryzen 7 9700X | $339Newegg price (sold by Newegg) | Amazon |
| Motherboard | ASUS TUF GAMING B650E-PLUS WIFI | $150Newegg price (sold by Newegg) | Amazon |
| RAM | Corsair Vengeance 64GB (2x32) DDR5-6000 CL30 | $1,275Corsair store price | Amazon |
| Power supply | Corsair HX1200i | $280Corsair store price | Amazon |
| Case | Corsair FRAME 5000D RS | $160Corsair store price | Amazon |
| Storage | Samsung 990 2TB NVMe | $330Newegg price (sold by Newegg) | Amazon |
| Total | $4,533 | ||
Will Qwen3-32B run?
| Model | Q4_K_M | Q8_0 | FP16 | Est. tok/s (Q4) |
|---|---|---|---|---|
| Qwen3-32B23.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 54–77 |
Power math
(GPU 575×1 W + CPU 65 W + 150 W rest of system) × 1.3 = 1027 W → 1050 W PSU
Running cost at full load: about 790 W, so $0.14/hour at an example $0.18/kWh (enter your own rate in the planner). Decode rarely holds the GPUs at full board power, so treat this as a ceiling.
Fit checks
- PSU: 1200 W vs. 1027 W recommended ((GPU 575 W + CPU 65 W + 150 W) × 1.3). Headroom 173 W.
- Power connectors: need 1× 12V-2x6 cable + 0× PCIe 8-pin; PSU has 2× 12V-2x6 + 5× 8-pin.
- Length: 304 mm card vs. 450 mm case limit.
- Expansion slots: 1 card × 2-slot needs about 2; case has 8.
All models on this build
| Model | Q4_K_M | Q8_0 | FP16 | Est. tok/s (Q4) |
|---|---|---|---|---|
| Kimi-K3.1-Pro1939.3 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Kimi-K31939.1 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Qwen3.8-2.4T-A95B1706.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| LongCat-2.51241.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| LongCat-2.01238.9 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — |
| DeepSeek-V4-Pro-08131151.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| DeepSeek-V4-Pro1115.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Kimi-K2.5716.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Kimi-K2.6716.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Kimi-K2.7-Code716.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Kimi-K2-Thinking716.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Kimi-K2-Instruct-0905716.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Kimi-K2-Instruct716.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| MiMo-V2.6-Pro-RL715.1 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| MiMo-V2.6-Pro-MOPD715.1 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| MiMo-V2.5-Pro714.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Ring-2.5-1T706.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Ling-2.5-1T706.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Ling-1T698.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Ring-1T698.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Inkling665.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Intern-S1-Pro640.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Muse-Spark-Open-816B-A42B574.1 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Hy4-preview544.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| GLM-5526.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| GLM-5.1526.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| GLM-5.3526.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — |
| GLM-5.2526.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| GLM-5.3-BF16526.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| K-EXAONE-2.0-750B-A37B523.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| DeepSeek-V3.2-Exp478.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| DeepSeek-V3.2-Speciale478.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| DeepSeek-V3.2478.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| DeepSeek-V3-0324478.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| DeepSeek-R1-0528478.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| DeepSeek-V3.1-Base478.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| DeepSeek-R1478.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| DeepSeek-R1-Zero478.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Step-5-Preview422.3 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Ling-3.1-flash399.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Ling-3.1-flash-1019399.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| LongCat-Flash-Chat392.7 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — |
| LongCat-Flash-Thinking392.7 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — |
| LongCat-Flash-Thinking-2601392.7 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — |
| NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16391.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Beam-1.0-501B-A23B350.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Qwen3-Coder-480B-A35B-Instruct335.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| MiniMax-M1-40k319.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| MiniMax-M1-80k319.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| MiniMax-M3298.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| ERNIE-4.5-VL-424B-A47B-PT296.3 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Intern-S2-397B282.3 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Qwen3.5-397B-A17B282.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Llama-4-Maverick-17B-128E-Instruct281.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Trinity-Large-Thinking278.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Trinity-Large-Preview278.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Trinity-Large-TrueBase278.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Trinity-Large-Base278.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Nex-N2.5-Pro277.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Nex-N2-Pro277.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| NorthCUA-Pro277.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| GLM-4.5250.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| GLM-4.7250.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| GLM-4.6249.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| GLM-5.3-Flash225.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Motif-3220.5 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — |
| MiMo-V2.5217.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| MiMo-V2.6-Flash-RL217.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| MiMo-V2.6-Flash-MOPD217.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| MiMo-V2-Flash217.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| DeepSeek-V4-Flash-Vision-Exp213.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| DeepSeek-V4-Flash-0731213.1 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| ERNIE-4.5-300B-A47B-PT210.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Hy3209.3 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Hy3-preview209.3 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Ling-plus205.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| DeepSeek-V4-Flash203.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| MemT-1.0-Flash201.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| ERNIE-5.5-Flash-Base200.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Inkling-Small186.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Llama-3_1-Nemotron-Ultra-253B-v1177.7 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — |
| Solar-Open2-250B175.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Intern-S1168.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| K-EXAONE-236B-A23B166.3 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| DeepSeek-V2.5165.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| DeepSeek-Coder-V2-Instruct165.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| DeepSeek-V2.5-1210165.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| DeepSeek-V2-Chat-0628165.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| DeepSeek-Coder-V2-Instruct-0724165.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Qwen3-VL-235B-A22B-Instruct165.3 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Qwen3-235B-A22B164.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Qwen3-235B-A22B-Instruct-2507164.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Qwen3-235B-A22B-Thinking-2507164.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| MiniMax-M2160.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| MiniMax-M2.5160.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| MiniMax-M2.7160.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| MiniMax-M2.1160.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| command-a-plus-05-2026-bf16153.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Step-3.7-Flash141.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Step-3.5-Flash140.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Step-3.5-Flash-Base-Midtrain138.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Qwen3.8-Flash-Next126.5 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — |
| Mixtral-8x22B-Instruct-v0.199.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Ling-3.0-flash-Sante89.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Ling-3.0-flash89.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Ling-3.0-flash-Fin89.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Ornith-1.5-122B88.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — |
| Qwen3.5-122B-A10B88.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Devstral-2-123B-Instruct-251288.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — |
| Ling-3.0-flash-VL88.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| NVIDIA-Nemotron-3-Super-120B-A12B-BF1687.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Mistral-Small-4-119B-260384.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Youtu-LLM-A7B-Base83.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Laguna-S-2.183.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| gpt-oss-120b82.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| c4ai-command-a-03-202578.4 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — |
| GLM-4.5-Air78.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Llama-4-Scout-17B-16E-Instruct76.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Llama-4-Scout-17B-16E76.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| GLM-4.5V76.1 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| GLM-4.6V76.1 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Ling-2.6-flash75.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| sarvam-105b74.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Ling-flash-2.072.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| LLaDA2.1-flash72.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Ring-flash-2.072.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| LLaDA2.2-flash72.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Solar-Open-100B72.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Qwen3-Next-80B-A3B-Instruct57.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Qwen3-Next-80B-A3B-Thinking57.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| AliceAI-Foundation-80B-A3B-Base57.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Hunyuan-A13B-Instruct57.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Qwen3-Coder-Next56.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Kolibri-155.5 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — |
| Qwen2.5-VL-72B-Instruct52.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — |
| UI-TARS-72B-DPO52.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — |
| Qwen2.5-72B-Instruct51.7 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — |
| Apertus-70B-Instruct-250950.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — |
| Apertus-70B-250950.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — |
| Llama-3.3-70B-Instruct50.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — |
| DeepSeek-R1-Distill-Llama-70B50.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — |
| Llama-3.1-70B50.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — |
| Hermes-2-Theta-Llama-3-70B50.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — |
| Meta-Llama-3.1-70B-Instruct50.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — |
| LongCat-Flash-Lite49.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — |
| AI21-Jamba2-Mini37.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — |
| Llama-3_1-Nemotron-51B-Instruct36.9 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — |
| Llama-3_3-Nemotron-Super-49B-v1_535.8 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — |
| Llama-3_3-Nemotron-Super-49B-v135.8 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — |
| Phi-3.5-MoE-instruct30.2 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 381 |
| GRIN-MoE30.2 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 381 |
| ALIA-40b29.2 GB at Q4 | Tight | Won’t fit | Won’t fit | 44–62 |
| IQuest-Coder-V1-40B-Loop-Instruct28.7 GB at Q4 | Fits | Won’t fit | Won’t fit | 45–63 |
| IQuest-Coder-V1-40B-Instruct28.7 GB at Q4 | Fits | Won’t fit | Won’t fit | 45–63 |
| Recursive Flint28.7 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 1006 |
| K2-Horizon-MoVA-36B-A4B27.1 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 628 |
| Seed-OSS-36B-Instruct26.2 GB at Q4 | Fits | Won’t fit | Won’t fit | 49–69 |
| Seed-OSS-36B-Base-woSyn26.2 GB at Q4 | Fits | Won’t fit | Won’t fit | 49–69 |
| Intern-S2-Preview26.2 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 |
| Ornith-1.5-35B-A3B26.1 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 |
| Sage-A1.526.1 GB at Q4 | Fits | Won’t fit | Won’t fit | 49–70 |
| Qwen3.6-35B-A3B26.1 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 |
| Qwen3.5-35B-A3B26.1 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 |
| Apex-35B-V1.026.1 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 |
| MiniCPM-V-4.7-35B-A3B25.5 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 |
| MemT-1.0-Nano25.5 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 |
| Agents-A125.5 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 |
| Nex-N2.5-mini25.5 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 |
| Nex-N2-mini25.5 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 |
| Axion-1.0-35B25.5 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 |
| NorthCUA-Mini25.5 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 |
| Clover-35B-A3B-Preview25.2 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 |
| Qwen-AgentWorld-35B-A3B25.2 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 |
| KAT-Coder-V2.5-Dev25.2 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 |
| EXAONE-4.5-33B24.9 GB at Q4 | Fits | Won’t fit | Won’t fit | 52–73 |
| Falcon-H1-34B-Instruct24.5 GB at Q4 | Fits | Won’t fit | Won’t fit | 53–75 |
| Qwen2.5-VL-32B-Instruct24.3 GB at Q4 | Fits | Won’t fit | Won’t fit | 53–75 |
| Laguna-XS.224.3 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 |
| Qwen3-VL-32B-Instruct24.3 GB at Q4 | Fits | Won’t fit | Won’t fit | 53–75 |
| HyperCLOVAX-SEED-Think-32B24.2 GB at Q4 | Fits | Won’t fit | Won’t fit | 53–75 |
| FlexOlmo-7x7B-1T24.2 GB at Q4 | Fits | Won’t fit | Won’t fit | 53–76 |
| GLM-Z1-Rumination-32B-041424.1 GB at Q4 | Fits | Won’t fit | Won’t fit | 54–76 |
| Nanbeige4.3-33B24.1 GB at Q4 | Fits | Won’t fit | Won’t fit | 54–76 |
| Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF1624.0 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 |
| Qwen2.5-Coder-32B-Instruct23.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 54–77 |
| DeepSeek-R1-Distill-Qwen-32B23.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 54–77 |
| Qwen2.5-32B-Instruct23.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 54–77 |
| QwQ-32B23.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 54–77 |
| QwQ-32B-Preview23.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 54–77 |
| Qwen2.5-32B23.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 54–77 |
| Qwen2.5-Coder-32B23.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 54–77 |
| Qwen3-32B23.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 54–77 |
| GLM-Z1-32B-041423.7 GB at Q4 | Fits | Won’t fit | Won’t fit | 54–77 |
| GLM-4-32B-041423.7 GB at Q4 | Fits | Won’t fit | Won’t fit | 54–77 |
| OLMo-2-0325-32B-Instruct23.5 GB at Q4 | Fits | Won’t fit | Won’t fit | 55–78 |
| OLMo-2-0325-32B23.5 GB at Q4 | Fits | Won’t fit | Won’t fit | 55–78 |
| Olmo-3-32B-Think23.5 GB at Q4 | Fits | Won’t fit | Won’t fit | 55–78 |
| Olmo-3-1125-32B23.5 GB at Q4 | Fits | Won’t fit | Won’t fit | 55–78 |
| Olmo-3.1-32B-Instruct23.5 GB at Q4 | Fits | Won’t fit | Won’t fit | 55–78 |
| Olmo-3.1-32B-Think23.5 GB at Q4 | Fits | Won’t fit | Won’t fit | 55–78 |
| Olmo-3.1-32B-Instruct-DPO23.5 GB at Q4 | Fits | Won’t fit | Won’t fit | 55–78 |
| granite-4.0-h-small23.5 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 279 |
| sarvam-30b23.4 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 1047 |
| EXAONE-4.0-32B23.3 GB at Q4 | Fits | Won’t fit | Won’t fit | 55–79 |
| EXAONE-4.0.1-32B23.3 GB at Q4 | Fits | Won’t fit | Won’t fit | 55–79 |
| EXAONE-3.5-32B-Instruct23.3 GB at Q4 | Fits | Won’t fit | Won’t fit | 55–79 |
| EXAONE-Deep-32B23.3 GB at Q4 | Fits | Won’t fit | Won’t fit | 55–79 |
| NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF1623.0 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 |
| NVIDIA-Nemotron-3-Nano-30B-A3B-BF1623.0 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 |
| Nemotron-Cascade-2-30B-A3B23.0 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 |
| Gemma 4 31B22.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 57–80 |
| gemma-4-31B22.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 57–80 |
| GLM-4.7-Flash22.8 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 |
| Xing4.0-29B-A4B22.8 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 628 |
| Xing4.0-29B-Intent22.8 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 628 |
| Qwen3-VL-30B-A3B-Instruct22.7 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 |
| Qwen3-VL-30B-A3B-Thinking22.7 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 |
| UI-Venus-1.5-30B-A3B22.7 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 |
| kanana-2-30b-a3b-instruct-260122.4 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 |
| kanana-2-30b-a3b-instruct22.4 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 |
| kanana-2-30b-a3b-thinking-260122.4 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 |
| Qwen3-30B-A3B22.3 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 |
| Qwen3-Coder-30B-A3B-Instruct22.3 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 |
| Qwen3-30B-A3B-Instruct-250722.3 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 |
| Qwen3-30B-A3B-Thinking-250722.3 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 |
| Tongyi-DeepResearch-30B-A3B22.3 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 |
| Rubicon-Preview22.3 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 |
| North-Mini-Code-1.022.3 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 |
| Hy-Memory-30B-A3B22.0 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 |
| Hy-MT2-30B-A3B22.0 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 |
| granite-switch-4.1-30b21.9 GB at Q4 | Fits | Won’t fit | Won’t fit | 59–84 |
| Muse-Glimmer-30B21.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 60–84 |
| ERNIE-4.5-VL-28B-A3B-Thinking21.7 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 |
| ERNIE-4.5-VL-28B-A3B-PT21.5 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 |
| granite-4.2-30b21.4 GB at Q4 | Fits | Won’t fit | Won’t fit | 61–86 |
| granite-4.1-30b21.1 GB at Q4 | Fits | Won’t fit | Won’t fit | 61–87 |
| Raon-1 mini preview21.1 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 584 |
| Qwen3.8-27B20.4 GB at Q4 | Fits | Won’t fit | Won’t fit | 64–90 |
| Tess-4.5-27B20.4 GB at Q4 | Fits | Won’t fit | Won’t fit | 64–90 |
| Qwen3.6-27B20.4 GB at Q4 | Fits | Won’t fit | Won’t fit | 64–90 |
| Qwen3.5-27B20.4 GB at Q4 | Fits | Won’t fit | Won’t fit | 64–90 |
| gemma-3-27b-it20.1 GB at Q4 | Fits | Won’t fit | Won’t fit | 65–92 |
| Arete-27B20.1 GB at Q4 | Fits | Won’t fit | Won’t fit | 65–92 |
| gemma-2-27b-it20.0 GB at Q4 | Fits | Won’t fit | Won’t fit | 65–92 |
| gemma-2-27b20.0 GB at Q4 | Fits | Won’t fit | Won’t fit | 65–92 |
| Qwen3.8-27B-Longbook27-v219.9 GB at Q4 | Fits | Won’t fit | Won’t fit | 66–93 |
| medgemma-27b-text-it19.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 66–93 |
| Hemmingway-1.519.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 66–93 |
| Trinity-Mini19.2 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 |
| diffusiongemma-26B-A4B-it19.0 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 628 |
| Gemma 4 26B A4B19.0 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 661 |
| gemma-4-26B-A4B19.0 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 628 |
| Voxtral-Small-24B-250717.9 GB at Q4 | Fits | Tight | Won’t fit | 73–104 |
| Mistral-Small-3.2-24B-Instruct-250617.7 GB at Q4 | Fits | Tight | Won’t fit | 74–105 |
| Mistral-Small-3.1-24B-Instruct-250317.7 GB at Q4 | Fits | Tight | Won’t fit | 74–105 |
| LFM2.5-24B-A2B17.7 GB at Q4 · MoE | Fits | Tight | Won’t fit | up to 1257 |
| LFM2-24B-A2B17.6 GB at Q4 · MoE | Fits | Tight | Won’t fit | up to 1256 |
| Mistral-Small-24B-Instruct-250117.4 GB at Q4 | Fits | Tight | Won’t fit | 75–107 |
| EuroLLM-22B-Instruct-251216.8 GB at Q4 | Fits | Fits | Won’t fit | 78–111 |
| EuroLLM-22B-251216.8 GB at Q4 | Fits | Fits | Won’t fit | 78–111 |
| solar-pro-preview-instruct16.4 GB at Q4 | Fits | Fits | Won’t fit | 80–113 |
| ERNIE-4.5-21B-A3B-PT16.3 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 837 |
| ERNIE-4.5-21B-A3B-Thinking16.2 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 837 |
| gpt-oss-20b15.6 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 698 |
| reka-flash-315.6 GB at Q4 | Fits | Fits | Won’t fit | 85–120 |
| maple-preview15.1 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 2511 |
| internlm2_5-20b-chat14.8 GB at Q4 | Fits | Fits | Won’t fit | 89–127 |
| Groot-19B-A3B-26102314.5 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 837 |
| Ling-Coder-lite12.7 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 913 |
| Ring-lite-distill-preview12.7 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 913 |
| Ling-lite12.7 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 913 |
| Ling-lite-1.5-250712.7 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 913 |
| Ling-lite-1.512.7 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 913 |
| Ring-lite12.7 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 913 |
| Ring-mini-linear-2.012.5 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 1571 |
| Kimi-VL-A3B-Instruct12.4 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 838 |
| Kimi-VL-A3B-Thinking12.4 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 838 |
| Kimi-VL-A3B-Thinking-250612.4 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 838 |
| LLaDA2.1-mini12.3 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 1795 |
| LLaDA2.0-mini12.3 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 1795 |
| Ling-mini-2.012.3 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 1795 |
| Ring-mini-2.012.3 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 1795 |
| LLaDA2.2-mini12.3 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 1795 |
| LLaDA2.0-mini-preview12.3 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 1795 |
| Moonlight-16B-A3B-Instruct12.1 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 837 |
| Moonlight-16B-A3B12.1 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 837 |
| Instella-MoE-16B-A3B-Think12.1 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 838 |
| DeepSeek-Coder-V2-Lite-Instruct12.0 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 1047 |
| kanana-1.5-15.7b-a3b-instruct11.9 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 838 |
| Phi-4-reasoning-vision-15B11.5 GB at Q4 | Fits | Fits | Won’t fit | 117–166 |
| Apriel-Nemotron-15b-Thinker11.4 GB at Q4 | Fits | Fits | Won’t fit | 118–168 |
| Apriel-1.5-15b-Thinker11.4 GB at Q4 | Fits | Fits | Won’t fit | 119–169 |
| Apriel-1.6-15b-Thinker11.4 GB at Q4 | Fits | Fits | Won’t fit | 119–169 |
| Carbon-X (DNA)11.3 GB at Q4 | Fits | Fits | Won’t fit | 120–170 |
| Qwen2.5-Coder-14B-Instruct11.3 GB at Q4 | Fits | Fits | Won’t fit | 120–170 |
| DeepSeek-R1-Distill-Qwen-14B11.3 GB at Q4 | Fits | Fits | Won’t fit | 120–170 |
| Qwen2.5-14B-Instruct11.3 GB at Q4 | Fits | Fits | Won’t fit | 120–170 |
| Qwen2.5-14B11.3 GB at Q4 | Fits | Fits | Won’t fit | 120–170 |
| Qwen2.5-14B-Instruct-1M11.3 GB at Q4 | Fits | Fits | Won’t fit | 120–170 |
| Qwen2.5-Coder-14B11.3 GB at Q4 | Fits | Fits | Won’t fit | 120–170 |
| Qwen3-14B11.3 GB at Q4 | Fits | Fits | Won’t fit | 120–170 |
| JanusCoder-14B11.3 GB at Q4 | Fits | Fits | Won’t fit | 120–170 |
| HyperCLOVAX-SEED-Think-14B11.3 GB at Q4 | Fits | Fits | Won’t fit | 120–170 |
| phi-411.2 GB at Q4 | Fits | Fits | Won’t fit | 121–171 |
| Phi-4-reasoning11.2 GB at Q4 | Fits | Fits | Won’t fit | 121–171 |
| Phi-4-reasoning-plus11.2 GB at Q4 | Fits | Fits | Won’t fit | 121–171 |
| OLMo-2-1124-13B-Instruct10.6 GB at Q4 | Fits | Fits | Won’t fit | 129–183 |
| Mistral-Nemo-Instruct-24079.5 GB at Q4 | Fits | Fits | Tight | 145–205 |
| gemma-3-12b-it9.5 GB at Q4 | Fits | Fits | Tight | 146–206 |
| gemma-3-12b-pt9.5 GB at Q4 | Fits | Fits | Tight | 146–206 |
| Mellum2.1-12B-A2.5B-Thinking9.5 GB at Q4 · MoE | Fits | Fits | Tight | up to 1005 |
| Mellum2-12B-A2.5B-Thinking9.5 GB at Q4 · MoE | Fits | Fits | Tight | up to 1005 |
| Mellum2-12B-A2.5B-Instruct9.5 GB at Q4 · MoE | Fits | Fits | Tight | up to 1005 |
| Mellum2-12B-A2.5B-Thinking-SFT9.5 GB at Q4 · MoE | Fits | Fits | Tight | up to 1005 |
| Mellum2.1-12B-A2.5B-Thinking-MTP9.5 GB at Q4 · MoE | Fits | Fits | Tight | up to 1005 |
| Gemma 4 12B9.3 GB at Q4 | Fits | Fits | Fits | 148–210 |
| HyperCLOVAX-SEED-Omni-8B8.5 GB at Q4 | Fits | Fits | Fits | 165–234 |
| Llama-3.2-11B-Vision-Instruct8.4 GB at Q4 | Fits | Fits | Fits | 166–235 |
| Llama-3.2-11B-Vision8.4 GB at Q4 | Fits | Fits | Fits | 167–236 |
| Falcon3-10B-Instruct8.2 GB at Q4 | Fits | Fits | Fits | 172–244 |
| GLM-4.1V-9B-Thinking8.2 GB at Q4 | Fits | Fits | Fits | 172–244 |
| GLM-4.6V-Flash8.2 GB at Q4 | Fits | Fits | Fits | 172–244 |
| GLM-4.1V-9B-Base8.2 GB at Q4 | Fits | Fits | Fits | 172–244 |
| Glyph8.2 GB at Q4 | Fits | Fits | Fits | 172–244 |
| INTELLECT-1-Instruct8.1 GB at Q4 | Fits | Fits | Fits | 174–246 |
| INTELLECT-18.1 GB at Q4 | Fits | Fits | Fits | 174–246 |
| ZAYA1-VL-8B7.8 GB at Q4 | Fits | Fits | Fits | 182–258 |
| SenseNova-Loop-9B-Preview7.7 GB at Q4 | Fits | Fits | Fits | 184–260 |
| Ornith-1.5-9B7.7 GB at Q4 | Fits | Fits | Fits | 184–260 |
| Qwen3.5-9B7.7 GB at Q4 | Fits | Fits | Fits | 184–260 |
| MiniCPM-SALA7.6 GB at Q4 | Fits | Fits | Fits | 187–265 |
| NorthCUA-Nano7.6 GB at Q4 | Fits | Fits | Fits | 188–267 |
| GLM-4-9B-04147.6 GB at Q4 | Fits | Fits | Fits | 189–267 |
| GLM-Z1-9B-04147.6 GB at Q4 | Fits | Fits | Fits | 189–267 |
| codegeex4-all-9b7.6 GB at Q4 | Fits | Fits | Fits | 189–267 |
| glm-4-9b-chat-hf7.6 GB at Q4 | Fits | Fits | Fits | 189–267 |
| moondream3-preview7.5 GB at Q4 | Fits | Fits | Fits | 191–271 |
| gemma-2-9b-it7.4 GB at Q4 | Fits | Fits | Fits | 192–272 |
| gemma-2-9b7.4 GB at Q4 | Fits | Fits | Fits | 192–272 |
| Gemma-SEA-LION-v3-9B-IT7.4 GB at Q4 | Fits | Fits | Fits | 192–272 |
| EuroLLM-9B-Instruct-25127.4 GB at Q4 | Fits | Fits | Fits | 194–275 |
| NVIDIA-Nemotron-Nano-9B-v27.2 GB at Q4 | Fits | Fits | Fits | 200–283 |
| ZAYA1-base7.2 GB at Q4 | Fits | Fits | Fits | 201–284 |
| Yi-Coder-9B-Chat7.2 GB at Q4 | Fits | Fits | Fits | 201–285 |
| Yi-Coder-9B7.2 GB at Q4 | Fits | Fits | Fits | 201–285 |
| internlm3-8b-instruct7.1 GB at Q4 | Fits | Fits | Fits | 201–285 |
| granite-4.1-8b7.1 GB at Q4 | Fits | Fits | Fits | 202–286 |
| granite-4.2-8b7.1 GB at Q4 | Fits | Fits | Fits | 202–286 |
| granite-switch-4.1-8b7.1 GB at Q4 | Fits | Fits | Fits | 202–286 |
| Qwen3-VL-8B-Instruct7.1 GB at Q4 | Fits | Fits | Fits | 202–287 |
| Qwen3-VL-8B-Thinking7.1 GB at Q4 | Fits | Fits | Fits | 202–287 |
| UI-Venus-1.5-8B7.1 GB at Q4 | Fits | Fits | Fits | 202–287 |
| Llama-3.1-Nemotron-Nano-VL-8B-V17.1 GB at Q4 | Fits | Fits | Fits | 203–288 |
| MiniCPM-V-4_57.1 GB at Q4 | Fits | Fits | Fits | 204–289 |
| aya-vision-8b7.0 GB at Q4 | Fits | Fits | Fits | 205–291 |
| Intern-S1-mini7.0 GB at Q4 | Fits | Fits | Fits | 208–294 |
| Nemotron-Labs-Diffusion-8B-Base6.9 GB at Q4 | Fits | Fits | Fits | 209–296 |
| LFM2.5-8B-A1B6.9 GB at Q4 · MoE | Fits | Fits | Fits | up to 2512 |
| Mistral-NeMo-Minitron-8B-Base6.9 GB at Q4 | Fits | Fits | Fits | 211–299 |
| LFM2-8B-A1B6.8 GB at Q4 · MoE | Fits | Fits | Fits | up to 2513 |
| rnj-1-instruct6.8 GB at Q4 | Fits | Fits | Fits | 213–302 |
| MiMo-VL-7B-RL-25086.8 GB at Q4 | Fits | Fits | Fits | 214–302 |
| MiMo-VL-7B-RL6.8 GB at Q4 | Fits | Fits | Fits | 214–302 |
| MiMo-Embodied-7B6.8 GB at Q4 | Fits | Fits | Fits | 214–302 |
| MiMo-VL-7B-SFT6.8 GB at Q4 | Fits | Fits | Fits | 214–302 |
| Qwen2.5-VL-7B-Instruct6.8 GB at Q4 | Fits | Fits | Fits | 214–303 |
| UI-TARS-1.5-7B6.8 GB at Q4 | Fits | Fits | Fits | 214–303 |
| Fara-7B6.8 GB at Q4 | Fits | Fits | Fits | 214–303 |
| UI-Venus-Ground-7B6.8 GB at Q4 | Fits | Fits | Fits | 214–303 |
| Qwen2-VL-7B-Instruct6.8 GB at Q4 | Fits | Fits | Fits | 214–303 |
| UI-TARS-7B-DPO6.8 GB at Q4 | Fits | Fits | Fits | 214–303 |
| UI-TARS-7B-SFT6.8 GB at Q4 | Fits | Fits | Fits | 214–303 |
| Seed-Coder-8B-Instruct6.8 GB at Q4 | Fits | Fits | Fits | 215–305 |
| Seed-Coder-8B-Reasoning6.8 GB at Q4 | Fits | Fits | Fits | 215–305 |
| Stable-DiffCoder-8B-Instruct6.8 GB at Q4 | Fits | Fits | Fits | 215–305 |
| Qwen3-8B6.7 GB at Q4 | Fits | Fits | Fits | 217–307 |
| DeepSeek-R1-0528-Qwen3-8B6.7 GB at Q4 | Fits | Fits | Fits | 217–307 |
| Qwen3-8B-Base6.7 GB at Q4 | Fits | Fits | Fits | 217–307 |
| WeDLM-8B-Instruct6.7 GB at Q4 | Fits | Fits | Fits | 217–307 |
| PaCoRe-8B6.7 GB at Q4 | Fits | Fits | Fits | 217–307 |
| MiniCPM4-8B6.7 GB at Q4 | Fits | Fits | Fits | 217–307 |
| MiniCPM4.1-8B6.7 GB at Q4 | Fits | Fits | Fits | 217–307 |
| AgentCPM-Report6.7 GB at Q4 | Fits | Fits | Fits | 217–307 |
| MiniCPM4-MCP6.7 GB at Q4 | Fits | Fits | Fits | 217–307 |
| granite-3.3-8b-instruct6.7 GB at Q4 | Fits | Fits | Fits | 217–307 |
| granite-3.1-8b-instruct6.7 GB at Q4 | Fits | Fits | Fits | 217–307 |
| granite-3.2-8b-instruct6.7 GB at Q4 | Fits | Fits | Fits | 217–307 |
| granite-3.0-8b-instruct6.7 GB at Q4 | Fits | Fits | Fits | 217–307 |
| Apertus-8B-Instruct-25096.6 GB at Q4 | Fits | Fits | Fits | 220–312 |
| Apertus-8B-25096.6 GB at Q4 | Fits | Fits | Fits | 220–312 |
| Llama-3.1-Tulu-3-8B6.6 GB at Q4 | Fits | Fits | Fits | 221–313 |
| Llama-3.1-Tulu-3-8B-DPO6.6 GB at Q4 | Fits | Fits | Fits | 221–313 |
| Llama-3.1-Tulu-3.1-8B6.6 GB at Q4 | Fits | Fits | Fits | 221–313 |
| kanana-1.5-8b-instruct-25056.6 GB at Q4 | Fits | Fits | Fits | 221–313 |
| Llama-3.1-8B-Instruct6.6 GB at Q4 | Fits | Fits | Fits | 221–313 |
| Llama-3.1-8B6.6 GB at Q4 | Fits | Fits | Fits | 221–313 |
| DeepSeek-R1-Distill-Llama-8B6.6 GB at Q4 | Fits | Fits | Fits | 221–313 |
| Meta-Llama-3.1-8B-Instruct6.6 GB at Q4 | Fits | Fits | Fits | 221–313 |
| L3-8B-Stheno-v3.26.6 GB at Q4 | Fits | Fits | Fits | 221–313 |
| Llama-3.1-Nemotron-Nano-8B-v16.6 GB at Q4 | Fits | Fits | Fits | 221–313 |
| Meta-Llama-3.1-8B6.6 GB at Q4 | Fits | Fits | Fits | 221–313 |
| LongWriter-llama3.1-8b6.6 GB at Q4 | Fits | Fits | Fits | 221–313 |
| Hy-MT2-7B6.6 GB at Q4 | Fits | Fits | Fits | 221–313 |
| Nemotron 3.5 Bolt E4B6.6 GB at Q4 | Fits | Fits | Fits | 222–314 |
| Gemma 4 E4B6.6 GB at Q4 | Fits | Fits | Fits | 222–314 |
| Ling-3.0-tiny6.5 GB at Q4 · MoE | Fits | Fits | Fits | up to 1933 |
| MiMo-7B-RL6.5 GB at Q4 | Fits | Fits | Fits | 226–321 |
| MiMo-7B-Base6.5 GB at Q4 | Fits | Fits | Fits | 226–321 |
| MiMo-7B-RL-05306.5 GB at Q4 | Fits | Fits | Fits | 226–321 |
| MiMo-7B-SFT6.5 GB at Q4 | Fits | Fits | Fits | 226–321 |
| EXAONE-3.5-7.8B-Instruct6.5 GB at Q4 | Fits | Fits | Fits | 227–321 |
| EXAONE-Deep-7.8B6.5 GB at Q4 | Fits | Fits | Fits | 227–321 |
| salamandra-7b-instruct6.4 GB at Q4 | Fits | Fits | Fits | 228–323 |
| salamandra-7b6.4 GB at Q4 | Fits | Fits | Fits | 228–323 |
| salamandra-7b-instruct-26066.4 GB at Q4 | Fits | Fits | Fits | 228–323 |
| FastVLM-7B6.4 GB at Q4 | Fits | Fits | Fits | 228–324 |
| Molmo2-O-7B6.4 GB at Q4 | Fits | Fits | Fits | 229–324 |
| internlm2_5-7b-chat6.4 GB at Q4 | Fits | Fits | Fits | 229–325 |
| internlm2_5-7b-chat-1m6.4 GB at Q4 | Fits | Fits | Fits | 229–325 |
| Phi-mini-MoE-instruct6.3 GB at Q4 · MoE | Fits | Fits | Fits | up to 1047 |
| Qwen2.5-Coder-7B-Instruct6.3 GB at Q4 | Fits | Fits | Fits | 233–330 |
| DeepSeek-R1-Distill-Qwen-7B6.3 GB at Q4 | Fits | Fits | Fits | 233–330 |
| Qwen2.5-7B-Instruct6.3 GB at Q4 | Fits | Fits | Fits | 233–330 |
| Qwen2.5-7B6.3 GB at Q4 | Fits | Fits | Fits | 233–330 |
| Qwen2-7B-Instruct6.3 GB at Q4 | Fits | Fits | Fits | 233–330 |
| Qwen2.5-Coder-7B6.3 GB at Q4 | Fits | Fits | Fits | 233–330 |
| Qwen2-7B6.3 GB at Q4 | Fits | Fits | Fits | 233–330 |
| Qwen2.5-7B-Instruct-1M6.3 GB at Q4 | Fits | Fits | Fits | 233–330 |
| Qwen2.5-Math-7B6.3 GB at Q4 | Fits | Fits | Fits | 233–330 |
| Qwen2.5-Math-7B-Instruct6.3 GB at Q4 | Fits | Fits | Fits | 233–330 |
| Marco-o16.3 GB at Q4 | Fits | Fits | Fits | 233–330 |
| SeaLLMs-v3-7B-Chat6.3 GB at Q4 | Fits | Fits | Fits | 233–330 |
| Arcee-Spark6.3 GB at Q4 | Fits | Fits | Fits | 233–330 |
| Falcon-H1-7B-Instruct6.3 GB at Q4 | Fits | Fits | Fits | 234–331 |
| Falcon-H1R-7B6.3 GB at Q4 | Fits | Fits | Fits | 234–331 |
| starvector-8b-im2svg6.2 GB at Q4 | Fits | Fits | Fits | 236–335 |
| Falcon3-7B-Instruct6.2 GB at Q4 | Fits | Fits | Fits | 238–337 |
| Olmo-Hybrid-7B6.2 GB at Q4 | Fits | Fits | Fits | 239–338 |
| LLaDA-MoE-7B-A1B-Base6.1 GB at Q4 · MoE | Fits | Fits | Fits | up to 2513 |
| Zamba2-7B-Instruct6.1 GB at Q4 | Fits | Fits | Fits | 241–342 |
| OLMo-2-1124-7B-Instruct6.1 GB at Q4 | Fits | Fits | Fits | 243–344 |
| Olmo-3-7B-Think6.1 GB at Q4 | Fits | Fits | Fits | 243–344 |
| Olmo-3-7B-Instruct6.1 GB at Q4 | Fits | Fits | Fits | 243–344 |
| Olmo-3-1025-7B6.1 GB at Q4 | Fits | Fits | Fits | 243–344 |
| Olmo-3-7B-Instruct-SFT6.1 GB at Q4 | Fits | Fits | Fits | 243–344 |
| Olmo-3-7B-Think-SFT6.1 GB at Q4 | Fits | Fits | Fits | 243–344 |
| Olmo-3-7B-Instruct-DPO6.1 GB at Q4 | Fits | Fits | Fits | 243–344 |
| Olmo-3-7B-RL-Zero-Math6.1 GB at Q4 | Fits | Fits | Fits | 243–344 |
| Olmo-3.1-7B-RL-Zero-Math6.1 GB at Q4 | Fits | Fits | Fits | 243–344 |
| Olmo-3-7B-Think-DPO6.1 GB at Q4 | Fits | Fits | Fits | 243–344 |
| Mistral-7B-Instruct-v0.36.1 GB at Q4 | Fits | Fits | Fits | 245–347 |
| granite-4.0-h-tiny5.8 GB at Q4 · MoE | Fits | Fits | Fits | up to 2513 |
| OLMoE-1B-7B-0924-Instruct5.8 GB at Q4 · MoE | Fits | Fits | Fits | up to 1933 |
| OLMoE-1B-7B-09245.8 GB at Q4 · MoE | Fits | Fits | Fits | up to 1933 |
| OLMoE-1B-7B-0125-Instruct5.8 GB at Q4 · MoE | Fits | Fits | Fits | up to 1933 |
| OLMoE-1B-7B-01255.8 GB at Q4 · MoE | Fits | Fits | Fits | up to 1933 |
| OLMo-7B-0724-hf5.8 GB at Q4 | Fits | Fits | Fits | 257–365 |
| granite-4.0-tiny-preview5.7 GB at Q4 · MoE | Fits | Fits | Fits | up to 2512 |
| YuE-s1-7B-anneal-en-cot5.3 GB at Q4 | Fits | Fits | Fits | 285–404 |
| Trinity-Nano-Preview5.3 GB at Q4 · MoE | Fits | Fits | Fits | up to 2512 |
| Trinity-Nano-Base5.3 GB at Q4 · MoE | Fits | Fits | Fits | up to 2512 |
| gemma-3n-E2B-it4.8 GB at Q4 | Fits | Fits | Fits | 326–462 |
| Youtu-VL-4B-Instruct4.7 GB at Q4 | Fits | Fits | Fits | 332–470 |
| Gemma 4 E2B4.6 GB at Q4 | Fits | Fits | Fits | 346–490 |
| Molmo2-ER4.4 GB at Q4 | Fits | Fits | Fits | 366–518 |
| Apriel-5B-Instruct4.4 GB at Q4 | Fits | Fits | Fits | 367–520 |
| WeVisOne-VL-4B4.4 GB at Q4 | Fits | Fits | Fits | 367–520 |
| Mage-VL4.3 GB at Q4 | Fits | Fits | Fits | 374–530 |
| Mage-VL-Cowork4.3 GB at Q4 | Fits | Fits | Fits | 374–530 |
| Qwen3.5-4B4.2 GB at Q4 | Fits | Fits | Fits | 381–539 |
| S5-nano4.2 GB at Q4 | Fits | Fits | Fits | 381–539 |
| AFM-4.5B4.2 GB at Q4 | Fits | Fits | Fits | 384–544 |
| Llama-3.1-Minitron-4B-Width-Base4.1 GB at Q4 | Fits | Fits | Fits | 393–557 |
| Qwen3-VL-4B-Instruct4.1 GB at Q4 | Fits | Fits | Fits | 400–566 |
| CapRL-Qwen3VL-4B4.1 GB at Q4 | Fits | Fits | Fits | 400–566 |
| glm-edge-4b-chat4.0 GB at Q4 | Fits | Fits | Fits | 410–581 |
| gemma-3-4b-it4.0 GB at Q4 | Fits | Fits | Fits | 412–584 |
| medgemma-4b-it4.0 GB at Q4 | Fits | Fits | Fits | 412–584 |
| medgemma-1.5-4b-it4.0 GB at Q4 | Fits | Fits | Fits | 412–584 |
| gemma-3-4b-pt4.0 GB at Q4 | Fits | Fits | Fits | 412–584 |
| Nanbeige4.2-3B3.9 GB at Q4 | Fits | Fits | Fits | 425–603 |
| Phi-3.5-vision-instruct3.9 GB at Q4 | Fits | Fits | Fits | 428–606 |
| Spark-X2.6-4B3.9 GB at Q4 | Fits | Fits | Fits | 431–611 |
| Spark-X2.5-4B3.9 GB at Q4 | Fits | Fits | Fits | 431–611 |
| POINTS-Reader3.9 GB at Q4 | Fits | Fits | Fits | 432–611 |
| MiniCPM-V-43.8 GB at Q4 | Fits | Fits | Fits | 437–619 |
| Qwen3-4B3.8 GB at Q4 | Fits | Fits | Fits | 441–625 |
| Qwen3-4B-Instruct-25073.8 GB at Q4 | Fits | Fits | Fits | 441–625 |
| Qwen3-4B-Thinking-25073.8 GB at Q4 | Fits | Fits | Fits | 441–625 |
| Mellum-4b-base3.8 GB at Q4 | Fits | Fits | Fits | 441–625 |
| granite-4.0-3b-vision3.8 GB at Q4 | Fits | Fits | Fits | 444–629 |
| granite-vision-4.1-4b3.8 GB at Q4 | Fits | Fits | Fits | 444–629 |
| Nemotron Labs Dory 1.0 4B3.8 GB at Q4 | Fits | Fits | Fits | 446–632 |
| NVIDIA-Nemotron-3-Nano-4B-BF163.8 GB at Q4 | Fits | Fits | Fits | 446–632 |
| Nanbeige4.1-3B3.7 GB at Q4 | Fits | Fits | Fits | 451–639 |
| Nanbeige4-3B-Thinking-25113.7 GB at Q4 | Fits | Fits | Fits | 451–639 |
| Phi-4-mini-flash-reasoning3.7 GB at Q4 | Fits | Fits | Fits | 460–652 |
| Phi-4-mini-instruct3.7 GB at Q4 | Fits | Fits | Fits | 462–655 |
| Phi-4-mini-reasoning3.7 GB at Q4 | Fits | Fits | Fits | 462–655 |
| Nemotron-Labs-Diffusion-3B3.7 GB at Q4 | Fits | Fits | Fits | 463–656 |
| Phi-3.5-mini-instruct3.7 GB at Q4 | Fits | Fits | Fits | 464–658 |
| MediPhi-Instruct3.7 GB at Q4 | Fits | Fits | Fits | 464–658 |
| MediPhi3.7 GB at Q4 | Fits | Fits | Fits | 464–658 |
| MediPhi-Clinical3.7 GB at Q4 | Fits | Fits | Fits | 464–658 |
| MediPhi-PubMed3.7 GB at Q4 | Fits | Fits | Fits | 464–658 |
| HY-Embodied-0.53.6 GB at Q4 | Fits | Fits | Fits | 469–664 |
| Phi-tiny-MoE-instruct3.6 GB at Q4 · MoE | Fits | Fits | Fits | up to 2284 |
| CapRL-3B3.6 GB at Q4 | Fits | Fits | Fits | 472–669 |
| HyperCLOVAX-SEED-Vision-Instruct-3B3.6 GB at Q4 | Fits | Fits | Fits | 477–675 |
| kanana-1.5-v-3b-instruct3.6 GB at Q4 | Fits | Fits | Fits | 484–685 |
| granite-4.2-3b3.6 GB at Q4 | Fits | Fits | Fits | 485–687 |
| kanana-2-3b-instruct3.4 GB at Q4 | Fits | Fits | Fits | 505–716 |
| granite-4.1-3b3.4 GB at Q4 | Fits | Fits | Fits | 521–738 |
| granite-4.0-micro3.4 GB at Q4 | Fits | Fits | Fits | 521–738 |
| granite-3.1-3b-a800m-instruct3.3 GB at Q4 · MoE | Fits | Fits | Fits | up to 3141 |
| Falcon3-3B-Instruct3.3 GB at Q4 | Fits | Fits | Fits | 549–778 |
| Llama-3.2-3B-Instruct3.2 GB at Q4 | Fits | Fits | Fits | 552–782 |
| Llama-3.2-3B3.2 GB at Q4 | Fits | Fits | Fits | 552–782 |
| Hermes-3-Llama-3.2-3B3.2 GB at Q4 | Fits | Fits | Fits | 552–782 |
| DeepHermes-3-Llama-3-3B-Preview3.2 GB at Q4 | Fits | Fits | Fits | 552–782 |
| AI21-Jamba-Reasoning-3B3.2 GB at Q4 | Fits | Fits | Fits | 555–786 |
| granite-4.0-h-micro3.2 GB at Q4 | Fits | Fits | Fits | 556–787 |
| Falcon-H1-3B-Instruct3.2 GB at Q4 | Fits | Fits | Fits | 563–798 |
| d1-3B3.2 GB at Q4 | Fits | Fits | Fits | 568–804 |
| LFM2.5-VL-3B3.2 GB at Q4 | Fits | Fits | Fits | 568–804 |
| Qwen2.5-3B-Instruct3.2 GB at Q4 | Fits | Fits | Fits | 575–814 |
| Qwen2.5-Coder-3B-Instruct3.2 GB at Q4 | Fits | Fits | Fits | 575–814 |
| Qwen2.5-3B3.2 GB at Q4 | Fits | Fits | Fits | 575–814 |
| Qwen2.5-Coder-3B3.2 GB at Q4 | Fits | Fits | Fits | 575–814 |
| SmolLM3-3B3.1 GB at Q4 | Fits | Fits | Fits | 577–817 |
| AI21-Jamba2-3B3.1 GB at Q4 | Fits | Fits | Fits | 585–829 |
| granite-swash-3b-a600m3.1 GB at Q4 · MoE | Fits | Fits | Fits | up to 4201 |
| granite-vision-3.2-2b3.1 GB at Q4 | Fits | Fits | Fits | 596–844 |
| granite-vision-3.1-2b-preview3.1 GB at Q4 | Fits | Fits | Fits | 596–844 |
| granite-vision-3.3-2b-chart2csv-preview3.1 GB at Q4 | Fits | Fits | Fits | 596–844 |
| LFM2.5-2.6B2.9 GB at Q4 | Fits | Fits | Fits | 658–932 |
| Zamba2-2.7B2.9 GB at Q4 | Fits | Fits | Fits | 666–944 |
| Zamba2-2.7B-instruct2.9 GB at Q4 | Fits | Fits | Fits | 666–944 |
| granite-3.0-2b-instruct2.8 GB at Q4 | Fits | Fits | Fits | 673–954 |
| gemma-2-2b-it2.8 GB at Q4 | Fits | Fits | Fits | 678–961 |
| gemma-2-2b2.8 GB at Q4 | Fits | Fits | Fits | 678–961 |
| EuroMoE-2.6B-A0.6B-Instruct-Preview2.8 GB at Q4 · MoE | Fits | Fits | Fits | up to 4187 |
| Motif-2.6B2.8 GB at Q4 | Fits | Fits | Fits | 683–967 |
| LFM2-2.6B2.8 GB at Q4 | Fits | Fits | Fits | 690–978 |
| LFM2-2.6B-Exp2.8 GB at Q4 | Fits | Fits | Fits | 690–978 |
| LFM2-2.6B-Transcript2.8 GB at Q4 | Fits | Fits | Fits | 690–978 |
| granite-3.3-2b-instruct2.8 GB at Q4 | Fits | Fits | Fits | 700–992 |
| granite-3.1-2b-instruct2.8 GB at Q4 | Fits | Fits | Fits | 700–992 |
| granite-3.2-2b-instruct2.8 GB at Q4 | Fits | Fits | Fits | 700–992 |
| MiniCPM5-2B2.8 GB at Q4 | Fits | Fits | Fits | 705–998 |
| MiniCPM5-2B-SFT2.8 GB at Q4 | Fits | Fits | Fits | 705–998 |
| MiniCPM5-2B-Midtrain2.8 GB at Q4 | Fits | Fits | Fits | 705–998 |
| sarvam-1-v0.52.7 GB at Q4 | Fits | Fits | Fits | 707–1001 |
| North-Micro-Vision-Instruct2.7 GB at Q4 | Fits | Fits | Fits | 714–1011 |
| UI-TARS-2B-SFT2.7 GB at Q4 | Fits | Fits | Fits | 726–1029 |
| WeVisOne-VL-2B2.7 GB at Q4 | Fits | Fits | Fits | 726–1029 |
| UI-Venus-1.5-2B2.7 GB at Q4 | Fits | Fits | Fits | 727–1030 |
| bitnet-b1.58-2B-4T-bf162.7 GB at Q4 | Fits | Fits | Fits | 735–1041 |
| EXAONE-3.5-2.4B-Instruct2.7 GB at Q4 | Fits | Fits | Fits | 737–1045 |
| EXAONE-Deep-2.4B2.7 GB at Q4 | Fits | Fits | Fits | 737–1045 |
| kanana-1.5-2.1b-instruct-25052.6 GB at Q4 | Fits | Fits | Fits | 765–1084 |
| Qwen3.5-2B2.6 GB at Q4 | Fits | Fits | Fits | 780–1105 |
| salamandra-2b2.6 GB at Q4 | Fits | Fits | Fits | 787–1115 |
| salamandra-2b-instruct2.6 GB at Q4 | Fits | Fits | Fits | 787–1115 |
| SmolVLM2-2.2B-Instruct2.6 GB at Q4 | Fits | Fits | Fits | 789–1118 |
| SmolVLM-Base2.6 GB at Q4 | Fits | Fits | Fits | 790–1119 |
| Qwen2-VL-2B-Instruct2.5 GB at Q4 | Fits | Fits | Fits | 803–1137 |
| LFM3-Omni-2B2.5 GB at Q4 | Fits | Fits | Fits | 818–1159 |
| granite-swash-2b2.5 GB at Q4 | Fits | Fits | Fits | 827–1172 |
| Qwen3-VL-2B-Instruct2.5 GB at Q4 | Fits | Fits | Fits | 834–1181 |
| kanana-nano-2.1b-instruct2.5 GB at Q4 | Fits | Fits | Fits | 850–1204 |
| Hy-MT2-1.8B2.4 GB at Q4 | Fits | Fits | Fits | 870–1233 |
| Qwen3-1.7B2.4 GB at Q4 | Fits | Fits | Fits | 873–1237 |
| Youtu-LLM-2B2.4 GB at Q4 | Fits | Fits | Fits | 904–1281 |
| LFM3-VL-2B2.3 GB at Q4 | Fits | Fits | Fits | 925–1310 |
| d1-2B2.3 GB at Q4 | Fits | Fits | Fits | 925–1310 |
| FastVLM-1.5B2.3 GB at Q4 | Fits | Fits | Fits | 929–1316 |
| internlm2_5-1_8b-chat2.3 GB at Q4 | Fits | Fits | Fits | 939–1330 |
| DeepSeek-R1-Distill-Qwen-1.5B2.2 GB at Q4 | Fits | Fits | Fits | 998–1414 |
| LFM3-1.7B2.2 GB at Q4 | Fits | Fits | Fits | 1026–1453 |
| Qwen3-1.7B-Base2.2 GB at Q4 | Fits | Fits | Fits | 1031–1460 |
| SmolLM2-1.7B2.2 GB at Q4 | Fits | Fits | Fits | 1036–1468 |
| SmolLM-1.7B2.2 GB at Q4 | Fits | Fits | Fits | 1036–1468 |
| Spark-X2.6-1.7B2.2 GB at Q4 | Fits | Fits | Fits | 1039–1471 |
| Falcon3-1B-Instruct2.2 GB at Q4 | Fits | Fits | Fits | 1062–1505 |
| EuroLLM-1.7B-Instruct2.2 GB at Q4 | Fits | Fits | Fits | 1070–1516 |
| granite-4.0-1b2.1 GB at Q4 | Fits | Fits | Fits | 1087–1540 |
| LFM2.5-VL-1.6B2.1 GB at Q4 | Fits | Fits | Fits | 1111–1574 |
| glm-edge-1.5b-chat2.1 GB at Q4 | Fits | Fits | Fits | 1113–1577 |
| LFM2-VL-1.6B2.1 GB at Q4 | Fits | Fits | Fits | 1119–1585 |
| Falcon-H1-1.5B-Deep-Instruct2.1 GB at Q4 | Fits | Fits | Fits | 1141–1616 |
| Falcon-H1-1.5B-Instruct2.1 GB at Q4 | Fits | Fits | Fits | 1141–1616 |
| MiniCPM-V-4.7-1B2.1 GB at Q4 | Fits | Fits | Fits | 1141–1616 |
| Qwen2.5-1.5B-Instruct2.1 GB at Q4 | Fits | Fits | Fits | 1149–1628 |
| Qwen2.5-1.5B2.1 GB at Q4 | Fits | Fits | Fits | 1149–1628 |
| Qwen2.5-Coder-1.5B-Instruct2.1 GB at Q4 | Fits | Fits | Fits | 1149–1628 |
| Qwen2.5-Coder-1.5B2.1 GB at Q4 | Fits | Fits | Fits | 1149–1628 |
| Qwen2.5-Math-1.5B2.1 GB at Q4 | Fits | Fits | Fits | 1149–1628 |
| Qwen2-1.5B-Instruct2.1 GB at Q4 | Fits | Fits | Fits | 1149–1628 |
| Qwen2.5-Math-1.5B-Instruct2.1 GB at Q4 | Fits | Fits | Fits | 1149–1628 |
| ReaderLM-v22.1 GB at Q4 | Fits | Fits | Fits | 1149–1628 |
| reader-lm-1.5b2.1 GB at Q4 | Fits | Fits | Fits | 1149–1628 |
| Hymba-1.5B-Instruct2.1 GB at Q4 | Fits | Fits | Fits | 1165–1650 |
| OLMo-2-0425-1B2.0 GB at Q4 | Fits | Fits | Fits | 1194–1692 |
| OLMo-2-0425-1B-Instruct2.0 GB at Q4 | Fits | Fits | Fits | 1194–1692 |
| Yi-Coder-1.5B-Chat2.0 GB at Q4 | Fits | Fits | Fits | 1201–1702 |
| Bolmo-1B2.0 GB at Q4 | Fits | Fits | Fits | 1207–1710 |
| granite-4.0-h-1b2.0 GB at Q4 | Fits | Fits | Fits | 1213–1719 |
| granite-3.1-1b-a400m-instruct1.9 GB at Q4 · MoE | Fits | Fits | Fits | up to 6281 |
| granite-3.0-1b-a400m-instruct1.9 GB at Q4 · MoE | Fits | Fits | Fits | up to 6281 |
| MiniCPM-V-4.61.9 GB at Q4 | Fits | Fits | Fits | 1364–1932 |
| MiniCPM-V-4.6-Thinking1.9 GB at Q4 | Fits | Fits | Fits | 1364–1932 |
| kanana-2-1.3b-instruct1.9 GB at Q4 | Fits | Fits | Fits | 1373–1945 |
| OLMo-1B-0724-hf1.9 GB at Q4 | Fits | Fits | Fits | 1386–1963 |
| EXAONE-4.0-1.2B1.9 GB at Q4 | Fits | Fits | Fits | 1386–1964 |
| Llama-3.2-1B-Instruct1.9 GB at Q4 | Fits | Fits | Fits | 1435–2033 |
| Llama-3.2-1B1.9 GB at Q4 | Fits | Fits | Fits | 1435–2033 |
| Llama-3.2-1B1.9 GB at Q4 | Fits | Fits | Fits | 1435–2033 |
| Zamba2-1.2B-instruct1.8 GB at Q4 | Fits | Fits | Fits | 1460–2068 |
| HRM-Text-1B1.8 GB at Q4 | Fits | Fits | Fits | 1499–2124 |
| AMD-OLMo-1B1.8 GB at Q4 | Fits | Fits | Fits | 1507–2135 |
| LFM2.5-1.2B-Instruct1.8 GB at Q4 | Fits | Fits | Fits | 1515–2147 |
| LFM2-1.2B1.8 GB at Q4 | Fits | Fits | Fits | 1515–2147 |
| LFM2.5-1.2B-Thinking1.8 GB at Q4 | Fits | Fits | Fits | 1515–2147 |
| LFM2.5-1.2B-JP-2026061.8 GB at Q4 | Fits | Fits | Fits | 1515–2147 |
| MiniCPM5-1B1.8 GB at Q4 | Fits | Fits | Fits | 1641–2325 |
| MiniCPM5-1B-SFT1.8 GB at Q4 | Fits | Fits | Fits | 1641–2325 |
| gemma-3-1b-it1.7 GB at Q4 | Fits | Fits | Fits | 1774–2513 |
| gemma-3-1b-pt1.7 GB at Q4 | Fits | Fits | Fits | 1774–2513 |
| Qwen3.5-0.8B1.6 GB at Q4 | Fits | Fits | Fits | 2031–2877 |
| Falcon-E-3B-Instruct1.6 GB at Q4 | Fits | Fits | Fits | 2052–2907 |
| bitnet-b1.58-2B-4T1.6 GB at Q4 | Fits | Fits | Fits | 2087–2957 |
| FastVLM-0.5B1.5 GB at Q4 | Fits | Fits | Fits | 2337–3311 |
| Qwen3-0.6B1.5 GB at Q4 | Fits | Fits | Fits | 2360–3343 |
| LFM2-700M1.5 GB at Q4 | Fits | Fits | Fits | 2389–3384 |
| Falcon-H1-Tiny-R-0.6B1.4 GB at Q4 | Fits | Fits | Fits | 2850–4037 |
| Qwen3-0.6B-Base1.4 GB at Q4 | Fits | Fits | Fits | 2975–4215 |
| d1-omni-600M1.4 GB at Q4 | Fits | Fits | Fits | 3021–4279 |
| HyperCLOVAX-SEED-Text-Instruct-0.5B1.4 GB at Q4 | Fits | Fits | Fits | 3132–4437 |
| Falcon-H1-0.5B-Instruct1.4 GB at Q4 | Fits | Fits | Fits | 3401–4819 |
| Qwen2.5-0.5B-Instruct1.3 GB at Q4 | Fits | Fits | Fits | 3590–5086 |
| Qwen2.5-0.5B1.3 GB at Q4 | Fits | Fits | Fits | 3590–5086 |
| Qwen2-0.5B-Instruct1.3 GB at Q4 | Fits | Fits | Fits | 3590–5086 |
| Qwen2.5-Coder-0.5B-Instruct1.3 GB at Q4 | Fits | Fits | Fits | 3590–5086 |
| LFM2-VL-450M1.3 GB at Q4 | Fits | Fits | Fits | 3934–5573 |
| LFM2.5-VL-450M1.3 GB at Q4 | Fits | Fits | Fits | 3952–5599 |
| Apertus-v1.1-0.5B1.3 GB at Q4 | Fits | Fits | Fits | 4046–5732 |
| MiniCPM4-0.5B1.3 GB at Q4 | Fits | Fits | Fits | 4088–5791 |
| circuit-sparsity1.3 GB at Q4 | Fits | Fits | Fits | 4231–5995 |
| SmolLM2-360M1.3 GB at Q4 | Fits | Fits | Fits | 4902–6944 |
| SmolLM-360M1.3 GB at Q4 | Fits | Fits | Fits | 4902–6944 |
| ERNIE-4.5-0.3B-PT1.3 GB at Q4 | Fits | Fits | Fits | 4916–6965 |
| LFM2.5-350M1.2 GB at Q4 | Fits | Fits | Fits | 5003–7088 |
| LFM2-350M1.2 GB at Q4 | Fits | Fits | Fits | 5003–7088 |
| granite-4.0-350m1.2 GB at Q4 | Fits | Fits | Fits | 5033–7130 |
| granite-4.0-h-350m1.2 GB at Q4 | Fits | Fits | Fits | 5211–7382 |