What Can I Run AI?

Builds

Dual RX 7900 XTX build (48 GB VRAM)

48 GB at list price without hunting for used cards, running on ROCm or Vulkan in llama.cpp. Runs 32B models at Q8. 70B at Q4_K_M is just over 48 GB by our formula (see the dual 3090 page).

Total
$5,134
Usable memory
48.0 GB
Qwen2.5-Coder-32B-Instruct Q4
Fits
Est. tok/s
29–41
PSU needed
1350 W
$ per tok/s
$147

Parts

PartItemPriceBuy
GPU2× Radeon RX 7900 XTX$1,998list price (MSRP)Amazon
CPUAMD Ryzen 9 9950X$539Newegg price (sold by Newegg)Amazon
MotherboardASUS ProArt X870E-CREATOR WIFI$512Newegg price (sold by Newegg)Amazon
RAMCorsair Vengeance 64GB (2x32) DDR5-6000 CL30$1,275Corsair store priceAmazon
Power supplyCorsair HX1500i$320Corsair store priceAmazon
CaseCorsair FRAME 5000D RS$160Corsair store priceAmazon
StorageSamsung 990 2TB NVMe$330Newegg price (sold by Newegg)Amazon
Total$5,134

We may earn a commission when you buy through these links, at no extra cost to you. Prices are dated snapshots (2026-10-23 for parts; GPUs at list price unless marked used). Used prices come from one dated listing each.

Will Qwen2.5-Coder-32B-Instruct run?

ModelQ4_K_MQ8_0FP16Est. tok/s (Q4)
Qwen2.5-Coder-32B-Instruct23.8 GB at Q4FitsFitsWon’t fit29–41

Tok/s = memory bandwidth ÷ model weight size × a 60–85% efficiency band, calibrated on llama.cpp scoreboards. Mixture-of-experts models show only an upper bound ("up to"). How we estimate speed. Multi-GPU layer split runs the cards one after another, so speed is about that of one card on the whole model, not double.

Power math

(GPU 355×2 W + CPU 170 W + 150 W rest of system) × 1.3 = 1339 W → 1350 W PSU

Running cost at full load: about 1030 W, so $0.19/hour at an example $0.18/kWh (enter your own rate in the planner). Decode rarely holds the GPUs at full board power, so treat this as a ceiling.

Fit checks

All models on this build

ModelQ4_K_MQ8_0FP16Est. tok/s (Q4)
Kimi-K3.1-Pro1939.3 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Kimi-K31939.1 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Qwen3.8-2.4T-A95B1706.4 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
LongCat-2.51241.8 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
LongCat-2.01238.9 GB at Q4Won’t fitWon’t fitWon’t fit—
DeepSeek-V4-Pro-08131151.7 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
DeepSeek-V4-Pro1115.7 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Kimi-K2.5716.9 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Kimi-K2.6716.9 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Kimi-K2.7-Code716.9 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Kimi-K2-Thinking716.6 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Kimi-K2-Instruct-0905716.6 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Kimi-K2-Instruct716.6 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
MiMo-V2.6-Pro-RL715.1 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
MiMo-V2.6-Pro-MOPD715.1 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
MiMo-V2.5-Pro714.4 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Ring-2.5-1T706.7 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Ling-2.5-1T706.7 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Ling-1T698.0 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Ring-1T698.0 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Inkling665.0 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Intern-S1-Pro640.4 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Muse-Spark-Open-816B-A42B574.1 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Hy4-preview544.8 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
GLM-5526.6 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
GLM-5.1526.6 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
GLM-5.3526.2 GB at Q4Won’t fitWon’t fitWon’t fit—
GLM-5.2526.2 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
GLM-5.3-BF16526.2 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
K-EXAONE-2.0-750B-A37B523.4 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
DeepSeek-V3.2-Exp478.9 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
DeepSeek-V3.2-Speciale478.9 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
DeepSeek-V3.2478.8 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
DeepSeek-V3-0324478.2 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
DeepSeek-R1-0528478.2 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
DeepSeek-V3.1-Base478.2 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
DeepSeek-R1478.2 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
DeepSeek-R1-Zero478.2 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Step-5-Preview422.3 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Ling-3.1-flash399.9 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Ling-3.1-flash-1019399.9 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
LongCat-Flash-Chat392.7 GB at Q4Won’t fitWon’t fitWon’t fit—
LongCat-Flash-Thinking392.7 GB at Q4Won’t fitWon’t fitWon’t fit—
LongCat-Flash-Thinking-2601392.7 GB at Q4Won’t fitWon’t fitWon’t fit—
NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16391.8 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Beam-1.0-501B-A23B350.5 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Qwen3-Coder-480B-A35B-Instruct335.8 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
MiniMax-M1-40k319.0 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
MiniMax-M1-80k319.0 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
MiniMax-M3298.7 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
ERNIE-4.5-VL-424B-A47B-PT296.3 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Intern-S2-397B282.3 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Qwen3.5-397B-A17B282.2 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Llama-4-Maverick-17B-128E-Instruct281.0 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Trinity-Large-Thinking278.9 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Trinity-Large-Preview278.9 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Trinity-Large-TrueBase278.9 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Trinity-Large-Base278.9 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Nex-N2.5-Pro277.6 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Nex-N2-Pro277.6 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
NorthCUA-Pro277.6 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
GLM-4.5250.8 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
GLM-4.7250.8 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
GLM-4.6249.7 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
GLM-5.3-Flash225.0 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Motif-3220.5 GB at Q4Won’t fitWon’t fitWon’t fit—
MiMo-V2.5217.7 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
MiMo-V2.6-Flash-RL217.7 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
MiMo-V2.6-Flash-MOPD217.7 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
MiMo-V2-Flash217.0 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
DeepSeek-V4-Flash-Vision-Exp213.4 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
DeepSeek-V4-Flash-0731213.1 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
ERNIE-4.5-300B-A47B-PT210.5 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Hy3209.3 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Hy3-preview209.3 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Ling-plus205.0 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
DeepSeek-V4-Flash203.8 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
MemT-1.0-Flash201.8 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
ERNIE-5.5-Flash-Base200.6 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Inkling-Small186.4 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Llama-3_1-Nemotron-Ultra-253B-v1177.7 GB at Q4Won’t fitWon’t fitWon’t fit—
Solar-Open2-250B175.5 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Intern-S1168.8 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
K-EXAONE-236B-A23B166.3 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
DeepSeek-V2.5165.4 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
DeepSeek-Coder-V2-Instruct165.4 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
DeepSeek-V2.5-1210165.4 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
DeepSeek-V2-Chat-0628165.4 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
DeepSeek-Coder-V2-Instruct-0724165.4 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Qwen3-VL-235B-A22B-Instruct165.3 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Qwen3-235B-A22B164.9 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Qwen3-235B-A22B-Instruct-2507164.9 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Qwen3-235B-A22B-Thinking-2507164.9 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
MiniMax-M2160.4 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
MiniMax-M2.5160.4 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
MiniMax-M2.7160.4 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
MiniMax-M2.1160.4 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
command-a-plus-05-2026-bf16153.5 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Step-3.7-Flash141.4 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Step-3.5-Flash140.0 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Step-3.5-Flash-Base-Midtrain138.9 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Qwen3.8-Flash-Next126.5 GB at Q4Won’t fitWon’t fitWon’t fit—
Mixtral-8x22B-Instruct-v0.199.0 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Ling-3.0-flash-Sante89.9 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Ling-3.0-flash89.9 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Ling-3.0-flash-Fin89.9 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Ornith-1.5-122B88.2 GB at Q4Won’t fitWon’t fitWon’t fit—
Qwen3.5-122B-A10B88.2 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Devstral-2-123B-Instruct-251288.2 GB at Q4Won’t fitWon’t fitWon’t fit—
Ling-3.0-flash-VL88.0 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
NVIDIA-Nemotron-3-Super-120B-A12B-BF1687.2 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Mistral-Small-4-119B-260384.2 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Youtu-LLM-A7B-Base83.5 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Laguna-S-2.183.0 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
gpt-oss-120b82.5 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
c4ai-command-a-03-202578.4 GB at Q4Won’t fitWon’t fitWon’t fit—
GLM-4.5-Air78.0 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Llama-4-Scout-17B-16E-Instruct76.7 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Llama-4-Scout-17B-16E76.7 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
GLM-4.5V76.1 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
GLM-4.6V76.1 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Ling-2.6-flash75.9 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
sarvam-105b74.9 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Ling-flash-2.072.7 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
LLaDA2.1-flash72.7 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Ring-flash-2.072.7 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
LLaDA2.2-flash72.7 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Solar-Open-100B72.6 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Qwen3-Next-80B-A3B-Instruct57.7 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Qwen3-Next-80B-A3B-Thinking57.7 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
AliceAI-Foundation-80B-A3B-Base57.7 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Hunyuan-A13B-Instruct57.0 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Qwen3-Coder-Next56.5 GB at Q4 · MoEWon’t fitWon’t fitWon’t fit—
Kolibri-155.5 GB at Q4Won’t fitWon’t fitWon’t fit—
Qwen2.5-VL-72B-Instruct52.2 GB at Q4Won’t fitWon’t fitWon’t fit—
UI-TARS-72B-DPO52.2 GB at Q4Won’t fitWon’t fitWon’t fit—
Qwen2.5-72B-Instruct51.7 GB at Q4Won’t fitWon’t fitWon’t fit—
Apertus-70B-Instruct-250950.2 GB at Q4Won’t fitWon’t fitWon’t fit—
Apertus-70B-250950.2 GB at Q4Won’t fitWon’t fitWon’t fit—
Llama-3.3-70B-Instruct50.2 GB at Q4Won’t fitWon’t fitWon’t fit—
DeepSeek-R1-Distill-Llama-70B50.2 GB at Q4Won’t fitWon’t fitWon’t fit—
Llama-3.1-70B50.2 GB at Q4Won’t fitWon’t fitWon’t fit—
Hermes-2-Theta-Llama-3-70B50.2 GB at Q4Won’t fitWon’t fitWon’t fit—
Meta-Llama-3.1-70B-Instruct50.2 GB at Q4Won’t fitWon’t fitWon’t fit—
LongCat-Flash-Lite49.2 GB at Q4Won’t fitWon’t fitWon’t fit—
AI21-Jamba2-Mini37.0 GB at Q4 · MoEFitsWon’t fitWon’t fitup to 112
Llama-3_1-Nemotron-51B-Instruct36.9 GB at Q4FitsWon’t fitWon’t fit18–26
Llama-3_3-Nemotron-Super-49B-v1_535.8 GB at Q4FitsWon’t fitWon’t fit19–27
Llama-3_3-Nemotron-Super-49B-v135.8 GB at Q4FitsWon’t fitWon’t fit19–27
Phi-3.5-MoE-instruct30.2 GB at Q4 · MoEFitsWon’t fitWon’t fitup to 204
GRIN-MoE30.2 GB at Q4 · MoEFitsWon’t fitWon’t fitup to 204
ALIA-40b29.2 GB at Q4FitsWon’t fitWon’t fit23–33
IQuest-Coder-V1-40B-Loop-Instruct28.7 GB at Q4FitsWon’t fitWon’t fit24–34
IQuest-Coder-V1-40B-Instruct28.7 GB at Q4FitsWon’t fitWon’t fit24–34
Recursive Flint28.7 GB at Q4 · MoEFitsWon’t fitWon’t fitup to 539
K2-Horizon-MoVA-36B-A4B27.1 GB at Q4 · MoEFitsTightWon’t fitup to 337
Seed-OSS-36B-Instruct26.2 GB at Q4FitsTightWon’t fit26–37
Seed-OSS-36B-Base-woSyn26.2 GB at Q4FitsTightWon’t fit26–37
Intern-S2-Preview26.2 GB at Q4 · MoEFitsTightWon’t fitup to 449
Ornith-1.5-35B-A3B26.1 GB at Q4 · MoEFitsTightWon’t fitup to 449
Sage-A1.526.1 GB at Q4FitsTightWon’t fit26–37
Qwen3.6-35B-A3B26.1 GB at Q4 · MoEFitsTightWon’t fitup to 449
Qwen3.5-35B-A3B26.1 GB at Q4 · MoEFitsTightWon’t fitup to 449
Apex-35B-V1.026.1 GB at Q4 · MoEFitsTightWon’t fitup to 449
MiniCPM-V-4.7-35B-A3B25.5 GB at Q4 · MoEFitsTightWon’t fitup to 449
MemT-1.0-Nano25.5 GB at Q4 · MoEFitsTightWon’t fitup to 449
Agents-A125.5 GB at Q4 · MoEFitsTightWon’t fitup to 448
Nex-N2.5-mini25.5 GB at Q4 · MoEFitsTightWon’t fitup to 448
Nex-N2-mini25.5 GB at Q4 · MoEFitsTightWon’t fitup to 448
Axion-1.0-35B25.5 GB at Q4 · MoEFitsTightWon’t fitup to 448
NorthCUA-Mini25.5 GB at Q4 · MoEFitsTightWon’t fitup to 448
Clover-35B-A3B-Preview25.2 GB at Q4 · MoEFitsTightWon’t fitup to 448
Qwen-AgentWorld-35B-A3B25.2 GB at Q4 · MoEFitsTightWon’t fitup to 448
KAT-Coder-V2.5-Dev25.2 GB at Q4 · MoEFitsTightWon’t fitup to 448
EXAONE-4.5-33B24.9 GB at Q4FitsFitsWon’t fit28–39
Falcon-H1-34B-Instruct24.5 GB at Q4FitsFitsWon’t fit28–40
Qwen2.5-VL-32B-Instruct24.3 GB at Q4FitsFitsWon’t fit28–40
Laguna-XS.224.3 GB at Q4 · MoEFitsFitsWon’t fitup to 449
Qwen3-VL-32B-Instruct24.3 GB at Q4FitsFitsWon’t fit28–40
HyperCLOVAX-SEED-Think-32B24.2 GB at Q4FitsFitsWon’t fit29–40
FlexOlmo-7x7B-1T24.2 GB at Q4FitsFitsWon’t fit29–40
GLM-Z1-Rumination-32B-041424.1 GB at Q4FitsFitsWon’t fit29–41
Nanbeige4.3-33B24.1 GB at Q4FitsFitsWon’t fit29–41
Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF1624.0 GB at Q4 · MoEFitsFitsWon’t fitup to 448
Qwen2.5-Coder-32B-Instruct23.8 GB at Q4FitsFitsWon’t fit29–41
DeepSeek-R1-Distill-Qwen-32B23.8 GB at Q4FitsFitsWon’t fit29–41
Qwen2.5-32B-Instruct23.8 GB at Q4FitsFitsWon’t fit29–41
QwQ-32B23.8 GB at Q4FitsFitsWon’t fit29–41
QwQ-32B-Preview23.8 GB at Q4FitsFitsWon’t fit29–41
Qwen2.5-32B23.8 GB at Q4FitsFitsWon’t fit29–41
Qwen2.5-Coder-32B23.8 GB at Q4FitsFitsWon’t fit29–41
Qwen3-32B23.8 GB at Q4FitsFitsWon’t fit29–41
GLM-Z1-32B-041423.7 GB at Q4FitsFitsWon’t fit29–41
GLM-4-32B-041423.7 GB at Q4FitsFitsWon’t fit29–41
OLMo-2-0325-32B-Instruct23.5 GB at Q4FitsFitsWon’t fit29–42
OLMo-2-0325-32B23.5 GB at Q4FitsFitsWon’t fit29–42
Olmo-3-32B-Think23.5 GB at Q4FitsFitsWon’t fit29–42
Olmo-3-1125-32B23.5 GB at Q4FitsFitsWon’t fit29–42
Olmo-3.1-32B-Instruct23.5 GB at Q4FitsFitsWon’t fit29–42
Olmo-3.1-32B-Think23.5 GB at Q4FitsFitsWon’t fit29–42
Olmo-3.1-32B-Instruct-DPO23.5 GB at Q4FitsFitsWon’t fit29–42
granite-4.0-h-small23.5 GB at Q4 · MoEFitsFitsWon’t fitup to 150
sarvam-30b23.4 GB at Q4 · MoEFitsFitsWon’t fitup to 561
EXAONE-4.0-32B23.3 GB at Q4FitsFitsWon’t fit30–42
EXAONE-4.0.1-32B23.3 GB at Q4FitsFitsWon’t fit30–42
EXAONE-3.5-32B-Instruct23.3 GB at Q4FitsFitsWon’t fit30–42
EXAONE-Deep-32B23.3 GB at Q4FitsFitsWon’t fit30–42
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF1623.0 GB at Q4 · MoEFitsFitsWon’t fitup to 449
NVIDIA-Nemotron-3-Nano-30B-A3B-BF1623.0 GB at Q4 · MoEFitsFitsWon’t fitup to 449
Nemotron-Cascade-2-30B-A3B23.0 GB at Q4 · MoEFitsFitsWon’t fitup to 449
Gemma 4 31B22.8 GB at Q4FitsFitsWon’t fit30–43
gemma-4-31B22.8 GB at Q4FitsFitsWon’t fit30–43
GLM-4.7-Flash22.8 GB at Q4 · MoEFitsFitsWon’t fitup to 449
Xing4.0-29B-A4B22.8 GB at Q4 · MoEFitsFitsWon’t fitup to 337
Xing4.0-29B-Intent22.8 GB at Q4 · MoEFitsFitsWon’t fitup to 337
Qwen3-VL-30B-A3B-Instruct22.7 GB at Q4 · MoEFitsFitsWon’t fitup to 448
Qwen3-VL-30B-A3B-Thinking22.7 GB at Q4 · MoEFitsFitsWon’t fitup to 448
UI-Venus-1.5-30B-A3B22.7 GB at Q4 · MoEFitsFitsWon’t fitup to 448
kanana-2-30b-a3b-instruct-260122.4 GB at Q4 · MoEFitsFitsWon’t fitup to 449
kanana-2-30b-a3b-instruct22.4 GB at Q4 · MoEFitsFitsWon’t fitup to 449
kanana-2-30b-a3b-thinking-260122.4 GB at Q4 · MoEFitsFitsWon’t fitup to 449
Qwen3-30B-A3B22.3 GB at Q4 · MoEFitsFitsWon’t fitup to 448
Qwen3-Coder-30B-A3B-Instruct22.3 GB at Q4 · MoEFitsFitsWon’t fitup to 448
Qwen3-30B-A3B-Instruct-250722.3 GB at Q4 · MoEFitsFitsWon’t fitup to 448
Qwen3-30B-A3B-Thinking-250722.3 GB at Q4 · MoEFitsFitsWon’t fitup to 448
Tongyi-DeepResearch-30B-A3B22.3 GB at Q4 · MoEFitsFitsWon’t fitup to 448
Rubicon-Preview22.3 GB at Q4 · MoEFitsFitsWon’t fitup to 448
North-Mini-Code-1.022.3 GB at Q4 · MoEFitsFitsWon’t fitup to 449
Hy-Memory-30B-A3B22.0 GB at Q4 · MoEFitsFitsWon’t fitup to 449
Hy-MT2-30B-A3B22.0 GB at Q4 · MoEFitsFitsWon’t fitup to 449
granite-switch-4.1-30b21.9 GB at Q4FitsFitsWon’t fit32–45
Muse-Glimmer-30B21.8 GB at Q4FitsFitsWon’t fit32–45
ERNIE-4.5-VL-28B-A3B-Thinking21.7 GB at Q4 · MoEFitsFitsWon’t fitup to 449
ERNIE-4.5-VL-28B-A3B-PT21.5 GB at Q4 · MoEFitsFitsWon’t fitup to 449
granite-4.2-30b21.4 GB at Q4FitsFitsWon’t fit32–46
granite-4.1-30b21.1 GB at Q4FitsFitsWon’t fit33–47
Raon-1 mini preview21.1 GB at Q4 · MoEFitsFitsWon’t fitup to 313
Qwen3.8-27B20.4 GB at Q4FitsFitsWon’t fit34–48
Tess-4.5-27B20.4 GB at Q4FitsFitsWon’t fit34–48
Qwen3.6-27B20.4 GB at Q4FitsFitsWon’t fit34–48
Qwen3.5-27B20.4 GB at Q4FitsFitsWon’t fit34–48
gemma-3-27b-it20.1 GB at Q4FitsFitsWon’t fit35–49
Arete-27B20.1 GB at Q4FitsFitsWon’t fit35–49
gemma-2-27b-it20.0 GB at Q4FitsFitsWon’t fit35–49
gemma-2-27b20.0 GB at Q4FitsFitsWon’t fit35–49
Qwen3.8-27B-Longbook27-v219.9 GB at Q4FitsFitsWon’t fit35–50
medgemma-27b-text-it19.8 GB at Q4FitsFitsWon’t fit35–50
Hemmingway-1.519.8 GB at Q4FitsFitsWon’t fit35–50
Trinity-Mini19.2 GB at Q4 · MoEFitsFitsWon’t fitup to 449
diffusiongemma-26B-A4B-it19.0 GB at Q4 · MoEFitsFitsWon’t fitup to 336
Gemma 4 26B A4B19.0 GB at Q4 · MoEFitsFitsWon’t fitup to 354
gemma-4-26B-A4B19.0 GB at Q4 · MoEFitsFitsWon’t fitup to 337
Voxtral-Small-24B-250717.9 GB at Q4FitsFitsWon’t fit39–55
Mistral-Small-3.2-24B-Instruct-250617.7 GB at Q4FitsFitsWon’t fit40–56
Mistral-Small-3.1-24B-Instruct-250317.7 GB at Q4FitsFitsWon’t fit40–56
LFM2.5-24B-A2B17.7 GB at Q4 · MoEFitsFitsWon’t fitup to 673
LFM2-24B-A2B17.6 GB at Q4 · MoEFitsFitsWon’t fitup to 673
Mistral-Small-24B-Instruct-250117.4 GB at Q4FitsFitsWon’t fit40–57
EuroLLM-22B-Instruct-251216.8 GB at Q4FitsFitsWon’t fit42–59
EuroLLM-22B-251216.8 GB at Q4FitsFitsWon’t fit42–59
solar-pro-preview-instruct16.4 GB at Q4FitsFitsWon’t fit43–61
ERNIE-4.5-21B-A3B-PT16.3 GB at Q4 · MoEFitsFitsWon’t fitup to 449
ERNIE-4.5-21B-A3B-Thinking16.2 GB at Q4 · MoEFitsFitsWon’t fitup to 449
gpt-oss-20b15.6 GB at Q4 · MoEFitsFitsWon’t fitup to 374
reka-flash-315.6 GB at Q4FitsFitsWon’t fit45–64
maple-preview15.1 GB at Q4 · MoEFitsFitsTightup to 1345
internlm2_5-20b-chat14.8 GB at Q4FitsFitsTight48–68
Groot-19B-A3B-26102314.5 GB at Q4 · MoEFitsFitsTightup to 449
Ling-Coder-lite12.7 GB at Q4 · MoEFitsFitsFitsup to 489
Ring-lite-distill-preview12.7 GB at Q4 · MoEFitsFitsFitsup to 489
Ling-lite12.7 GB at Q4 · MoEFitsFitsFitsup to 489
Ling-lite-1.5-250712.7 GB at Q4 · MoEFitsFitsFitsup to 489
Ling-lite-1.512.7 GB at Q4 · MoEFitsFitsFitsup to 489
Ring-lite12.7 GB at Q4 · MoEFitsFitsFitsup to 489
Ring-mini-linear-2.012.5 GB at Q4 · MoEFitsFitsFitsup to 841
Kimi-VL-A3B-Instruct12.4 GB at Q4 · MoEFitsFitsFitsup to 449
Kimi-VL-A3B-Thinking12.4 GB at Q4 · MoEFitsFitsFitsup to 449
Kimi-VL-A3B-Thinking-250612.4 GB at Q4 · MoEFitsFitsFitsup to 449
LLaDA2.1-mini12.3 GB at Q4 · MoEFitsFitsFitsup to 962
LLaDA2.0-mini12.3 GB at Q4 · MoEFitsFitsFitsup to 962
Ling-mini-2.012.3 GB at Q4 · MoEFitsFitsFitsup to 962
Ring-mini-2.012.3 GB at Q4 · MoEFitsFitsFitsup to 962
LLaDA2.2-mini12.3 GB at Q4 · MoEFitsFitsFitsup to 962
LLaDA2.0-mini-preview12.3 GB at Q4 · MoEFitsFitsFitsup to 962
Moonlight-16B-A3B-Instruct12.1 GB at Q4 · MoEFitsFitsFitsup to 449
Moonlight-16B-A3B12.1 GB at Q4 · MoEFitsFitsFitsup to 449
Instella-MoE-16B-A3B-Think12.1 GB at Q4 · MoEFitsFitsFitsup to 449
DeepSeek-Coder-V2-Lite-Instruct12.0 GB at Q4 · MoEFitsFitsFitsup to 561
kanana-1.5-15.7b-a3b-instruct11.9 GB at Q4 · MoEFitsFitsFitsup to 449
Phi-4-reasoning-vision-15B11.5 GB at Q4FitsFitsFits63–89
Apriel-Nemotron-15b-Thinker11.4 GB at Q4FitsFitsFits63–90
Apriel-1.5-15b-Thinker11.4 GB at Q4FitsFitsFits64–91
Apriel-1.6-15b-Thinker11.4 GB at Q4FitsFitsFits64–91
Carbon-X (DNA)11.3 GB at Q4FitsFitsFits64–91
Qwen2.5-Coder-14B-Instruct11.3 GB at Q4FitsFitsFits64–91
DeepSeek-R1-Distill-Qwen-14B11.3 GB at Q4FitsFitsFits64–91
Qwen2.5-14B-Instruct11.3 GB at Q4FitsFitsFits64–91
Qwen2.5-14B11.3 GB at Q4FitsFitsFits64–91
Qwen2.5-14B-Instruct-1M11.3 GB at Q4FitsFitsFits64–91
Qwen2.5-Coder-14B11.3 GB at Q4FitsFitsFits64–91
Qwen3-14B11.3 GB at Q4FitsFitsFits64–91
JanusCoder-14B11.3 GB at Q4FitsFitsFits64–91
HyperCLOVAX-SEED-Think-14B11.3 GB at Q4FitsFitsFits64–91
phi-411.2 GB at Q4FitsFitsFits65–92
Phi-4-reasoning11.2 GB at Q4FitsFitsFits65–92
Phi-4-reasoning-plus11.2 GB at Q4FitsFitsFits65–92
OLMo-2-1124-13B-Instruct10.6 GB at Q4FitsFitsFits69–98
Mistral-Nemo-Instruct-24079.5 GB at Q4FitsFitsFits78–110
gemma-3-12b-it9.5 GB at Q4FitsFitsFits78–110
gemma-3-12b-pt9.5 GB at Q4FitsFitsFits78–110
Mellum2.1-12B-A2.5B-Thinking9.5 GB at Q4 · MoEFitsFitsFitsup to 538
Mellum2-12B-A2.5B-Thinking9.5 GB at Q4 · MoEFitsFitsFitsup to 538
Mellum2-12B-A2.5B-Instruct9.5 GB at Q4 · MoEFitsFitsFitsup to 538
Mellum2-12B-A2.5B-Thinking-SFT9.5 GB at Q4 · MoEFitsFitsFitsup to 538
Mellum2.1-12B-A2.5B-Thinking-MTP9.5 GB at Q4 · MoEFitsFitsFitsup to 538
Gemma 4 12B9.3 GB at Q4FitsFitsFits79–113
HyperCLOVAX-SEED-Omni-8B8.5 GB at Q4FitsFitsFits88–125
Llama-3.2-11B-Vision-Instruct8.4 GB at Q4FitsFitsFits89–126
Llama-3.2-11B-Vision8.4 GB at Q4FitsFitsFits89–126
Falcon3-10B-Instruct8.2 GB at Q4FitsFitsFits92–131
GLM-4.1V-9B-Thinking8.2 GB at Q4FitsFitsFits92–131
GLM-4.6V-Flash8.2 GB at Q4FitsFitsFits92–131
GLM-4.1V-9B-Base8.2 GB at Q4FitsFitsFits92–131
Glyph8.2 GB at Q4FitsFitsFits92–131
INTELLECT-1-Instruct8.1 GB at Q4FitsFitsFits93–132
INTELLECT-18.1 GB at Q4FitsFitsFits93–132
ZAYA1-VL-8B7.8 GB at Q4FitsFitsFits98–138
SenseNova-Loop-9B-Preview7.7 GB at Q4FitsFitsFits98–139
Ornith-1.5-9B7.7 GB at Q4FitsFitsFits98–139
Qwen3.5-9B7.7 GB at Q4FitsFitsFits98–139
MiniCPM-SALA7.6 GB at Q4FitsFitsFits100–142
NorthCUA-Nano7.6 GB at Q4FitsFitsFits101–143
GLM-4-9B-04147.6 GB at Q4FitsFitsFits101–143
GLM-Z1-9B-04147.6 GB at Q4FitsFitsFits101–143
codegeex4-all-9b7.6 GB at Q4FitsFitsFits101–143
glm-4-9b-chat-hf7.6 GB at Q4FitsFitsFits101–143
moondream3-preview7.5 GB at Q4FitsFitsFits103–145
gemma-2-9b-it7.4 GB at Q4FitsFitsFits103–146
gemma-2-9b7.4 GB at Q4FitsFitsFits103–146
Gemma-SEA-LION-v3-9B-IT7.4 GB at Q4FitsFitsFits103–146
EuroLLM-9B-Instruct-25127.4 GB at Q4FitsFitsFits104–147
NVIDIA-Nemotron-Nano-9B-v27.2 GB at Q4FitsFitsFits107–151
ZAYA1-base7.2 GB at Q4FitsFitsFits107–152
Yi-Coder-9B-Chat7.2 GB at Q4FitsFitsFits108–152
Yi-Coder-9B7.2 GB at Q4FitsFitsFits108–152
internlm3-8b-instruct7.1 GB at Q4FitsFitsFits108–153
granite-4.1-8b7.1 GB at Q4FitsFitsFits108–153
granite-4.2-8b7.1 GB at Q4FitsFitsFits108–153
granite-switch-4.1-8b7.1 GB at Q4FitsFitsFits108–153
Qwen3-VL-8B-Instruct7.1 GB at Q4FitsFitsFits108–154
Qwen3-VL-8B-Thinking7.1 GB at Q4FitsFitsFits108–154
UI-Venus-1.5-8B7.1 GB at Q4FitsFitsFits108–154
Llama-3.1-Nemotron-Nano-VL-8B-V17.1 GB at Q4FitsFitsFits109–154
MiniCPM-V-4_57.1 GB at Q4FitsFitsFits109–155
aya-vision-8b7.0 GB at Q4FitsFitsFits110–156
Intern-S1-mini7.0 GB at Q4FitsFitsFits111–158
Nemotron-Labs-Diffusion-8B-Base6.9 GB at Q4FitsFitsFits112–159
LFM2.5-8B-A1B6.9 GB at Q4 · MoEFitsFitsFitsup to 1346
Mistral-NeMo-Minitron-8B-Base6.9 GB at Q4FitsFitsFits113–160
LFM2-8B-A1B6.8 GB at Q4 · MoEFitsFitsFitsup to 1346
rnj-1-instruct6.8 GB at Q4FitsFitsFits114–162
MiMo-VL-7B-RL-25086.8 GB at Q4FitsFitsFits114–162
MiMo-VL-7B-RL6.8 GB at Q4FitsFitsFits114–162
MiMo-Embodied-7B6.8 GB at Q4FitsFitsFits114–162
MiMo-VL-7B-SFT6.8 GB at Q4FitsFitsFits114–162
Qwen2.5-VL-7B-Instruct6.8 GB at Q4FitsFitsFits115–162
UI-TARS-1.5-7B6.8 GB at Q4FitsFitsFits115–162
Fara-7B6.8 GB at Q4FitsFitsFits115–162
UI-Venus-Ground-7B6.8 GB at Q4FitsFitsFits115–162
Qwen2-VL-7B-Instruct6.8 GB at Q4FitsFitsFits115–162
UI-TARS-7B-DPO6.8 GB at Q4FitsFitsFits115–162
UI-TARS-7B-SFT6.8 GB at Q4FitsFitsFits115–162
Seed-Coder-8B-Instruct6.8 GB at Q4FitsFitsFits115–163
Seed-Coder-8B-Reasoning6.8 GB at Q4FitsFitsFits115–163
Stable-DiffCoder-8B-Instruct6.8 GB at Q4FitsFitsFits115–163
Qwen3-8B6.7 GB at Q4FitsFitsFits116–164
DeepSeek-R1-0528-Qwen3-8B6.7 GB at Q4FitsFitsFits116–164
Qwen3-8B-Base6.7 GB at Q4FitsFitsFits116–164
WeDLM-8B-Instruct6.7 GB at Q4FitsFitsFits116–164
PaCoRe-8B6.7 GB at Q4FitsFitsFits116–164
MiniCPM4-8B6.7 GB at Q4FitsFitsFits116–164
MiniCPM4.1-8B6.7 GB at Q4FitsFitsFits116–164
AgentCPM-Report6.7 GB at Q4FitsFitsFits116–164
MiniCPM4-MCP6.7 GB at Q4FitsFitsFits116–164
granite-3.3-8b-instruct6.7 GB at Q4FitsFitsFits116–165
granite-3.1-8b-instruct6.7 GB at Q4FitsFitsFits116–165
granite-3.2-8b-instruct6.7 GB at Q4FitsFitsFits116–165
granite-3.0-8b-instruct6.7 GB at Q4FitsFitsFits116–165
Apertus-8B-Instruct-25096.6 GB at Q4FitsFitsFits118–167
Apertus-8B-25096.6 GB at Q4FitsFitsFits118–167
Llama-3.1-Tulu-3-8B6.6 GB at Q4FitsFitsFits118–168
Llama-3.1-Tulu-3-8B-DPO6.6 GB at Q4FitsFitsFits118–168
Llama-3.1-Tulu-3.1-8B6.6 GB at Q4FitsFitsFits118–168
kanana-1.5-8b-instruct-25056.6 GB at Q4FitsFitsFits118–168
Llama-3.1-8B-Instruct6.6 GB at Q4FitsFitsFits118–168
Llama-3.1-8B6.6 GB at Q4FitsFitsFits118–168
DeepSeek-R1-Distill-Llama-8B6.6 GB at Q4FitsFitsFits118–168
Meta-Llama-3.1-8B-Instruct6.6 GB at Q4FitsFitsFits118–168
L3-8B-Stheno-v3.26.6 GB at Q4FitsFitsFits118–168
Llama-3.1-Nemotron-Nano-8B-v16.6 GB at Q4FitsFitsFits118–168
Meta-Llama-3.1-8B6.6 GB at Q4FitsFitsFits118–168
LongWriter-llama3.1-8b6.6 GB at Q4FitsFitsFits118–168
Hy-MT2-7B6.6 GB at Q4FitsFitsFits118–168
Nemotron 3.5 Bolt E4B6.6 GB at Q4FitsFitsFits119–168
Gemma 4 E4B6.6 GB at Q4FitsFitsFits119–168
Ling-3.0-tiny6.5 GB at Q4 · MoEFitsFitsFitsup to 1035
MiMo-7B-RL6.5 GB at Q4FitsFitsFits121–172
MiMo-7B-Base6.5 GB at Q4FitsFitsFits121–172
MiMo-7B-RL-05306.5 GB at Q4FitsFitsFits121–172
MiMo-7B-SFT6.5 GB at Q4FitsFitsFits121–172
EXAONE-3.5-7.8B-Instruct6.5 GB at Q4FitsFitsFits122–172
EXAONE-Deep-7.8B6.5 GB at Q4FitsFitsFits122–172
salamandra-7b-instruct6.4 GB at Q4FitsFitsFits122–173
salamandra-7b6.4 GB at Q4FitsFitsFits122–173
salamandra-7b-instruct-26066.4 GB at Q4FitsFitsFits122–173
FastVLM-7B6.4 GB at Q4FitsFitsFits122–173
Molmo2-O-7B6.4 GB at Q4FitsFitsFits122–173
internlm2_5-7b-chat6.4 GB at Q4FitsFitsFits123–174
internlm2_5-7b-chat-1m6.4 GB at Q4FitsFitsFits123–174
Phi-mini-MoE-instruct6.3 GB at Q4 · MoEFitsFitsFitsup to 561
Qwen2.5-Coder-7B-Instruct6.3 GB at Q4FitsFitsFits125–177
DeepSeek-R1-Distill-Qwen-7B6.3 GB at Q4FitsFitsFits125–177
Qwen2.5-7B-Instruct6.3 GB at Q4FitsFitsFits125–177
Qwen2.5-7B6.3 GB at Q4FitsFitsFits125–177
Qwen2-7B-Instruct6.3 GB at Q4FitsFitsFits125–177
Qwen2.5-Coder-7B6.3 GB at Q4FitsFitsFits125–177
Qwen2-7B6.3 GB at Q4FitsFitsFits125–177
Qwen2.5-7B-Instruct-1M6.3 GB at Q4FitsFitsFits125–177
Qwen2.5-Math-7B6.3 GB at Q4FitsFitsFits125–177
Qwen2.5-Math-7B-Instruct6.3 GB at Q4FitsFitsFits125–177
Marco-o16.3 GB at Q4FitsFitsFits125–177
SeaLLMs-v3-7B-Chat6.3 GB at Q4FitsFitsFits125–177
Arcee-Spark6.3 GB at Q4FitsFitsFits125–177
Falcon-H1-7B-Instruct6.3 GB at Q4FitsFitsFits125–177
Falcon-H1R-7B6.3 GB at Q4FitsFitsFits125–177
starvector-8b-im2svg6.2 GB at Q4FitsFitsFits127–179
Falcon3-7B-Instruct6.2 GB at Q4FitsFitsFits127–181
Olmo-Hybrid-7B6.2 GB at Q4FitsFitsFits128–181
LLaDA-MoE-7B-A1B-Base6.1 GB at Q4 · MoEFitsFitsFitsup to 1346
Zamba2-7B-Instruct6.1 GB at Q4FitsFitsFits129–183
OLMo-2-1124-7B-Instruct6.1 GB at Q4FitsFitsFits130–184
Olmo-3-7B-Think6.1 GB at Q4FitsFitsFits130–184
Olmo-3-7B-Instruct6.1 GB at Q4FitsFitsFits130–184
Olmo-3-1025-7B6.1 GB at Q4FitsFitsFits130–184
Olmo-3-7B-Instruct-SFT6.1 GB at Q4FitsFitsFits130–184
Olmo-3-7B-Think-SFT6.1 GB at Q4FitsFitsFits130–184
Olmo-3-7B-Instruct-DPO6.1 GB at Q4FitsFitsFits130–184
Olmo-3-7B-RL-Zero-Math6.1 GB at Q4FitsFitsFits130–184
Olmo-3.1-7B-RL-Zero-Math6.1 GB at Q4FitsFitsFits130–184
Olmo-3-7B-Think-DPO6.1 GB at Q4FitsFitsFits130–184
Mistral-7B-Instruct-v0.36.1 GB at Q4FitsFitsFits131–186
granite-4.0-h-tiny5.8 GB at Q4 · MoEFitsFitsFitsup to 1346
OLMoE-1B-7B-0924-Instruct5.8 GB at Q4 · MoEFitsFitsFitsup to 1035
OLMoE-1B-7B-09245.8 GB at Q4 · MoEFitsFitsFitsup to 1035
OLMoE-1B-7B-0125-Instruct5.8 GB at Q4 · MoEFitsFitsFitsup to 1035
OLMoE-1B-7B-01255.8 GB at Q4 · MoEFitsFitsFitsup to 1035
OLMo-7B-0724-hf5.8 GB at Q4FitsFitsFits138–195
granite-4.0-tiny-preview5.7 GB at Q4 · MoEFitsFitsFitsup to 1346
YuE-s1-7B-anneal-en-cot5.3 GB at Q4FitsFitsFits153–216
Trinity-Nano-Preview5.3 GB at Q4 · MoEFitsFitsFitsup to 1346
Trinity-Nano-Base5.3 GB at Q4 · MoEFitsFitsFitsup to 1346
gemma-3n-E2B-it4.8 GB at Q4FitsFitsFits175–247
Youtu-VL-4B-Instruct4.7 GB at Q4FitsFitsFits178–252
Gemma 4 E2B4.6 GB at Q4FitsFitsFits185–263
Molmo2-ER4.4 GB at Q4FitsFitsFits196–277
Apriel-5B-Instruct4.4 GB at Q4FitsFitsFits197–279
WeVisOne-VL-4B4.4 GB at Q4FitsFitsFits197–279
Mage-VL4.3 GB at Q4FitsFitsFits200–284
Mage-VL-Cowork4.3 GB at Q4FitsFitsFits200–284
Qwen3.5-4B4.2 GB at Q4FitsFitsFits204–289
S5-nano4.2 GB at Q4FitsFitsFits204–289
AFM-4.5B4.2 GB at Q4FitsFitsFits206–291
Llama-3.1-Minitron-4B-Width-Base4.1 GB at Q4FitsFitsFits211–298
Qwen3-VL-4B-Instruct4.1 GB at Q4FitsFitsFits214–303
CapRL-Qwen3VL-4B4.1 GB at Q4FitsFitsFits214–303
glm-edge-4b-chat4.0 GB at Q4FitsFitsFits220–311
gemma-3-4b-it4.0 GB at Q4FitsFitsFits221–313
medgemma-4b-it4.0 GB at Q4FitsFitsFits221–313
medgemma-1.5-4b-it4.0 GB at Q4FitsFitsFits221–313
gemma-3-4b-pt4.0 GB at Q4FitsFitsFits221–313
Nanbeige4.2-3B3.9 GB at Q4FitsFitsFits228–323
Phi-3.5-vision-instruct3.9 GB at Q4FitsFitsFits229–325
Spark-X2.6-4B3.9 GB at Q4FitsFitsFits231–327
Spark-X2.5-4B3.9 GB at Q4FitsFitsFits231–327
POINTS-Reader3.9 GB at Q4FitsFitsFits231–328
MiniCPM-V-43.8 GB at Q4FitsFitsFits234–332
Qwen3-4B3.8 GB at Q4FitsFitsFits236–335
Qwen3-4B-Instruct-25073.8 GB at Q4FitsFitsFits236–335
Qwen3-4B-Thinking-25073.8 GB at Q4FitsFitsFits236–335
Mellum-4b-base3.8 GB at Q4FitsFitsFits236–335
granite-4.0-3b-vision3.8 GB at Q4FitsFitsFits238–337
granite-vision-4.1-4b3.8 GB at Q4FitsFitsFits238–337
Nemotron Labs Dory 1.0 4B3.8 GB at Q4FitsFitsFits239–339
NVIDIA-Nemotron-3-Nano-4B-BF163.8 GB at Q4FitsFitsFits239–339
Nanbeige4.1-3B3.7 GB at Q4FitsFitsFits242–342
Nanbeige4-3B-Thinking-25113.7 GB at Q4FitsFitsFits242–342
Phi-4-mini-flash-reasoning3.7 GB at Q4FitsFitsFits247–349
Phi-4-mini-instruct3.7 GB at Q4FitsFitsFits248–351
Phi-4-mini-reasoning3.7 GB at Q4FitsFitsFits248–351
Nemotron-Labs-Diffusion-3B3.7 GB at Q4FitsFitsFits248–351
Phi-3.5-mini-instruct3.7 GB at Q4FitsFitsFits249–352
MediPhi-Instruct3.7 GB at Q4FitsFitsFits249–352
MediPhi3.7 GB at Q4FitsFitsFits249–352
MediPhi-Clinical3.7 GB at Q4FitsFitsFits249–352
MediPhi-PubMed3.7 GB at Q4FitsFitsFits249–352
HY-Embodied-0.53.6 GB at Q4FitsFitsFits251–356
Phi-tiny-MoE-instruct3.6 GB at Q4 · MoEFitsFitsFitsup to 1224
CapRL-3B3.6 GB at Q4FitsFitsFits253–358
HyperCLOVAX-SEED-Vision-Instruct-3B3.6 GB at Q4FitsFitsFits255–362
kanana-1.5-v-3b-instruct3.6 GB at Q4FitsFitsFits259–367
granite-4.2-3b3.6 GB at Q4FitsFitsFits260–368
kanana-2-3b-instruct3.4 GB at Q4FitsFitsFits271–384
granite-4.1-3b3.4 GB at Q4FitsFitsFits279–396
granite-4.0-micro3.4 GB at Q4FitsFitsFits279–396
granite-3.1-3b-a800m-instruct3.3 GB at Q4 · MoEFitsFitsFitsup to 1683
Falcon3-3B-Instruct3.3 GB at Q4FitsFitsFits294–417
Llama-3.2-3B-Instruct3.2 GB at Q4FitsFitsFits296–419
Llama-3.2-3B3.2 GB at Q4FitsFitsFits296–419
Hermes-3-Llama-3.2-3B3.2 GB at Q4FitsFitsFits296–419
DeepHermes-3-Llama-3-3B-Preview3.2 GB at Q4FitsFitsFits296–419
AI21-Jamba-Reasoning-3B3.2 GB at Q4FitsFitsFits297–421
granite-4.0-h-micro3.2 GB at Q4FitsFitsFits298–422
Falcon-H1-3B-Instruct3.2 GB at Q4FitsFitsFits302–427
d1-3B3.2 GB at Q4FitsFitsFits304–431
LFM2.5-VL-3B3.2 GB at Q4FitsFitsFits304–431
Qwen2.5-3B-Instruct3.2 GB at Q4FitsFitsFits308–436
Qwen2.5-Coder-3B-Instruct3.2 GB at Q4FitsFitsFits308–436
Qwen2.5-3B3.2 GB at Q4FitsFitsFits308–436
Qwen2.5-Coder-3B3.2 GB at Q4FitsFitsFits308–436
SmolLM3-3B3.1 GB at Q4FitsFitsFits309–438
AI21-Jamba2-3B3.1 GB at Q4FitsFitsFits314–444
granite-swash-3b-a600m3.1 GB at Q4 · MoEFitsFitsFitsup to 2251
granite-vision-3.2-2b3.1 GB at Q4FitsFitsFits319–452
granite-vision-3.1-2b-preview3.1 GB at Q4FitsFitsFits319–452
granite-vision-3.3-2b-chart2csv-preview3.1 GB at Q4FitsFitsFits319–452
LFM2.5-2.6B2.9 GB at Q4FitsFitsFits352–499
Zamba2-2.7B2.9 GB at Q4FitsFitsFits357–506
Zamba2-2.7B-instruct2.9 GB at Q4FitsFitsFits357–506
granite-3.0-2b-instruct2.8 GB at Q4FitsFitsFits361–511
gemma-2-2b-it2.8 GB at Q4FitsFitsFits363–515
gemma-2-2b2.8 GB at Q4FitsFitsFits363–515
EuroMoE-2.6B-A0.6B-Instruct-Preview2.8 GB at Q4 · MoEFitsFitsFitsup to 2243
Motif-2.6B2.8 GB at Q4FitsFitsFits366–518
LFM2-2.6B2.8 GB at Q4FitsFitsFits370–524
LFM2-2.6B-Exp2.8 GB at Q4FitsFitsFits370–524
LFM2-2.6B-Transcript2.8 GB at Q4FitsFitsFits370–524
granite-3.3-2b-instruct2.8 GB at Q4FitsFitsFits375–531
granite-3.1-2b-instruct2.8 GB at Q4FitsFitsFits375–531
granite-3.2-2b-instruct2.8 GB at Q4FitsFitsFits375–531
MiniCPM5-2B2.8 GB at Q4FitsFitsFits378–535
MiniCPM5-2B-SFT2.8 GB at Q4FitsFitsFits378–535
MiniCPM5-2B-Midtrain2.8 GB at Q4FitsFitsFits378–535
sarvam-1-v0.52.7 GB at Q4FitsFitsFits379–536
North-Micro-Vision-Instruct2.7 GB at Q4FitsFitsFits382–542
UI-TARS-2B-SFT2.7 GB at Q4FitsFitsFits389–551
WeVisOne-VL-2B2.7 GB at Q4FitsFitsFits389–551
UI-Venus-1.5-2B2.7 GB at Q4FitsFitsFits390–552
bitnet-b1.58-2B-4T-bf162.7 GB at Q4FitsFitsFits394–558
EXAONE-3.5-2.4B-Instruct2.7 GB at Q4FitsFitsFits395–560
EXAONE-Deep-2.4B2.7 GB at Q4FitsFitsFits395–560
kanana-1.5-2.1b-instruct-25052.6 GB at Q4FitsFitsFits410–581
Qwen3.5-2B2.6 GB at Q4FitsFitsFits418–592
salamandra-2b2.6 GB at Q4FitsFitsFits422–597
salamandra-2b-instruct2.6 GB at Q4FitsFitsFits422–597
SmolVLM2-2.2B-Instruct2.6 GB at Q4FitsFitsFits423–599
SmolVLM-Base2.6 GB at Q4FitsFitsFits423–599
Qwen2-VL-2B-Instruct2.5 GB at Q4FitsFitsFits430–609
LFM3-Omni-2B2.5 GB at Q4FitsFitsFits438–621
granite-swash-2b2.5 GB at Q4FitsFitsFits443–628
Qwen3-VL-2B-Instruct2.5 GB at Q4FitsFitsFits447–633
kanana-nano-2.1b-instruct2.5 GB at Q4FitsFitsFits455–645
Hy-MT2-1.8B2.4 GB at Q4FitsFitsFits466–660
Qwen3-1.7B2.4 GB at Q4FitsFitsFits468–662
Youtu-LLM-2B2.4 GB at Q4FitsFitsFits484–686
LFM3-VL-2B2.3 GB at Q4FitsFitsFits495–702
d1-2B2.3 GB at Q4FitsFitsFits495–702
FastVLM-1.5B2.3 GB at Q4FitsFitsFits498–705
internlm2_5-1_8b-chat2.3 GB at Q4FitsFitsFits503–712
DeepSeek-R1-Distill-Qwen-1.5B2.2 GB at Q4FitsFitsFits535–757
LFM3-1.7B2.2 GB at Q4FitsFitsFits550–779
Qwen3-1.7B-Base2.2 GB at Q4FitsFitsFits552–782
SmolLM2-1.7B2.2 GB at Q4FitsFitsFits555–786
SmolLM-1.7B2.2 GB at Q4FitsFitsFits555–786
Spark-X2.6-1.7B2.2 GB at Q4FitsFitsFits556–788
Falcon3-1B-Instruct2.2 GB at Q4FitsFitsFits569–806
EuroLLM-1.7B-Instruct2.2 GB at Q4FitsFitsFits573–812
granite-4.0-1b2.1 GB at Q4FitsFitsFits582–825
LFM2.5-VL-1.6B2.1 GB at Q4FitsFitsFits595–843
glm-edge-1.5b-chat2.1 GB at Q4FitsFitsFits596–845
LFM2-VL-1.6B2.1 GB at Q4FitsFitsFits600–849
Falcon-H1-1.5B-Deep-Instruct2.1 GB at Q4FitsFitsFits611–866
Falcon-H1-1.5B-Instruct2.1 GB at Q4FitsFitsFits611–866
MiniCPM-V-4.7-1B2.1 GB at Q4FitsFitsFits611–866
Qwen2.5-1.5B-Instruct2.1 GB at Q4FitsFitsFits615–872
Qwen2.5-1.5B2.1 GB at Q4FitsFitsFits615–872
Qwen2.5-Coder-1.5B-Instruct2.1 GB at Q4FitsFitsFits615–872
Qwen2.5-Coder-1.5B2.1 GB at Q4FitsFitsFits615–872
Qwen2.5-Math-1.5B2.1 GB at Q4FitsFitsFits615–872
Qwen2-1.5B-Instruct2.1 GB at Q4FitsFitsFits615–872
Qwen2.5-Math-1.5B-Instruct2.1 GB at Q4FitsFitsFits615–872
ReaderLM-v22.1 GB at Q4FitsFitsFits615–872
reader-lm-1.5b2.1 GB at Q4FitsFitsFits615–872
Hymba-1.5B-Instruct2.1 GB at Q4FitsFitsFits624–884
OLMo-2-0425-1B2.0 GB at Q4FitsFitsFits640–906
OLMo-2-0425-1B-Instruct2.0 GB at Q4FitsFitsFits640–906
Yi-Coder-1.5B-Chat2.0 GB at Q4FitsFitsFits643–912
Bolmo-1B2.0 GB at Q4FitsFitsFits647–916
granite-4.0-h-1b2.0 GB at Q4FitsFitsFits650–921
granite-3.1-1b-a400m-instruct1.9 GB at Q4 · MoEFitsFitsFitsup to 3365
granite-3.0-1b-a400m-instruct1.9 GB at Q4 · MoEFitsFitsFitsup to 3365
MiniCPM-V-4.61.9 GB at Q4FitsFitsFits731–1035
MiniCPM-V-4.6-Thinking1.9 GB at Q4FitsFitsFits731–1035
kanana-2-1.3b-instruct1.9 GB at Q4FitsFitsFits736–1042
OLMo-1B-0724-hf1.9 GB at Q4FitsFitsFits742–1052
EXAONE-4.0-1.2B1.9 GB at Q4FitsFitsFits743–1052
Llama-3.2-1B-Instruct1.9 GB at Q4FitsFitsFits769–1089
Llama-3.2-1B1.9 GB at Q4FitsFitsFits769–1089
Llama-3.2-1B1.9 GB at Q4FitsFitsFits769–1089
Zamba2-1.2B-instruct1.8 GB at Q4FitsFitsFits782–1108
HRM-Text-1B1.8 GB at Q4FitsFitsFits803–1138
AMD-OLMo-1B1.8 GB at Q4FitsFitsFits807–1144
LFM2.5-1.2B-Instruct1.8 GB at Q4FitsFitsFits812–1150
LFM2-1.2B1.8 GB at Q4FitsFitsFits812–1150
LFM2.5-1.2B-Thinking1.8 GB at Q4FitsFitsFits812–1150
LFM2.5-1.2B-JP-2026061.8 GB at Q4FitsFitsFits812–1150
MiniCPM5-1B1.8 GB at Q4FitsFitsFits879–1246
MiniCPM5-1B-SFT1.8 GB at Q4FitsFitsFits879–1246
gemma-3-1b-it1.7 GB at Q4FitsFitsFits950–1346
gemma-3-1b-pt1.7 GB at Q4FitsFitsFits950–1346
Qwen3.5-0.8B1.6 GB at Q4FitsFitsFits1088–1541
Falcon-E-3B-Instruct1.6 GB at Q4FitsFitsFits1099–1558
bitnet-b1.58-2B-4T1.6 GB at Q4FitsFitsFits1118–1584
FastVLM-0.5B1.5 GB at Q4FitsFitsFits1252–1774
Qwen3-0.6B1.5 GB at Q4FitsFitsFits1264–1791
LFM2-700M1.5 GB at Q4FitsFitsFits1280–1813
Falcon-H1-Tiny-R-0.6B1.4 GB at Q4FitsFitsFits1527–2163
Qwen3-0.6B-Base1.4 GB at Q4FitsFitsFits1594–2258
d1-omni-600M1.4 GB at Q4FitsFitsFits1618–2292
HyperCLOVAX-SEED-Text-Instruct-0.5B1.4 GB at Q4FitsFitsFits1678–2377
Falcon-H1-0.5B-Instruct1.4 GB at Q4FitsFitsFits1822–2581
Qwen2.5-0.5B-Instruct1.3 GB at Q4FitsFitsFits1923–2724
Qwen2.5-0.5B1.3 GB at Q4FitsFitsFits1923–2724
Qwen2-0.5B-Instruct1.3 GB at Q4FitsFitsFits1923–2724
Qwen2.5-Coder-0.5B-Instruct1.3 GB at Q4FitsFitsFits1923–2724
LFM2-VL-450M1.3 GB at Q4FitsFitsFits2107–2986
LFM2.5-VL-450M1.3 GB at Q4FitsFitsFits2117–3000
Apertus-v1.1-0.5B1.3 GB at Q4FitsFitsFits2167–3071
MiniCPM4-0.5B1.3 GB at Q4FitsFitsFits2190–3102
circuit-sparsity1.3 GB at Q4FitsFitsFits2267–3211
SmolLM2-360M1.3 GB at Q4FitsFitsFits2626–3720
SmolLM-360M1.3 GB at Q4FitsFitsFits2626–3720
ERNIE-4.5-0.3B-PT1.3 GB at Q4FitsFitsFits2634–3731
LFM2.5-350M1.2 GB at Q4FitsFitsFits2680–3797
LFM2-350M1.2 GB at Q4FitsFitsFits2680–3797
granite-4.0-350m1.2 GB at Q4FitsFitsFits2696–3820
granite-4.0-h-350m1.2 GB at Q4FitsFitsFits2792–3955

Copy the parts list

Open in planner and tweak Compare with other builds

New models, and what they need to run

One short email a week: fresh open models with their VRAM numbers, plus hardware worth watching.