What Can I Run AI?

VRAM calculator: which LLMs fit in your memory?

Not in our hardware list? Enter how much memory your GPU or Mac has and see instantly which of our 656 tracked open models fit, at Q4, Q8 or FP16 and at context lengths up to 256k tokens.

VRAM on a graphics card, or total RAM on a Mac.

Memory type

Unified: we count about 75% as usable by the GPU.

How much text the model keeps in view at once.

llama.cpp: -ctk/-ctv flags.

E.g. 1–2 GB if this GPU also drives your display.

388 of 656 models run fully at Q4_K_M in 16.0 GB usable.

Same usable memory as: GeForce RTX 4060 Ti 16GB · GeForce RTX 4070 Ti Super · GeForce RTX 4080 Super · GeForce RTX 5080 · Radeon RX 7600 XT · Radeon RX 7800 XT · GeForce RTX 4080 · GeForce RTX 5060 Ti 16GB · GeForce RTX 5070 Ti · Radeon RX 6800 · Radeon RX 6800 XT · Radeon RX 6900 XT · Radeon RX 6950 XT · Radeon RX 7900 GRE · Radeon RX 9060 XT 16GB · Radeon RX 9070 · Radeon RX 9070 XT · Intel Arc A770 16GB · NVIDIA RTX A4000 · NVIDIA RTX 2000 Ada 16GB

Sorted largest first. Bar: memory needed vs. your usable memory; the tick marks 90%, our comfort line.FitsTightWon’t fit
ModelNeed vs. 16.0 GBVerdict
Kimi-K3.1-Pro2780.1B params · moonshotai1939.3 / 16.0 GBQ4Won’t fit
Kimi-K32779.9B params · moonshotai1939.1 / 16.0 GBQ4Won’t fit
Qwen3.8-2.4T-A95B2446.2B params · Qwen1706.4 / 16.0 GBQ4Won’t fit
LongCat-2.51779.8B params · meituan-longcat1241.8 / 16.0 GBQ4Won’t fit
LongCat-2.01775.6B params · meituan-longcat1238.9 / 16.0 GBQ4Won’t fit
DeepSeek-V4-Pro-08131650.5B params · deepseek-ai1151.7 / 16.0 GBQ4Won’t fit
DeepSeek-V4-Pro1598.8B params · deepseek-ai1115.7 / 16.0 GBQ4Won’t fit
Kimi-K2.51026.9B params · moonshotai716.9 / 16.0 GBQ4Won’t fit
Kimi-K2.61026.9B params · moonshotai716.9 / 16.0 GBQ4Won’t fit
Kimi-K2.7-Code1026.9B params · moonshotai716.9 / 16.0 GBQ4Won’t fit
Kimi-K2-Thinking1026.4B params · moonshotai716.6 / 16.0 GBQ4Won’t fit
Kimi-K2-Instruct-09051026.4B params · moonshotai716.6 / 16.0 GBQ4Won’t fit
Kimi-K2-Instruct1026.4B params · moonshotai716.6 / 16.0 GBQ4Won’t fit
MiMo-V2.6-Pro-RL1024.2B params · XiaomiMiMo715.1 / 16.0 GBQ4Won’t fit
MiMo-V2.6-Pro-MOPD1024.2B params · XiaomiMiMo715.1 / 16.0 GBQ4Won’t fit
MiMo-V2.5-Pro1023.2B params · XiaomiMiMo714.4 / 16.0 GBQ4Won’t fit
Ring-2.5-1T1012.2B params · inclusionAI706.7 / 16.0 GBQ4Won’t fit
Ling-2.5-1T1012.2B params · inclusionAI706.7 / 16.0 GBQ4Won’t fit
Ling-1T999.7B params · inclusionAI698.0 / 16.0 GBQ4Won’t fit
Ring-1T999.7B params · inclusionAI698.0 / 16.0 GBQ4Won’t fit
Inkling952.4B params · thinkingmachines665.0 / 16.0 GBQ4Won’t fit
Intern-S1-Pro917.0B params · internlm640.4 / 16.0 GBQ4Won’t fit
Muse-Spark-Open-816B-A42B822.0B params · meta-models574.1 / 16.0 GBQ4Won’t fit
Hy4-preview780.0B params · tencent544.8 / 16.0 GBQ4Won’t fit
GLM-5753.9B params · zai-org526.6 / 16.0 GBQ4Won’t fit
GLM-5.1753.9B params · zai-org526.6 / 16.0 GBQ4Won’t fit
GLM-5.3753.3B params · zai-org526.2 / 16.0 GBQ4Won’t fit
GLM-5.2753.3B params · zai-org526.2 / 16.0 GBQ4Won’t fit
GLM-5.3-BF16753.3B params · zai-org526.2 / 16.0 GBQ4Won’t fit
K-EXAONE-2.0-750B-A37B749.4B params · LGAI-EXAONE523.4 / 16.0 GBQ4Won’t fit
DeepSeek-V3.2-Exp685.4B params · deepseek-ai478.9 / 16.0 GBQ4Won’t fit
DeepSeek-V3.2-Speciale685.4B params · deepseek-ai478.9 / 16.0 GBQ4Won’t fit
DeepSeek-V3.2685.4B params · deepseek-ai478.8 / 16.0 GBQ4Won’t fit
DeepSeek-V3-0324684.5B params · deepseek-ai478.2 / 16.0 GBQ4Won’t fit
DeepSeek-R1-0528684.5B params · deepseek-ai478.2 / 16.0 GBQ4Won’t fit
DeepSeek-V3.1-Base684.5B params · deepseek-ai478.2 / 16.0 GBQ4Won’t fit
DeepSeek-R1684.5B params · deepseek-ai478.2 / 16.0 GBQ4Won’t fit
DeepSeek-R1-Zero684.5B params · deepseek-ai478.2 / 16.0 GBQ4Won’t fit
Step-5-Preview604.3B params · stepfun-ai422.3 / 16.0 GBQ4Won’t fit
Ling-3.1-flash572.1B params · inclusionAI399.9 / 16.0 GBQ4Won’t fit
Ling-3.1-flash-1019572.1B params · inclusionAI399.9 / 16.0 GBQ4Won’t fit
LongCat-Flash-Chat561.9B params · meituan-longcat392.7 / 16.0 GBQ4Won’t fit
LongCat-Flash-Thinking561.9B params · meituan-longcat392.7 / 16.0 GBQ4Won’t fit
LongCat-Flash-Thinking-2601561.9B params · meituan-longcat392.7 / 16.0 GBQ4Won’t fit
NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16560.5B params · nvidia391.8 / 16.0 GBQ4Won’t fit
Beam-1.0-501B-A23B501.3B params · reflection350.5 / 16.0 GBQ4Won’t fit
Qwen3-Coder-480B-A35B-Instruct480.2B params · Qwen335.8 / 16.0 GBQ4Won’t fit
MiniMax-M1-40k456.1B params · MiniMaxAI319.0 / 16.0 GBQ4Won’t fit
MiniMax-M1-80k456.1B params · MiniMaxAI319.0 / 16.0 GBQ4Won’t fit
MiniMax-M3427.0B params · MiniMaxAI298.7 / 16.0 GBQ4Won’t fit
ERNIE-4.5-VL-424B-A47B-PT423.5B params · baidu296.3 / 16.0 GBQ4Won’t fit
Intern-S2-397B403.4B params · internlm282.3 / 16.0 GBQ4Won’t fit
Qwen3.5-397B-A17B403.4B params · Qwen282.2 / 16.0 GBQ4Won’t fit
Llama-4-Maverick-17B-128E-Instruct401.6B params · meta-llama281.0 / 16.0 GBQ4Won’t fit
Trinity-Large-Thinking398.6B params · arcee-ai278.9 / 16.0 GBQ4Won’t fit
Trinity-Large-Preview398.6B params · arcee-ai278.9 / 16.0 GBQ4Won’t fit
Trinity-Large-TrueBase398.6B params · arcee-ai278.9 / 16.0 GBQ4Won’t fit
Trinity-Large-Base398.6B params · arcee-ai278.9 / 16.0 GBQ4Won’t fit
Nex-N2.5-Pro396.8B params · nex-agi277.6 / 16.0 GBQ4Won’t fit
Nex-N2-Pro396.8B params · nex-agi277.6 / 16.0 GBQ4Won’t fit
NorthCUA-Pro396.8B params · beipo-ai277.6 / 16.0 GBQ4Won’t fit
GLM-4.5358.3B params · zai-org250.8 / 16.0 GBQ4Won’t fit
GLM-4.7358.3B params · zai-org250.8 / 16.0 GBQ4Won’t fit
GLM-4.6356.8B params · zai-org249.7 / 16.0 GBQ4Won’t fit
GLM-5.3-Flash321.3B params · zai-org225.0 / 16.0 GBQ4Won’t fit
Motif-3314.8B params · Motif-Technologies220.5 / 16.0 GBQ4Won’t fit
MiMo-V2.5310.8B params · XiaomiMiMo217.7 / 16.0 GBQ4Won’t fit
MiMo-V2.6-Flash-RL310.8B params · XiaomiMiMo217.7 / 16.0 GBQ4Won’t fit
MiMo-V2.6-Flash-MOPD310.8B params · XiaomiMiMo217.7 / 16.0 GBQ4Won’t fit
MiMo-V2-Flash309.8B params · XiaomiMiMo217.0 / 16.0 GBQ4Won’t fit
DeepSeek-V4-Flash-Vision-Exp304.6B params · deepseek-ai213.4 / 16.0 GBQ4Won’t fit
DeepSeek-V4-Flash-0731304.2B params · deepseek-ai213.1 / 16.0 GBQ4Won’t fit
ERNIE-4.5-300B-A47B-PT300.5B params · baidu210.5 / 16.0 GBQ4Won’t fit
Hy3298.8B params · tencent209.3 / 16.0 GBQ4Won’t fit
Hy3-preview298.8B params · tencent209.3 / 16.0 GBQ4Won’t fit
Ling-plus292.5B params · inclusionAI205.0 / 16.0 GBQ4Won’t fit
DeepSeek-V4-Flash290.9B params · deepseek-ai203.8 / 16.0 GBQ4Won’t fit
MemT-1.0-Flash287.9B params · MemTensor201.8 / 16.0 GBQ4Won’t fit
ERNIE-5.5-Flash-Base286.2B params · baidu200.6 / 16.0 GBQ4Won’t fit
Inkling-Small266.0B params · thinkingmachines186.4 / 16.0 GBQ4Won’t fit
Llama-3_1-Nemotron-Ultra-253B-v1253.4B params · nvidia177.7 / 16.0 GBQ4Won’t fit
Solar-Open2-250B250.3B params · upstage175.5 / 16.0 GBQ4Won’t fit
Intern-S1240.7B params · internlm168.8 / 16.0 GBQ4Won’t fit
K-EXAONE-236B-A23B237.1B params · LGAI-EXAONE166.3 / 16.0 GBQ4Won’t fit
DeepSeek-V2.5235.7B params · deepseek-ai165.4 / 16.0 GBQ4Won’t fit
DeepSeek-Coder-V2-Instruct235.7B params · deepseek-ai165.4 / 16.0 GBQ4Won’t fit
DeepSeek-V2.5-1210235.7B params · deepseek-ai165.4 / 16.0 GBQ4Won’t fit
DeepSeek-V2-Chat-0628235.7B params · deepseek-ai165.4 / 16.0 GBQ4Won’t fit
DeepSeek-Coder-V2-Instruct-0724235.7B params · deepseek-ai165.4 / 16.0 GBQ4Won’t fit
Qwen3-VL-235B-A22B-Instruct235.7B params · Qwen165.3 / 16.0 GBQ4Won’t fit
Qwen3-235B-A22B235.1B params · Qwen164.9 / 16.0 GBQ4Won’t fit
Qwen3-235B-A22B-Instruct-2507235.1B params · Qwen164.9 / 16.0 GBQ4Won’t fit
Qwen3-235B-A22B-Thinking-2507235.1B params · Qwen164.9 / 16.0 GBQ4Won’t fit
MiniMax-M2228.7B params · MiniMaxAI160.4 / 16.0 GBQ4Won’t fit
MiniMax-M2.5228.7B params · MiniMaxAI160.4 / 16.0 GBQ4Won’t fit
MiniMax-M2.7228.7B params · MiniMaxAI160.4 / 16.0 GBQ4Won’t fit
MiniMax-M2.1228.7B params · MiniMaxAI160.4 / 16.0 GBQ4Won’t fit
command-a-plus-05-2026-bf16218.8B params · CohereLabs153.5 / 16.0 GBQ4Won’t fit
Step-3.7-Flash201.4B params · stepfun-ai141.4 / 16.0 GBQ4Won’t fit
Step-3.5-Flash199.4B params · stepfun-ai140.0 / 16.0 GBQ4Won’t fit
Step-3.5-Flash-Base-Midtrain197.8B params · stepfun-ai138.9 / 16.0 GBQ4Won’t fit
Qwen3.8-Flash-Next180.0B params · Qwen126.5 / 16.0 GBQ4Won’t fit
Mixtral-8x22B-Instruct-v0.1140.6B params · mistralai99.0 / 16.0 GBQ4Won’t fit
Ling-3.0-flash-Sante127.5B params · inclusionAI89.9 / 16.0 GBQ4Won’t fit
Ling-3.0-flash127.5B params · inclusionAI89.9 / 16.0 GBQ4Won’t fit
Ling-3.0-flash-Fin127.5B params · inclusionAI89.9 / 16.0 GBQ4Won’t fit
Ornith-1.5-122B125.1B params · ornith-ai88.2 / 16.0 GBQ4Won’t fit
Qwen3.5-122B-A10B125.1B params · Qwen88.2 / 16.0 GBQ4Won’t fit
Devstral-2-123B-Instruct-2512125.0B params · mistralai88.2 / 16.0 GBQ4Won’t fit
Ling-3.0-flash-VL124.8B params · inclusionAI88.0 / 16.0 GBQ4Won’t fit
NVIDIA-Nemotron-3-Super-120B-A12B-BF16123.6B params · nvidia87.2 / 16.0 GBQ4Won’t fit
Mistral-Small-4-119B-2603119.4B params · mistralai84.2 / 16.0 GBQ4Won’t fit
Youtu-LLM-A7B-Base118.4B params · tencent83.5 / 16.0 GBQ4Won’t fit
Laguna-S-2.1117.6B params · poolside83.0 / 16.0 GBQ4Won’t fit
gpt-oss-120b116.8B params · openai82.5 / 16.0 GBQ4Won’t fit
c4ai-command-a-03-2025111.1B params · CohereLabs78.4 / 16.0 GBQ4Won’t fit
GLM-4.5-Air110.5B params · zai-org78.0 / 16.0 GBQ4Won’t fit
Llama-4-Scout-17B-16E-Instruct108.6B params · meta-llama76.7 / 16.0 GBQ4Won’t fit
Llama-4-Scout-17B-16E108.6B params · meta-llama76.7 / 16.0 GBQ4Won’t fit
GLM-4.5V107.7B params · zai-org76.1 / 16.0 GBQ4Won’t fit
GLM-4.6V107.7B params · zai-org76.1 / 16.0 GBQ4Won’t fit
Ling-2.6-flash107.5B params · inclusionAI75.9 / 16.0 GBQ4Won’t fit
sarvam-105b106.0B params · sarvamai74.9 / 16.0 GBQ4Won’t fit
Ling-flash-2.0102.9B params · inclusionAI72.7 / 16.0 GBQ4Won’t fit
LLaDA2.1-flash102.9B params · inclusionAI72.7 / 16.0 GBQ4Won’t fit
Ring-flash-2.0102.9B params · inclusionAI72.7 / 16.0 GBQ4Won’t fit
LLaDA2.2-flash102.9B params · inclusionAI72.7 / 16.0 GBQ4Won’t fit
Solar-Open-100B102.7B params · upstage72.6 / 16.0 GBQ4Won’t fit
Qwen3-Next-80B-A3B-Instruct81.3B params · Qwen57.7 / 16.0 GBQ4Won’t fit
Qwen3-Next-80B-A3B-Thinking81.3B params · Qwen57.7 / 16.0 GBQ4Won’t fit
AliceAI-Foundation-80B-A3B-Base81.3B params · yandex57.7 / 16.0 GBQ4Won’t fit
Hunyuan-A13B-Instruct80.4B params · tencent57.0 / 16.0 GBQ4Won’t fit
Qwen3-Coder-Next79.7B params · Qwen56.5 / 16.0 GBQ4Won’t fit
Kolibri-178.1B params · Aleph-Alpha55.5 / 16.0 GBQ4Won’t fit
Qwen2.5-VL-72B-Instruct73.4B params · Qwen52.2 / 16.0 GBQ4Won’t fit
UI-TARS-72B-DPO73.4B params · ByteDance-Seed52.2 / 16.0 GBQ4Won’t fit
Qwen2.5-72B-Instruct72.7B params · Qwen51.7 / 16.0 GBQ4Won’t fit
Apertus-70B-Instruct-250970.6B params · swiss-ai50.2 / 16.0 GBQ4Won’t fit
Apertus-70B-250970.6B params · swiss-ai50.2 / 16.0 GBQ4Won’t fit
Llama-3.3-70B-Instruct70.6B params · meta-llama50.2 / 16.0 GBQ4Won’t fit
DeepSeek-R1-Distill-Llama-70B70.6B params · deepseek-ai50.2 / 16.0 GBQ4Won’t fit
Llama-3.1-70B70.6B params · meta-llama50.2 / 16.0 GBQ4Won’t fit
Hermes-2-Theta-Llama-3-70B70.6B params · NousResearch50.2 / 16.0 GBQ4Won’t fit
Meta-Llama-3.1-70B-Instruct70.6B params · NousResearch50.2 / 16.0 GBQ4Won’t fit
LongCat-Flash-Lite69.1B params · meituan-longcat49.2 / 16.0 GBQ4Won’t fit
AI21-Jamba2-Mini51.6B params · ai21labs37.0 / 16.0 GBQ4Won’t fit
Llama-3_1-Nemotron-51B-Instruct51.5B params · nvidia36.9 / 16.0 GBQ4Won’t fit
Llama-3_3-Nemotron-Super-49B-v1_549.9B params · nvidia35.8 / 16.0 GBQ4Won’t fit
Llama-3_3-Nemotron-Super-49B-v149.9B params · nvidia35.8 / 16.0 GBQ4Won’t fit
Phi-3.5-MoE-instruct41.9B params · microsoft30.2 / 16.0 GBQ4Won’t fit
GRIN-MoE41.9B params · microsoft30.2 / 16.0 GBQ4Won’t fit
ALIA-40b40.4B params · BSC-LT29.2 / 16.0 GBQ4Won’t fit
IQuest-Coder-V1-40B-Loop-Instruct39.8B params · IQuestLab28.7 / 16.0 GBQ4Won’t fit
IQuest-Coder-V1-40B-Instruct39.8B params · IQuestLab28.7 / 16.0 GBQ4Won’t fit
Recursive Flint39.8B params · RecursiveSI28.7 / 16.0 GBQ4Won’t fit
K2-Horizon-MoVA-36B-A4B37.4B params · IFM27.1 / 16.0 GBQ4Won’t fit
Seed-OSS-36B-Instruct36.2B params · ByteDance-Seed26.2 / 16.0 GBQ4Won’t fit
Seed-OSS-36B-Base-woSyn36.2B params · ByteDance-Seed26.2 / 16.0 GBQ4Won’t fit
Intern-S2-Preview36.1B params · internlm26.2 / 16.0 GBQ4Won’t fit
Ornith-1.5-35B-A3B36.0B params · ornith-ai26.1 / 16.0 GBQ4Won’t fit
Sage-A1.536.0B params · InternScience26.1 / 16.0 GBQ4Won’t fit
Qwen3.6-35B-A3B36.0B params · Qwen26.1 / 16.0 GBQ4Won’t fit
Qwen3.5-35B-A3B36.0B params · Qwen26.1 / 16.0 GBQ4Won’t fit
Apex-35B-V1.036.0B params · Apexintelligence-AI26.1 / 16.0 GBQ4Won’t fit
MiniCPM-V-4.7-35B-A3B35.2B params · openbmb25.5 / 16.0 GBQ4Won’t fit
MemT-1.0-Nano35.1B params · MemTensor25.5 / 16.0 GBQ4Won’t fit
Agents-A135.1B params · InternScience25.5 / 16.0 GBQ4Won’t fit
Nex-N2.5-mini35.1B params · nex-agi25.5 / 16.0 GBQ4Won’t fit
Nex-N2-mini35.1B params · nex-agi25.5 / 16.0 GBQ4Won’t fit
Axion-1.0-35B35.1B params · Axion1-025.5 / 16.0 GBQ4Won’t fit
NorthCUA-Mini35.1B params · beipo-ai25.5 / 16.0 GBQ4Won’t fit
Clover-35B-A3B-Preview34.7B params · Diffuspace25.2 / 16.0 GBQ4Won’t fit
Qwen-AgentWorld-35B-A3B34.7B params · Qwen25.2 / 16.0 GBQ4Won’t fit
KAT-Coder-V2.5-Dev34.7B params · Kwaipilot25.2 / 16.0 GBQ4Won’t fit
EXAONE-4.5-33B34.4B params · LGAI-EXAONE24.9 / 16.0 GBQ4Won’t fit
Falcon-H1-34B-Instruct33.6B params · tiiuae24.5 / 16.0 GBQ4Won’t fit
Qwen2.5-VL-32B-Instruct33.5B params · Qwen24.3 / 16.0 GBQ4Won’t fit
Laguna-XS.233.4B params · poolside24.3 / 16.0 GBQ4Won’t fit
Qwen3-VL-32B-Instruct33.4B params · Qwen24.3 / 16.0 GBQ4Won’t fit
HyperCLOVAX-SEED-Think-32B33.3B params · naver-hyperclovax24.2 / 16.0 GBQ4Won’t fit
FlexOlmo-7x7B-1T33.3B params · allenai24.2 / 16.0 GBQ4Won’t fit
GLM-Z1-Rumination-32B-041433.1B params · zai-org24.1 / 16.0 GBQ4Won’t fit
Nanbeige4.3-33B33.1B params · Nanbeige24.1 / 16.0 GBQ4Won’t fit
Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF1633.0B params · nvidia24.0 / 16.0 GBQ4Won’t fit
Qwen2.5-Coder-32B-Instruct32.8B params · Qwen23.8 / 16.0 GBQ4Won’t fit
DeepSeek-R1-Distill-Qwen-32B32.8B params · deepseek-ai23.8 / 16.0 GBQ4Won’t fit
Qwen2.5-32B-Instruct32.8B params · Qwen23.8 / 16.0 GBQ4Won’t fit
QwQ-32B32.8B params · Qwen23.8 / 16.0 GBQ4Won’t fit
QwQ-32B-Preview32.8B params · Qwen23.8 / 16.0 GBQ4Won’t fit
Qwen2.5-32B32.8B params · Qwen23.8 / 16.0 GBQ4Won’t fit
Qwen2.5-Coder-32B32.8B params · Qwen23.8 / 16.0 GBQ4Won’t fit
Qwen3-32B32.8B params · Qwen23.8 / 16.0 GBQ4Won’t fit
GLM-Z1-32B-041432.6B params · zai-org23.7 / 16.0 GBQ4Won’t fit
GLM-4-32B-041432.6B params · zai-org23.7 / 16.0 GBQ4Won’t fit
OLMo-2-0325-32B-Instruct32.2B params · allenai23.5 / 16.0 GBQ4Won’t fit
OLMo-2-0325-32B32.2B params · allenai23.5 / 16.0 GBQ4Won’t fit
Olmo-3-32B-Think32.2B params · allenai23.5 / 16.0 GBQ4Won’t fit
Olmo-3-1125-32B32.2B params · allenai23.5 / 16.0 GBQ4Won’t fit
Olmo-3.1-32B-Instruct32.2B params · allenai23.5 / 16.0 GBQ4Won’t fit
Olmo-3.1-32B-Think32.2B params · allenai23.5 / 16.0 GBQ4Won’t fit
Olmo-3.1-32B-Instruct-DPO32.2B params · allenai23.5 / 16.0 GBQ4Won’t fit
granite-4.0-h-small32.2B params · ibm-granite23.5 / 16.0 GBQ4Won’t fit
sarvam-30b32.2B params · sarvamai23.4 / 16.0 GBQ4Won’t fit
EXAONE-4.0-32B32.0B params · LGAI-EXAONE23.3 / 16.0 GBQ4Won’t fit
EXAONE-4.0.1-32B32.0B params · LGAI-EXAONE23.3 / 16.0 GBQ4Won’t fit
EXAONE-3.5-32B-Instruct32.0B params · LGAI-EXAONE23.3 / 16.0 GBQ4Won’t fit
EXAONE-Deep-32B32.0B params · LGAI-EXAONE23.3 / 16.0 GBQ4Won’t fit
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF1631.6B params · nvidia23.0 / 16.0 GBQ4Won’t fit
NVIDIA-Nemotron-3-Nano-30B-A3B-BF1631.6B params · nvidia23.0 / 16.0 GBQ4Won’t fit
Nemotron-Cascade-2-30B-A3B31.6B params · nvidia23.0 / 16.0 GBQ4Won’t fit
Gemma 4 31B31.3B params · google22.8 / 16.0 GBQ4Won’t fit
gemma-4-31B31.3B params · google22.8 / 16.0 GBQ4Won’t fit
GLM-4.7-Flash31.2B params · zai-org22.8 / 16.0 GBQ4Won’t fit
Xing4.0-29B-A4B31.2B params · XingChen-AGI22.8 / 16.0 GBQ4Won’t fit
Xing4.0-29B-Intent31.2B params · XingChen-AGI22.8 / 16.0 GBQ4Won’t fit
Qwen3-VL-30B-A3B-Instruct31.1B params · Qwen22.7 / 16.0 GBQ4Won’t fit
Qwen3-VL-30B-A3B-Thinking31.1B params · Qwen22.7 / 16.0 GBQ4Won’t fit
UI-Venus-1.5-30B-A3B31.1B params · inclusionAI22.7 / 16.0 GBQ4Won’t fit
kanana-2-30b-a3b-instruct-260130.7B params · kakaocorp22.4 / 16.0 GBQ4Won’t fit
kanana-2-30b-a3b-instruct30.7B params · kakaocorp22.4 / 16.0 GBQ4Won’t fit
kanana-2-30b-a3b-thinking-260130.7B params · kakaocorp22.4 / 16.0 GBQ4Won’t fit
Qwen3-30B-A3B30.5B params · Qwen22.3 / 16.0 GBQ4Won’t fit
Qwen3-Coder-30B-A3B-Instruct30.5B params · Qwen22.3 / 16.0 GBQ4Won’t fit
Qwen3-30B-A3B-Instruct-250730.5B params · Qwen22.3 / 16.0 GBQ4Won’t fit
Qwen3-30B-A3B-Thinking-250730.5B params · Qwen22.3 / 16.0 GBQ4Won’t fit
Tongyi-DeepResearch-30B-A3B30.5B params · Alibaba-NLP22.3 / 16.0 GBQ4Won’t fit
Rubicon-Preview30.5B params · inclusionAI22.3 / 16.0 GBQ4Won’t fit
North-Mini-Code-1.030.5B params · CohereLabs22.3 / 16.0 GBQ4Won’t fit
Hy-Memory-30B-A3B30.1B params · tencent22.0 / 16.0 GBQ4Won’t fit
Hy-MT2-30B-A3B30.1B params · tencent22.0 / 16.0 GBQ4Won’t fit
granite-switch-4.1-30b30.0B params · ibm-granite21.9 / 16.0 GBQ4Won’t fit
Muse-Glimmer-30B29.8B params · meta-models21.8 / 16.0 GBQ4Won’t fit
ERNIE-4.5-VL-28B-A3B-Thinking29.7B params · baidu21.7 / 16.0 GBQ4Won’t fit
ERNIE-4.5-VL-28B-A3B-PT29.4B params · baidu21.5 / 16.0 GBQ4Won’t fit
granite-4.2-30b29.3B params · ibm-granite21.4 / 16.0 GBQ4Won’t fit
granite-4.1-30b28.9B params · ibm-granite21.1 / 16.0 GBQ4Won’t fit
Raon-1 mini preview28.8B params · KRAFTON21.1 / 16.0 GBQ4Won’t fit
Qwen3.8-27B27.8B params · Qwen20.4 / 16.0 GBQ4Won’t fit
Tess-4.5-27B27.8B params · migtissera20.4 / 16.0 GBQ4Won’t fit
Qwen3.6-27B27.8B params · Qwen20.4 / 16.0 GBQ4Won’t fit
Qwen3.5-27B27.8B params · Qwen20.4 / 16.0 GBQ4Won’t fit
gemma-3-27b-it27.4B params · google20.1 / 16.0 GBQ4Won’t fit
Arete-27B27.4B params · NousResearch20.1 / 16.0 GBQ4Won’t fit
gemma-2-27b-it27.2B params · google20.0 / 16.0 GBQ4Won’t fit
gemma-2-27b27.2B params · google20.0 / 16.0 GBQ4Won’t fit
Qwen3.8-27B-Longbook27-v227.1B params · summerAIO19.9 / 16.0 GBQ4Won’t fit
medgemma-27b-text-it27.0B params · google19.8 / 16.0 GBQ4Won’t fit
Hemmingway-1.526.9B params · HemmingwayAI19.8 / 16.0 GBQ4Won’t fit
Trinity-Mini26.1B params · arcee-ai19.2 / 16.0 GBQ4Won’t fit
diffusiongemma-26B-A4B-it25.8B params · google19.0 / 16.0 GBQ4Won’t fit
Gemma 4 26B A4B25.8B params · google19.0 / 16.0 GBQ4Won’t fit
gemma-4-26B-A4B25.8B params · google19.0 / 16.0 GBQ4Won’t fit
Voxtral-Small-24B-250724.3B params · mistralai17.9 / 16.0 GBQ4Won’t fit
Mistral-Small-3.2-24B-Instruct-250624.0B params · mistralai17.7 / 16.0 GBQ4Won’t fit
Mistral-Small-3.1-24B-Instruct-250324.0B params · mistralai17.7 / 16.0 GBQ4Won’t fit
LFM2.5-24B-A2B24.0B params · LiquidAI17.7 / 16.0 GBQ4Won’t fit
LFM2-24B-A2B23.8B params · LiquidAI17.6 / 16.0 GBQ4Won’t fit
Mistral-Small-24B-Instruct-250123.6B params · mistralai17.4 / 16.0 GBQ4Won’t fit
EuroLLM-22B-Instruct-251222.6B params · utter-project16.8 / 16.0 GBQ4Won’t fit
EuroLLM-22B-251222.6B params · utter-project16.8 / 16.0 GBQ4Won’t fit
solar-pro-preview-instruct22.1B params · upstage16.4 / 16.0 GBQ4Won’t fit
ERNIE-4.5-21B-A3B-PT21.9B params · baidu16.3 / 16.0 GBQ4Won’t fit
ERNIE-4.5-21B-A3B-Thinking21.8B params · baidu16.2 / 16.0 GBQ4Won’t fit
gpt-oss-20b20.9B params · openai15.6 / 16.0 GBQ4Tight
reka-flash-320.9B params · RekaAI15.6 / 16.0 GBQ4Tight
maple-preview20.2B params · deepgrove15.1 / 16.0 GBQ4Tight
internlm2_5-20b-chat19.9B params · internlm14.8 / 16.0 GBQ4Tight
Groot-19B-A3B-26102319.4B params · GrootTeam14.5 / 16.0 GBQ4Tight
Ling-Coder-lite16.8B params · inclusionAI12.7 / 16.0 GBQ4Fits
Ring-lite-distill-preview16.8B params · inclusionAI12.7 / 16.0 GBQ4Fits
Ling-lite16.8B params · inclusionAI12.7 / 16.0 GBQ4Fits
Ling-lite-1.5-250716.8B params · inclusionAI12.7 / 16.0 GBQ4Fits
Ling-lite-1.516.8B params · inclusionAI12.7 / 16.0 GBQ4Fits
Ring-lite16.8B params · inclusionAI12.7 / 16.0 GBQ4Fits
Ring-mini-linear-2.016.4B params · inclusionAI12.5 / 16.0 GBQ4Fits
Kimi-VL-A3B-Instruct16.4B params · moonshotai12.4 / 16.0 GBQ4Fits
Kimi-VL-A3B-Thinking16.4B params · moonshotai12.4 / 16.0 GBQ4Fits
Kimi-VL-A3B-Thinking-250616.4B params · moonshotai12.4 / 16.0 GBQ4Fits
LLaDA2.1-mini16.3B params · inclusionAI12.3 / 16.0 GBQ4Fits
LLaDA2.0-mini16.3B params · inclusionAI12.3 / 16.0 GBQ4Fits
Ling-mini-2.016.3B params · inclusionAI12.3 / 16.0 GBQ4Fits
Ring-mini-2.016.3B params · inclusionAI12.3 / 16.0 GBQ4Fits
LLaDA2.2-mini16.3B params · inclusionAI12.3 / 16.0 GBQ4Fits
LLaDA2.0-mini-preview16.3B params · inclusionAI12.3 / 16.0 GBQ4Fits
Moonlight-16B-A3B-Instruct16.0B params · moonshotai12.1 / 16.0 GBQ4Fits
Moonlight-16B-A3B16.0B params · moonshotai12.1 / 16.0 GBQ4Fits
Instella-MoE-16B-A3B-Think15.9B params · amd12.1 / 16.0 GBQ4Fits
DeepSeek-Coder-V2-Lite-Instruct15.7B params · deepseek-ai12.0 / 16.0 GBQ4Fits
kanana-1.5-15.7b-a3b-instruct15.7B params · kakaocorp11.9 / 16.0 GBQ4Fits
Phi-4-reasoning-vision-15B15.1B params · microsoft11.5 / 16.0 GBQ4Fits
Apriel-Nemotron-15b-Thinker15.0B params · ServiceNow-AI11.4 / 16.0 GBQ4Fits
Apriel-1.5-15b-Thinker14.9B params · ServiceNow-AI11.4 / 16.0 GBQ4Fits
Apriel-1.6-15b-Thinker14.9B params · ServiceNow-AI11.4 / 16.0 GBQ4Fits
Carbon-X (DNA)14.8B params · HuggingFaceBio11.3 / 16.0 GBQ4Fits
Qwen2.5-Coder-14B-Instruct14.8B params · Qwen11.3 / 16.0 GBQ4Fits
DeepSeek-R1-Distill-Qwen-14B14.8B params · deepseek-ai11.3 / 16.0 GBQ4Fits
Qwen2.5-14B-Instruct14.8B params · Qwen11.3 / 16.0 GBQ4Fits
Qwen2.5-14B14.8B params · Qwen11.3 / 16.0 GBQ4Fits
Qwen2.5-14B-Instruct-1M14.8B params · Qwen11.3 / 16.0 GBQ4Fits
Qwen2.5-Coder-14B14.8B params · Qwen11.3 / 16.0 GBQ4Fits
Qwen3-14B14.8B params · Qwen11.3 / 16.0 GBQ4Fits
JanusCoder-14B14.8B params · internlm11.3 / 16.0 GBQ4Fits
HyperCLOVAX-SEED-Think-14B14.7B params · naver-hyperclovax11.3 / 16.0 GBQ4Fits
phi-414.7B params · microsoft11.2 / 16.0 GBQ4Fits
Phi-4-reasoning14.7B params · microsoft11.2 / 16.0 GBQ4Fits
Phi-4-reasoning-plus14.7B params · microsoft11.2 / 16.0 GBQ4Fits
OLMo-2-1124-13B-Instruct13.7B params · allenai10.6 / 16.0 GBQ4Fits
Mistral-Nemo-Instruct-240712.2B params · mistralai9.5 / 16.0 GBQ4Fits
gemma-3-12b-it12.2B params · google9.5 / 16.0 GBQ4Fits
gemma-3-12b-pt12.2B params · google9.5 / 16.0 GBQ4Fits
Mellum2.1-12B-A2.5B-Thinking12.1B params · JetBrains9.5 / 16.0 GBQ4Fits
Mellum2-12B-A2.5B-Thinking12.1B params · JetBrains9.5 / 16.0 GBQ4Fits
Mellum2-12B-A2.5B-Instruct12.1B params · JetBrains9.5 / 16.0 GBQ4Fits
Mellum2-12B-A2.5B-Thinking-SFT12.1B params · JetBrains9.5 / 16.0 GBQ4Fits
Mellum2.1-12B-A2.5B-Thinking-MTP12.1B params · JetBrains9.5 / 16.0 GBQ4Fits
Gemma 4 12B12.0B params · google9.3 / 16.0 GBQ4Fits
HyperCLOVAX-SEED-Omni-8B10.7B params · naver-hyperclovax8.5 / 16.0 GBQ4Fits
Llama-3.2-11B-Vision-Instruct10.7B params · meta-llama8.4 / 16.0 GBQ4Fits
Llama-3.2-11B-Vision10.6B params · meta-llama8.4 / 16.0 GBQ4Fits
Falcon3-10B-Instruct10.3B params · tiiuae8.2 / 16.0 GBQ4Fits
GLM-4.1V-9B-Thinking10.3B params · zai-org8.2 / 16.0 GBQ4Fits
GLM-4.6V-Flash10.3B params · zai-org8.2 / 16.0 GBQ4Fits
GLM-4.1V-9B-Base10.3B params · zai-org8.2 / 16.0 GBQ4Fits
Glyph10.3B params · zai-org8.2 / 16.0 GBQ4Fits
INTELLECT-1-Instruct10.2B params · PrimeIntellect8.1 / 16.0 GBQ4Fits
INTELLECT-110.2B params · PrimeIntellect8.1 / 16.0 GBQ4Fits
ZAYA1-VL-8B9.7B params · Zyphra7.8 / 16.0 GBQ4Fits
SenseNova-Loop-9B-Preview9.7B params · sensenova7.7 / 16.0 GBQ4Fits
Ornith-1.5-9B9.7B params · ornith-ai7.7 / 16.0 GBQ4Fits
Qwen3.5-9B9.7B params · Qwen7.7 / 16.0 GBQ4Fits
MiniCPM-SALA9.5B params · openbmb7.6 / 16.0 GBQ4Fits
NorthCUA-Nano9.4B params · beipo-ai7.6 / 16.0 GBQ4Fits
GLM-4-9B-04149.4B params · zai-org7.6 / 16.0 GBQ4Fits
GLM-Z1-9B-04149.4B params · zai-org7.6 / 16.0 GBQ4Fits
codegeex4-all-9b9.4B params · zai-org7.6 / 16.0 GBQ4Fits
glm-4-9b-chat-hf9.4B params · zai-org7.6 / 16.0 GBQ4Fits
moondream3-preview9.3B params · moondream7.5 / 16.0 GBQ4Fits
gemma-2-9b-it9.2B params · google7.4 / 16.0 GBQ4Fits
gemma-2-9b9.2B params · google7.4 / 16.0 GBQ4Fits
Gemma-SEA-LION-v3-9B-IT9.2B params · aisingapore7.4 / 16.0 GBQ4Fits
EuroLLM-9B-Instruct-25129.2B params · utter-project7.4 / 16.0 GBQ4Fits
NVIDIA-Nemotron-Nano-9B-v28.9B params · nvidia7.2 / 16.0 GBQ4Fits
ZAYA1-base8.8B params · Zyphra7.2 / 16.0 GBQ4Fits
Yi-Coder-9B-Chat8.8B params · 01-ai7.2 / 16.0 GBQ4Fits
Yi-Coder-9B8.8B params · 01-ai7.2 / 16.0 GBQ4Fits
internlm3-8b-instruct8.8B params · internlm7.1 / 16.0 GBQ4Fits
granite-4.1-8b8.8B params · ibm-granite7.1 / 16.0 GBQ4Fits
granite-4.2-8b8.8B params · ibm-granite7.1 / 16.0 GBQ4Fits
granite-switch-4.1-8b8.8B params · ibm-granite7.1 / 16.0 GBQ4Fits
Qwen3-VL-8B-Instruct8.8B params · Qwen7.1 / 16.0 GBQ4Fits
Qwen3-VL-8B-Thinking8.8B params · Qwen7.1 / 16.0 GBQ4Fits
UI-Venus-1.5-8B8.8B params · inclusionAI7.1 / 16.0 GBQ4Fits
Llama-3.1-Nemotron-Nano-VL-8B-V18.7B params · nvidia7.1 / 16.0 GBQ4Fits
MiniCPM-V-4_58.7B params · openbmb7.1 / 16.0 GBQ4Fits
aya-vision-8b8.6B params · CohereLabs7.0 / 16.0 GBQ4Fits
Intern-S1-mini8.5B params · internlm7.0 / 16.0 GBQ4Fits
Nemotron-Labs-Diffusion-8B-Base8.5B params · nvidia6.9 / 16.0 GBQ4Fits
LFM2.5-8B-A1B8.5B params · LiquidAI6.9 / 16.0 GBQ4Fits
Mistral-NeMo-Minitron-8B-Base8.4B params · nvidia6.9 / 16.0 GBQ4Fits
LFM2-8B-A1B8.3B params · LiquidAI6.8 / 16.0 GBQ4Fits
rnj-1-instruct8.3B params · EssentialAI6.8 / 16.0 GBQ4Fits
MiMo-VL-7B-RL-25088.3B params · XiaomiMiMo6.8 / 16.0 GBQ4Fits
MiMo-VL-7B-RL8.3B params · XiaomiMiMo6.8 / 16.0 GBQ4Fits
MiMo-Embodied-7B8.3B params · XiaomiMiMo6.8 / 16.0 GBQ4Fits
MiMo-VL-7B-SFT8.3B params · XiaomiMiMo6.8 / 16.0 GBQ4Fits
Qwen2.5-VL-7B-Instruct8.3B params · Qwen6.8 / 16.0 GBQ4Fits
UI-TARS-1.5-7B8.3B params · ByteDance-Seed6.8 / 16.0 GBQ4Fits
Fara-7B8.3B params · microsoft6.8 / 16.0 GBQ4Fits
UI-Venus-Ground-7B8.3B params · inclusionAI6.8 / 16.0 GBQ4Fits
Qwen2-VL-7B-Instruct8.3B params · Qwen6.8 / 16.0 GBQ4Fits
UI-TARS-7B-DPO8.3B params · ByteDance-Seed6.8 / 16.0 GBQ4Fits
UI-TARS-7B-SFT8.3B params · ByteDance-Seed6.8 / 16.0 GBQ4Fits
Seed-Coder-8B-Instruct8.3B params · ByteDance-Seed6.8 / 16.0 GBQ4Fits
Seed-Coder-8B-Reasoning8.3B params · ByteDance-Seed6.8 / 16.0 GBQ4Fits
Stable-DiffCoder-8B-Instruct8.3B params · ByteDance-Seed6.8 / 16.0 GBQ4Fits
Qwen3-8B8.2B params · Qwen6.7 / 16.0 GBQ4Fits
DeepSeek-R1-0528-Qwen3-8B8.2B params · deepseek-ai6.7 / 16.0 GBQ4Fits
Qwen3-8B-Base8.2B params · Qwen6.7 / 16.0 GBQ4Fits
WeDLM-8B-Instruct8.2B params · tencent6.7 / 16.0 GBQ4Fits
PaCoRe-8B8.2B params · stepfun-ai6.7 / 16.0 GBQ4Fits
MiniCPM4-8B8.2B params · openbmb6.7 / 16.0 GBQ4Fits
MiniCPM4.1-8B8.2B params · openbmb6.7 / 16.0 GBQ4Fits
AgentCPM-Report8.2B params · openbmb6.7 / 16.0 GBQ4Fits
MiniCPM4-MCP8.2B params · openbmb6.7 / 16.0 GBQ4Fits
granite-3.3-8b-instruct8.2B params · ibm-granite6.7 / 16.0 GBQ4Fits
granite-3.1-8b-instruct8.2B params · ibm-granite6.7 / 16.0 GBQ4Fits
granite-3.2-8b-instruct8.2B params · ibm-granite6.7 / 16.0 GBQ4Fits
granite-3.0-8b-instruct8.2B params · ibm-granite6.7 / 16.0 GBQ4Fits
Apertus-8B-Instruct-25098.1B params · swiss-ai6.6 / 16.0 GBQ4Fits
Apertus-8B-25098.1B params · swiss-ai6.6 / 16.0 GBQ4Fits
Llama-3.1-Tulu-3-8B8.0B params · allenai6.6 / 16.0 GBQ4Fits
Llama-3.1-Tulu-3-8B-DPO8.0B params · allenai6.6 / 16.0 GBQ4Fits
Llama-3.1-Tulu-3.1-8B8.0B params · allenai6.6 / 16.0 GBQ4Fits
kanana-1.5-8b-instruct-25058.0B params · kakaocorp6.6 / 16.0 GBQ4Fits
Llama-3.1-8B-Instruct8.0B params · meta-llama6.6 / 16.0 GBQ4Fits
Llama-3.1-8B8.0B params · meta-llama6.6 / 16.0 GBQ4Fits
DeepSeek-R1-Distill-Llama-8B8.0B params · deepseek-ai6.6 / 16.0 GBQ4Fits
Meta-Llama-3.1-8B-Instruct8.0B params · NousResearch6.6 / 16.0 GBQ4Fits
L3-8B-Stheno-v3.28.0B params · Sao10K6.6 / 16.0 GBQ4Fits
Llama-3.1-Nemotron-Nano-8B-v18.0B params · nvidia6.6 / 16.0 GBQ4Fits
Meta-Llama-3.1-8B8.0B params · NousResearch6.6 / 16.0 GBQ4Fits
LongWriter-llama3.1-8b8.0B params · zai-org6.6 / 16.0 GBQ4Fits
Hy-MT2-7B8.0B params · tencent6.6 / 16.0 GBQ4Fits
Nemotron 3.5 Bolt E4B8.0B params · nvidia6.6 / 16.0 GBQ4Fits
Gemma 4 E4B8.0B params · google6.6 / 16.0 GBQ4Fits
Ling-3.0-tiny7.9B params · inclusionAI6.5 / 16.0 GBQ4Fits
MiMo-7B-RL7.8B params · XiaomiMiMo6.5 / 16.0 GBQ4Fits
MiMo-7B-Base7.8B params · XiaomiMiMo6.5 / 16.0 GBQ4Fits
MiMo-7B-RL-05307.8B params · XiaomiMiMo6.5 / 16.0 GBQ4Fits
MiMo-7B-SFT7.8B params · XiaomiMiMo6.5 / 16.0 GBQ4Fits
EXAONE-3.5-7.8B-Instruct7.8B params · LGAI-EXAONE6.5 / 16.0 GBQ4Fits
EXAONE-Deep-7.8B7.8B params · LGAI-EXAONE6.5 / 16.0 GBQ4Fits
salamandra-7b-instruct7.8B params · BSC-LT6.4 / 16.0 GBQ4Fits
salamandra-7b7.8B params · BSC-LT6.4 / 16.0 GBQ4Fits
salamandra-7b-instruct-26067.8B params · BSC-LT6.4 / 16.0 GBQ4Fits
FastVLM-7B7.8B params · apple6.4 / 16.0 GBQ4Fits
Molmo2-O-7B7.8B params · allenai6.4 / 16.0 GBQ4Fits
internlm2_5-7b-chat7.7B params · internlm6.4 / 16.0 GBQ4Fits
internlm2_5-7b-chat-1m7.7B params · internlm6.4 / 16.0 GBQ4Fits
Phi-mini-MoE-instruct7.6B params · microsoft6.3 / 16.0 GBQ4Fits
Qwen2.5-Coder-7B-Instruct7.6B params · Qwen6.3 / 16.0 GBQ4Fits
DeepSeek-R1-Distill-Qwen-7B7.6B params · deepseek-ai6.3 / 16.0 GBQ4Fits
Qwen2.5-7B-Instruct7.6B params · Qwen6.3 / 16.0 GBQ4Fits
Qwen2.5-7B7.6B params · Qwen6.3 / 16.0 GBQ4Fits
Qwen2-7B-Instruct7.6B params · Qwen6.3 / 16.0 GBQ4Fits
Qwen2.5-Coder-7B7.6B params · Qwen6.3 / 16.0 GBQ4Fits
Qwen2-7B7.6B params · Qwen6.3 / 16.0 GBQ4Fits
Qwen2.5-7B-Instruct-1M7.6B params · Qwen6.3 / 16.0 GBQ4Fits
Qwen2.5-Math-7B7.6B params · Qwen6.3 / 16.0 GBQ4Fits
Qwen2.5-Math-7B-Instruct7.6B params · Qwen6.3 / 16.0 GBQ4Fits
Marco-o17.6B params · ATH-MaaS6.3 / 16.0 GBQ4Fits
SeaLLMs-v3-7B-Chat7.6B params · SeaLLMs6.3 / 16.0 GBQ4Fits
Arcee-Spark7.6B params · arcee-ai6.3 / 16.0 GBQ4Fits
Falcon-H1-7B-Instruct7.6B params · tiiuae6.3 / 16.0 GBQ4Fits
Falcon-H1R-7B7.6B params · tiiuae6.3 / 16.0 GBQ4Fits
starvector-8b-im2svg7.5B params · starvector6.2 / 16.0 GBQ4Fits
Falcon3-7B-Instruct7.5B params · tiiuae6.2 / 16.0 GBQ4Fits
Olmo-Hybrid-7B7.4B params · allenai6.2 / 16.0 GBQ4Fits
LLaDA-MoE-7B-A1B-Base7.4B params · inclusionAI6.1 / 16.0 GBQ4Fits
Zamba2-7B-Instruct7.4B params · Zyphra6.1 / 16.0 GBQ4Fits
OLMo-2-1124-7B-Instruct7.3B params · allenai6.1 / 16.0 GBQ4Fits
Olmo-3-7B-Think7.3B params · allenai6.1 / 16.0 GBQ4Fits
Olmo-3-7B-Instruct7.3B params · allenai6.1 / 16.0 GBQ4Fits
Olmo-3-1025-7B7.3B params · allenai6.1 / 16.0 GBQ4Fits
Olmo-3-7B-Instruct-SFT7.3B params · allenai6.1 / 16.0 GBQ4Fits
Olmo-3-7B-Think-SFT7.3B params · allenai6.1 / 16.0 GBQ4Fits
Olmo-3-7B-Instruct-DPO7.3B params · allenai6.1 / 16.0 GBQ4Fits
Olmo-3-7B-RL-Zero-Math7.3B params · allenai6.1 / 16.0 GBQ4Fits
Olmo-3.1-7B-RL-Zero-Math7.3B params · allenai6.1 / 16.0 GBQ4Fits
Olmo-3-7B-Think-DPO7.3B params · allenai6.1 / 16.0 GBQ4Fits
Mistral-7B-Instruct-v0.37.2B params · mistralai6.1 / 16.0 GBQ4Fits
granite-4.0-h-tiny6.9B params · ibm-granite5.8 / 16.0 GBQ4Fits
OLMoE-1B-7B-0924-Instruct6.9B params · allenai5.8 / 16.0 GBQ4Fits
OLMoE-1B-7B-09246.9B params · allenai5.8 / 16.0 GBQ4Fits
OLMoE-1B-7B-0125-Instruct6.9B params · allenai5.8 / 16.0 GBQ4Fits
OLMoE-1B-7B-01256.9B params · allenai5.8 / 16.0 GBQ4Fits
OLMo-7B-0724-hf6.9B params · allenai5.8 / 16.0 GBQ4Fits
granite-4.0-tiny-preview6.7B params · ibm-granite5.7 / 16.0 GBQ4Fits
YuE-s1-7B-anneal-en-cot6.2B params · m-a-p5.3 / 16.0 GBQ4Fits
Trinity-Nano-Preview6.1B params · arcee-ai5.3 / 16.0 GBQ4Fits
Trinity-Nano-Base6.1B params · arcee-ai5.3 / 16.0 GBQ4Fits
gemma-3n-E2B-it5.4B params · google4.8 / 16.0 GBQ4Fits
Youtu-VL-4B-Instruct5.3B params · tencent4.7 / 16.0 GBQ4Fits
Gemma 4 E2B5.1B params · google4.6 / 16.0 GBQ4Fits
Molmo2-ER4.9B params · allenai4.4 / 16.0 GBQ4Fits
Apriel-5B-Instruct4.8B params · ServiceNow-AI4.4 / 16.0 GBQ4Fits
WeVisOne-VL-4B4.8B params · tencent4.4 / 16.0 GBQ4Fits
Mage-VL4.7B params · microsoft4.3 / 16.0 GBQ4Fits
Mage-VL-Cowork4.7B params · microsoft4.3 / 16.0 GBQ4Fits
Qwen3.5-4B4.7B params · Qwen4.2 / 16.0 GBQ4Fits
S5-nano4.7B params · maritaca-ai4.2 / 16.0 GBQ4Fits
AFM-4.5B4.6B params · arcee-ai4.2 / 16.0 GBQ4Fits
Llama-3.1-Minitron-4B-Width-Base4.5B params · nvidia4.1 / 16.0 GBQ4Fits
Qwen3-VL-4B-Instruct4.4B params · Qwen4.1 / 16.0 GBQ4Fits
CapRL-Qwen3VL-4B4.4B params · internlm4.1 / 16.0 GBQ4Fits
glm-edge-4b-chat4.3B params · zai-org4.0 / 16.0 GBQ4Fits
gemma-3-4b-it4.3B params · google4.0 / 16.0 GBQ4Fits
medgemma-4b-it4.3B params · google4.0 / 16.0 GBQ4Fits
medgemma-1.5-4b-it4.3B params · google4.0 / 16.0 GBQ4Fits
gemma-3-4b-pt4.3B params · google4.0 / 16.0 GBQ4Fits
Nanbeige4.2-3B4.2B params · Nanbeige3.9 / 16.0 GBQ4Fits
Phi-3.5-vision-instruct4.1B params · microsoft3.9 / 16.0 GBQ4Fits
Spark-X2.6-4B4.1B params · XHToken3.9 / 16.0 GBQ4Fits
Spark-X2.5-4B4.1B params · XHToken3.9 / 16.0 GBQ4Fits
POINTS-Reader4.1B params · tencent3.9 / 16.0 GBQ4Fits
MiniCPM-V-44.1B params · openbmb3.8 / 16.0 GBQ4Fits
Qwen3-4B4.0B params · Qwen3.8 / 16.0 GBQ4Fits
Qwen3-4B-Instruct-25074.0B params · Qwen3.8 / 16.0 GBQ4Fits
Qwen3-4B-Thinking-25074.0B params · Qwen3.8 / 16.0 GBQ4Fits
Mellum-4b-base4.0B params · JetBrains3.8 / 16.0 GBQ4Fits
granite-4.0-3b-vision4.0B params · ibm-granite3.8 / 16.0 GBQ4Fits
granite-vision-4.1-4b4.0B params · ibm-granite3.8 / 16.0 GBQ4Fits
Nemotron Labs Dory 1.0 4B4.0B params · nvidia3.8 / 16.0 GBQ4Fits
NVIDIA-Nemotron-3-Nano-4B-BF164.0B params · nvidia3.8 / 16.0 GBQ4Fits
Nanbeige4.1-3B3.9B params · Nanbeige3.7 / 16.0 GBQ4Fits
Nanbeige4-3B-Thinking-25113.9B params · Nanbeige3.7 / 16.0 GBQ4Fits
Phi-4-mini-flash-reasoning3.9B params · microsoft3.7 / 16.0 GBQ4Fits
Phi-4-mini-instruct3.8B params · microsoft3.7 / 16.0 GBQ4Fits
Phi-4-mini-reasoning3.8B params · microsoft3.7 / 16.0 GBQ4Fits
Nemotron-Labs-Diffusion-3B3.8B params · nvidia3.7 / 16.0 GBQ4Fits
Phi-3.5-mini-instruct3.8B params · microsoft3.7 / 16.0 GBQ4Fits
MediPhi-Instruct3.8B params · microsoft3.7 / 16.0 GBQ4Fits
MediPhi3.8B params · microsoft3.7 / 16.0 GBQ4Fits
MediPhi-Clinical3.8B params · microsoft3.7 / 16.0 GBQ4Fits
MediPhi-PubMed3.8B params · microsoft3.7 / 16.0 GBQ4Fits
HY-Embodied-0.53.8B params · tencent3.6 / 16.0 GBQ4Fits
Phi-tiny-MoE-instruct3.8B params · microsoft3.6 / 16.0 GBQ4Fits
CapRL-3B3.8B params · internlm3.6 / 16.0 GBQ4Fits
HyperCLOVAX-SEED-Vision-Instruct-3B3.7B params · naver-hyperclovax3.6 / 16.0 GBQ4Fits
kanana-1.5-v-3b-instruct3.7B params · kakaocorp3.6 / 16.0 GBQ4Fits
granite-4.2-3b3.7B params · ibm-granite3.6 / 16.0 GBQ4Fits
kanana-2-3b-instruct3.5B params · kakaocorp3.4 / 16.0 GBQ4Fits
granite-4.1-3b3.4B params · ibm-granite3.4 / 16.0 GBQ4Fits
granite-4.0-micro3.4B params · ibm-granite3.4 / 16.0 GBQ4Fits
granite-3.1-3b-a800m-instruct3.3B params · ibm-granite3.3 / 16.0 GBQ4Fits
Falcon3-3B-Instruct3.2B params · tiiuae3.3 / 16.0 GBQ4Fits
Llama-3.2-3B-Instruct3.2B params · meta-llama3.2 / 16.0 GBQ4Fits
Llama-3.2-3B3.2B params · meta-llama3.2 / 16.0 GBQ4Fits
Hermes-3-Llama-3.2-3B3.2B params · NousResearch3.2 / 16.0 GBQ4Fits
DeepHermes-3-Llama-3-3B-Preview3.2B params · NousResearch3.2 / 16.0 GBQ4Fits
AI21-Jamba-Reasoning-3B3.2B params · ai21labs3.2 / 16.0 GBQ4Fits
granite-4.0-h-micro3.2B params · ibm-granite3.2 / 16.0 GBQ4Fits
Falcon-H1-3B-Instruct3.1B params · tiiuae3.2 / 16.0 GBQ4Fits
d1-3B3.1B params · LiquidAI3.2 / 16.0 GBQ4Fits
LFM2.5-VL-3B3.1B params · LiquidAI3.2 / 16.0 GBQ4Fits
Qwen2.5-3B-Instruct3.1B params · Qwen3.2 / 16.0 GBQ4Fits
Qwen2.5-Coder-3B-Instruct3.1B params · Qwen3.2 / 16.0 GBQ4Fits
Qwen2.5-3B3.1B params · Qwen3.2 / 16.0 GBQ4Fits
Qwen2.5-Coder-3B3.1B params · Qwen3.2 / 16.0 GBQ4Fits
SmolLM3-3B3.1B params · HuggingFaceTB3.1 / 16.0 GBQ4Fits
AI21-Jamba2-3B3.0B params · ai21labs3.1 / 16.0 GBQ4Fits
granite-swash-3b-a600m3.0B params · ibm-granite3.1 / 16.0 GBQ4Fits
granite-vision-3.2-2b3.0B params · ibm-granite3.1 / 16.0 GBQ4Fits
granite-vision-3.1-2b-preview3.0B params · ibm-granite3.1 / 16.0 GBQ4Fits
granite-vision-3.3-2b-chart2csv-preview3.0B params · ibm-granite3.1 / 16.0 GBQ4Fits
LFM2.5-2.6B2.7B params · LiquidAI2.9 / 16.0 GBQ4Fits
Zamba2-2.7B2.7B params · Zyphra2.9 / 16.0 GBQ4Fits
Zamba2-2.7B-instruct2.7B params · Zyphra2.9 / 16.0 GBQ4Fits
granite-3.0-2b-instruct2.6B params · ibm-granite2.8 / 16.0 GBQ4Fits
gemma-2-2b-it2.6B params · google2.8 / 16.0 GBQ4Fits
gemma-2-2b2.6B params · google2.8 / 16.0 GBQ4Fits
EuroMoE-2.6B-A0.6B-Instruct-Preview2.6B params · utter-project2.8 / 16.0 GBQ4Fits
Motif-2.6B2.6B params · Motif-Technologies2.8 / 16.0 GBQ4Fits
LFM2-2.6B2.6B params · LiquidAI2.8 / 16.0 GBQ4Fits
LFM2-2.6B-Exp2.6B params · LiquidAI2.8 / 16.0 GBQ4Fits
LFM2-2.6B-Transcript2.6B params · LiquidAI2.8 / 16.0 GBQ4Fits
granite-3.3-2b-instruct2.5B params · ibm-granite2.8 / 16.0 GBQ4Fits
granite-3.1-2b-instruct2.5B params · ibm-granite2.8 / 16.0 GBQ4Fits
granite-3.2-2b-instruct2.5B params · ibm-granite2.8 / 16.0 GBQ4Fits
MiniCPM5-2B2.5B params · openbmb2.8 / 16.0 GBQ4Fits
MiniCPM5-2B-SFT2.5B params · openbmb2.8 / 16.0 GBQ4Fits
MiniCPM5-2B-Midtrain2.5B params · openbmb2.8 / 16.0 GBQ4Fits
sarvam-1-v0.52.5B params · sarvamai2.7 / 16.0 GBQ4Fits
North-Micro-Vision-Instruct2.5B params · CohereLabs2.7 / 16.0 GBQ4Fits
UI-TARS-2B-SFT2.4B params · ByteDance-Seed2.7 / 16.0 GBQ4Fits
WeVisOne-VL-2B2.4B params · tencent2.7 / 16.0 GBQ4Fits
UI-Venus-1.5-2B2.4B params · inclusionAI2.7 / 16.0 GBQ4Fits
bitnet-b1.58-2B-4T-bf162.4B params · microsoft2.7 / 16.0 GBQ4Fits
EXAONE-3.5-2.4B-Instruct2.4B params · LGAI-EXAONE2.7 / 16.0 GBQ4Fits
EXAONE-Deep-2.4B2.4B params · LGAI-EXAONE2.7 / 16.0 GBQ4Fits
kanana-1.5-2.1b-instruct-25052.3B params · kakaocorp2.6 / 16.0 GBQ4Fits
Qwen3.5-2B2.3B params · Qwen2.6 / 16.0 GBQ4Fits
salamandra-2b2.3B params · BSC-LT2.6 / 16.0 GBQ4Fits
salamandra-2b-instruct2.3B params · BSC-LT2.6 / 16.0 GBQ4Fits
SmolVLM2-2.2B-Instruct2.2B params · HuggingFaceTB2.6 / 16.0 GBQ4Fits
SmolVLM-Base2.2B params · HuggingFaceTB2.6 / 16.0 GBQ4Fits
Qwen2-VL-2B-Instruct2.2B params · Qwen2.5 / 16.0 GBQ4Fits
LFM3-Omni-2B2.2B params · LiquidAI2.5 / 16.0 GBQ4Fits
granite-swash-2b2.1B params · ibm-granite2.5 / 16.0 GBQ4Fits
Qwen3-VL-2B-Instruct2.1B params · Qwen2.5 / 16.0 GBQ4Fits
kanana-nano-2.1b-instruct2.1B params · kakaocorp2.5 / 16.0 GBQ4Fits
Hy-MT2-1.8B2.0B params · tencent2.4 / 16.0 GBQ4Fits
Qwen3-1.7B2.0B params · Qwen2.4 / 16.0 GBQ4Fits
Youtu-LLM-2B2.0B params · tencent2.4 / 16.0 GBQ4Fits
LFM3-VL-2B1.9B params · LiquidAI2.3 / 16.0 GBQ4Fits
d1-2B1.9B params · LiquidAI2.3 / 16.0 GBQ4Fits
FastVLM-1.5B1.9B params · apple2.3 / 16.0 GBQ4Fits
internlm2_5-1_8b-chat1.9B params · internlm2.3 / 16.0 GBQ4Fits
DeepSeek-R1-Distill-Qwen-1.5B1.8B params · deepseek-ai2.2 / 16.0 GBQ4Fits
LFM3-1.7B1.7B params · LiquidAI2.2 / 16.0 GBQ4Fits
Qwen3-1.7B-Base1.7B params · Qwen2.2 / 16.0 GBQ4Fits
SmolLM2-1.7B1.7B params · HuggingFaceTB2.2 / 16.0 GBQ4Fits
SmolLM-1.7B1.7B params · HuggingFaceTB2.2 / 16.0 GBQ4Fits
Spark-X2.6-1.7B1.7B params · XHToken2.2 / 16.0 GBQ4Fits
Falcon3-1B-Instruct1.7B params · tiiuae2.2 / 16.0 GBQ4Fits
EuroLLM-1.7B-Instruct1.7B params · utter-project2.2 / 16.0 GBQ4Fits
granite-4.0-1b1.6B params · ibm-granite2.1 / 16.0 GBQ4Fits
LFM2.5-VL-1.6B1.6B params · LiquidAI2.1 / 16.0 GBQ4Fits
glm-edge-1.5b-chat1.6B params · zai-org2.1 / 16.0 GBQ4Fits
LFM2-VL-1.6B1.6B params · LiquidAI2.1 / 16.0 GBQ4Fits
Falcon-H1-1.5B-Deep-Instruct1.6B params · tiiuae2.1 / 16.0 GBQ4Fits
Falcon-H1-1.5B-Instruct1.6B params · tiiuae2.1 / 16.0 GBQ4Fits
MiniCPM-V-4.7-1B1.6B params · openbmb2.1 / 16.0 GBQ4Fits
Qwen2.5-1.5B-Instruct1.5B params · Qwen2.1 / 16.0 GBQ4Fits
Qwen2.5-1.5B1.5B params · Qwen2.1 / 16.0 GBQ4Fits
Qwen2.5-Coder-1.5B-Instruct1.5B params · Qwen2.1 / 16.0 GBQ4Fits
Qwen2.5-Coder-1.5B1.5B params · Qwen2.1 / 16.0 GBQ4Fits
Qwen2.5-Math-1.5B1.5B params · Qwen2.1 / 16.0 GBQ4Fits
Qwen2-1.5B-Instruct1.5B params · Qwen2.1 / 16.0 GBQ4Fits
Qwen2.5-Math-1.5B-Instruct1.5B params · Qwen2.1 / 16.0 GBQ4Fits
ReaderLM-v21.5B params · jinaai2.1 / 16.0 GBQ4Fits
reader-lm-1.5b1.5B params · jinaai2.1 / 16.0 GBQ4Fits
Hymba-1.5B-Instruct1.5B params · nvidia2.1 / 16.0 GBQ4Fits
OLMo-2-0425-1B1.5B params · allenai2.0 / 16.0 GBQ4Fits
OLMo-2-0425-1B-Instruct1.5B params · allenai2.0 / 16.0 GBQ4Fits
Yi-Coder-1.5B-Chat1.5B params · 01-ai2.0 / 16.0 GBQ4Fits
Bolmo-1B1.5B params · allenai2.0 / 16.0 GBQ4Fits
granite-4.0-h-1b1.5B params · ibm-granite2.0 / 16.0 GBQ4Fits
granite-3.1-1b-a400m-instruct1.3B params · ibm-granite1.9 / 16.0 GBQ4Fits
granite-3.0-1b-a400m-instruct1.3B params · ibm-granite1.9 / 16.0 GBQ4Fits
MiniCPM-V-4.61.3B params · openbmb1.9 / 16.0 GBQ4Fits
MiniCPM-V-4.6-Thinking1.3B params · openbmb1.9 / 16.0 GBQ4Fits
kanana-2-1.3b-instruct1.3B params · kakaocorp1.9 / 16.0 GBQ4Fits
OLMo-1B-0724-hf1.3B params · allenai1.9 / 16.0 GBQ4Fits
EXAONE-4.0-1.2B1.3B params · LGAI-EXAONE1.9 / 16.0 GBQ4Fits
Llama-3.2-1B-Instruct1.2B params · meta-llama1.9 / 16.0 GBQ4Fits
Llama-3.2-1B1.2B params · meta-llama1.9 / 16.0 GBQ4Fits
Llama-3.2-1B1.2B params · NousResearch1.9 / 16.0 GBQ4Fits
Zamba2-1.2B-instruct1.2B params · Zyphra1.8 / 16.0 GBQ4Fits
HRM-Text-1B1.2B params · sapientinc1.8 / 16.0 GBQ4Fits
AMD-OLMo-1B1.2B params · amd1.8 / 16.0 GBQ4Fits
LFM2.5-1.2B-Instruct1.2B params · LiquidAI1.8 / 16.0 GBQ4Fits
LFM2-1.2B1.2B params · LiquidAI1.8 / 16.0 GBQ4Fits
LFM2.5-1.2B-Thinking1.2B params · LiquidAI1.8 / 16.0 GBQ4Fits
LFM2.5-1.2B-JP-2026061.2B params · LiquidAI1.8 / 16.0 GBQ4Fits
MiniCPM5-1B1.1B params · openbmb1.8 / 16.0 GBQ4Fits
MiniCPM5-1B-SFT1.1B params · openbmb1.8 / 16.0 GBQ4Fits
gemma-3-1b-it1.0B params · google1.7 / 16.0 GBQ4Fits
gemma-3-1b-pt1.0B params · google1.7 / 16.0 GBQ4Fits
Qwen3.5-0.8B0.9B params · Qwen1.6 / 16.0 GBQ4Fits
Falcon-E-3B-Instruct0.9B params · tiiuae1.6 / 16.0 GBQ4Fits
bitnet-b1.58-2B-4T0.8B params · microsoft1.6 / 16.0 GBQ4Fits
FastVLM-0.5B0.8B params · apple1.5 / 16.0 GBQ4Fits
Qwen3-0.6B0.8B params · Qwen1.5 / 16.0 GBQ4Fits
LFM2-700M0.7B params · LiquidAI1.5 / 16.0 GBQ4Fits
Falcon-H1-Tiny-R-0.6B0.6B params · tiiuae1.4 / 16.0 GBQ4Fits
Qwen3-0.6B-Base0.6B params · Qwen1.4 / 16.0 GBQ4Fits
d1-omni-600M0.6B params · LiquidAI1.4 / 16.0 GBQ4Fits
HyperCLOVAX-SEED-Text-Instruct-0.5B0.6B params · naver-hyperclovax1.4 / 16.0 GBQ4Fits
Falcon-H1-0.5B-Instruct0.5B params · tiiuae1.4 / 16.0 GBQ4Fits
Qwen2.5-0.5B-Instruct0.5B params · Qwen1.3 / 16.0 GBQ4Fits
Qwen2.5-0.5B0.5B params · Qwen1.3 / 16.0 GBQ4Fits
Qwen2-0.5B-Instruct0.5B params · Qwen1.3 / 16.0 GBQ4Fits
Qwen2.5-Coder-0.5B-Instruct0.5B params · Qwen1.3 / 16.0 GBQ4Fits
LFM2-VL-450M0.5B params · LiquidAI1.3 / 16.0 GBQ4Fits
LFM2.5-VL-450M0.4B params · LiquidAI1.3 / 16.0 GBQ4Fits
Apertus-v1.1-0.5B0.4B params · swiss-ai1.3 / 16.0 GBQ4Fits
MiniCPM4-0.5B0.4B params · openbmb1.3 / 16.0 GBQ4Fits
circuit-sparsity0.4B params · openai1.3 / 16.0 GBQ4Fits
SmolLM2-360M0.4B params · HuggingFaceTB1.3 / 16.0 GBQ4Fits
SmolLM-360M0.4B params · HuggingFaceTB1.3 / 16.0 GBQ4Fits
ERNIE-4.5-0.3B-PT0.4B params · baidu1.3 / 16.0 GBQ4Fits
LFM2.5-350M0.4B params · LiquidAI1.2 / 16.0 GBQ4Fits
LFM2-350M0.4B params · LiquidAI1.2 / 16.0 GBQ4Fits
granite-4.0-350m0.4B params · ibm-granite1.2 / 16.0 GBQ4Fits
granite-4.0-h-350m0.3B params · ibm-granite1.2 / 16.0 GBQ4Fits

Estimates use our formula (weights × 1.15 + 1 GB, about 4k context). Past 4k we add the KV cache from each model’s published config.json; models marked “cache not modeled” use an attention design we can’t size yet, so leave extra headroom for them. This checks memory fit only, not speed. Share your result: the page URL updates as you type.

New models, and what they need to run

One short email a week: fresh open models with their VRAM numbers, plus hardware worth watching.

Or subscribe here