# Two used RTX 3060 12GB cards for 24 GB | What Can I Run AI? > Two used RTX 3060 12GB cards for 24 GB: parts, total $2,208, 24.0 GB usable, estimated speed, PSU math and fit checks. Source: https://whatcanirunai.vercel.app/builds/dual-used-rtx-3060-24gb/ [Builds](https://whatcanirunai.vercel.app/builds/) # Two used RTX 3060 12GB cards for 24 GB 24 GB total from cheap used cards. The catch is bandwidth: each card has only 360 GB/s. Total $2,208 Usable memory 24.0 GB Qwen3-32B Q4 Tight Est. tok/s 11–15 PSU needed 750 W $ per tok/s $168 ## Parts | Part | Item | Price | Buy | | ------------ | ----------------------------------------------------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------- | | GPU | 2× Used RTX 3060 12GB (Gigabyte Eagle OC, "Like New") | $780[used listing](https://www.newegg.com/gigabyte-gv-n3060eagle-oc-12gd-geforce-rtx-3060-12gb-graphics-card-windforce-2x/p/N82E16814932403) | [Amazon](https://www.amazon.com/s?k=RTX%203060%2012GB&tag=whatcanirunai-20) | | CPU | AMD Ryzen 5 9600X | $219[Newegg price (sold by Newegg)](https://www.newegg.com/p/N82E16819113844) | [Amazon](https://www.amazon.com/s?k=AMD%20Ryzen%205%209600X&tag=whatcanirunai-20) | | Motherboard | ASUS TUF GAMING B650E-PLUS WIFI | $150[Newegg price (sold by Newegg)](https://www.newegg.com/p/N82E16813119739) | [Amazon](https://www.amazon.com/s?k=ASUS%20TUF%20GAMING%20B650E-PLUS%20WIFI&tag=whatcanirunai-20) | | RAM | Corsair Vengeance 32GB (2x16) DDR5-6000 C36 | $644[Corsair store price](https://www.corsair.com/us/en/p/memory/cmk32gx5m2b6000c36/vengeance-32gb-2x16gb-ddr5-dram-6000mhz-c36-memory-kit-black-cmk32gx5m2b6000c36) | [Amazon](https://www.amazon.com/s?k=Corsair%20Vengeance%2032GB%20%282x16%29%20DDR5-6000%20C36&tag=whatcanirunai-20) | | Power supply | Corsair RM850x | $140[Corsair store price](https://www.corsair.com/us/en/p/psu/cp-9020270-na/rmx-series-rm850x-fully-modular-power-supply-cp-9020270-na) | [Amazon](https://www.amazon.com/s?k=Corsair%20RM850x&tag=whatcanirunai-20) | | Case | Corsair FRAME 4000D RS | $85[Corsair store price](https://www.corsair.com/us/en/p/pc-cases/cc-9011312-ww/frame-4000d-rs-modular-mid-tower-pc-case-cc-9011312-ww) | [Amazon](https://www.amazon.com/s?k=Corsair%20FRAME%204000D%20RS&tag=whatcanirunai-20) | | Storage | Samsung 990 1TB NVMe | $190[Newegg price (sold by Newegg)](https://www.newegg.com/p/N82E16820147922) | [Amazon](https://www.amazon.com/s?k=Samsung%20990%201TB%20NVMe&tag=whatcanirunai-20) | | Total | **$2,208** | | | We may earn a commission when you buy through these links, at no extra cost to you. Prices are dated snapshots (2026-10-23 for parts; GPUs at list price unless marked used). Used prices come from one dated listing each. ## Will Qwen3-32B run? | Model | Q4\_K\_M | Q8\_0 | FP16 | Est. tok/s (Q4) | | -------------------------------------------- | -------- | --------- | --------- | --------------- | | [Qwen3-32B](https://whatcanirunai.vercel.app/models/qwen3-32b/)23.8 GB at Q4 | Tight | Won’t fit | Won’t fit | 11–15 | Tok/s = memory bandwidth ÷ model weight size × a 60–85% efficiency band, calibrated on llama.cpp scoreboards. Mixture-of-experts models show only an upper bound ("up to"). [How we estimate speed](https://whatcanirunai.vercel.app/method/#speed). Multi-GPU layer split runs the cards one after another, so speed is about that of one card on the whole model, not double. ## Power math (GPU 170×2 W + CPU 65 W + 150 W rest of system) × 1.3 = 722 W → 750 W PSU Running cost at full load: about 555 W, so **$0.10/hour** at an example $0.18/kWh (enter your own rate in the [planner](https://whatcanirunai.vercel.app/planner/)). Decode rarely holds the GPUs at full board power, so treat this as a ceiling. ## Fit checks * PSU: 850 W vs. 722 W recommended ((GPU 340 W + CPU 65 W + 150 W) × 1.3). Headroom 129 W. * Power connectors: need 2× PCIe 8-pin; PSU has 1× 12V-2x6 + 3× 8-pin. * Motherboard: 2 GPUs on 2 x16-size slots (1x PCIe 5.0 x16 (CPU, x16) + 1x PCIe 4.0 x16-size (chipset, x4; shares bandwidth with M.2\_3)). * Card length is not on the reference spec page (partner cards vary). Case limit is 430 mm. * Second card runs at PCIe x4\. Fine for llama.cpp layer split (little traffic), slower for tensor parallel and model loading. * Slot spacing: check both cards physically fit side by side on this board. We don’t model slot positions. ## All models on this build | Model | Q4\_K\_M | Q8\_0 | FP16 | Est. tok/s (Q4) | | ---------------------------------------------------------------------------------------------------------------------- | --------- | --------- | --------- | --------------- | | [Kimi-K3.1-Pro](https://whatcanirunai.vercel.app/models/kimi-k3.1-pro/)1939.3 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Kimi-K3](https://whatcanirunai.vercel.app/models/kimi-k3/)1939.1 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3.8-2.4T-A95B](https://whatcanirunai.vercel.app/models/qwen3.8-2.4t-a95b/)1706.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [LongCat-2.5](https://whatcanirunai.vercel.app/models/longcat-2.5/)1241.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [LongCat-2.0](https://whatcanirunai.vercel.app/models/longcat-2.0/)1238.9 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-V4-Pro-0813](https://whatcanirunai.vercel.app/models/deepseek-v4-pro-0813/)1151.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-V4-Pro](https://whatcanirunai.vercel.app/models/deepseek-v4-pro/)1115.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Kimi-K2.5](https://whatcanirunai.vercel.app/models/kimi-k2.5/)716.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Kimi-K2.6](https://whatcanirunai.vercel.app/models/kimi-k2.6/)716.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Kimi-K2.7-Code](https://whatcanirunai.vercel.app/models/kimi-k2.7-code/)716.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Kimi-K2-Thinking](https://whatcanirunai.vercel.app/models/kimi-k2-thinking/)716.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Kimi-K2-Instruct-0905](https://whatcanirunai.vercel.app/models/kimi-k2-instruct-0905/)716.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Kimi-K2-Instruct](https://whatcanirunai.vercel.app/models/kimi-k2-instruct/)716.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiMo-V2.6-Pro-RL](https://whatcanirunai.vercel.app/models/mimo-v2.6-pro-rl/)715.1 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiMo-V2.6-Pro-MOPD](https://whatcanirunai.vercel.app/models/mimo-v2.6-pro-mopd/)715.1 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiMo-V2.5-Pro](https://whatcanirunai.vercel.app/models/mimo-v2.5-pro/)714.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ring-2.5-1T](https://whatcanirunai.vercel.app/models/ring-2.5-1t/)706.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ling-2.5-1T](https://whatcanirunai.vercel.app/models/ling-2.5-1t/)706.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ling-1T](https://whatcanirunai.vercel.app/models/ling-1t/)698.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ring-1T](https://whatcanirunai.vercel.app/models/ring-1t/)698.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Inkling](https://whatcanirunai.vercel.app/models/inkling/)665.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Intern-S1-Pro](https://whatcanirunai.vercel.app/models/intern-s1-pro/)640.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Muse-Spark-Open-816B-A42B](https://whatcanirunai.vercel.app/models/muse-spark-open-816b-a42b/)574.1 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Hy4-preview](https://whatcanirunai.vercel.app/models/hy4-preview/)544.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [GLM-5](https://whatcanirunai.vercel.app/models/glm-5/)526.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [GLM-5.1](https://whatcanirunai.vercel.app/models/glm-5.1/)526.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [GLM-5.3](https://whatcanirunai.vercel.app/models/glm-5.3/)526.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [GLM-5.2](https://whatcanirunai.vercel.app/models/glm-5.2/)526.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [GLM-5.3-BF16](https://whatcanirunai.vercel.app/models/glm-5.3-bf16/)526.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [K-EXAONE-2.0-750B-A37B](https://whatcanirunai.vercel.app/models/k-exaone-2.0-750b-a37b/)523.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-V3.2-Exp](https://whatcanirunai.vercel.app/models/deepseek-v3.2-exp/)478.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-V3.2-Speciale](https://whatcanirunai.vercel.app/models/deepseek-v3.2-speciale/)478.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-V3.2](https://whatcanirunai.vercel.app/models/deepseek-v3.2/)478.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-V3-0324](https://whatcanirunai.vercel.app/models/deepseek-v3-0324/)478.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-R1-0528](https://whatcanirunai.vercel.app/models/deepseek-r1-0528/)478.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-V3.1-Base](https://whatcanirunai.vercel.app/models/deepseek-v3.1-base/)478.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-R1](https://whatcanirunai.vercel.app/models/deepseek-r1/)478.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-R1-Zero](https://whatcanirunai.vercel.app/models/deepseek-r1-zero/)478.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Step-5-Preview](https://whatcanirunai.vercel.app/models/step-5-preview/)422.3 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ling-3.1-flash](https://whatcanirunai.vercel.app/models/ling-3.1-flash/)399.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ling-3.1-flash-1019](https://whatcanirunai.vercel.app/models/ling-3.1-flash-1019/)399.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [LongCat-Flash-Chat](https://whatcanirunai.vercel.app/models/longcat-flash-chat/)392.7 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [LongCat-Flash-Thinking](https://whatcanirunai.vercel.app/models/longcat-flash-thinking/)392.7 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [LongCat-Flash-Thinking-2601](https://whatcanirunai.vercel.app/models/longcat-flash-thinking-2601/)392.7 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16](https://whatcanirunai.vercel.app/models/nvidia-nemotron-3-ultra-550b-a55b-bf16/)391.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Beam-1.0-501B-A23B](https://whatcanirunai.vercel.app/models/beam-1.0-501b-a23b/)350.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3-Coder-480B-A35B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-coder-480b-a35b-instruct/)335.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiniMax-M1-40k](https://whatcanirunai.vercel.app/models/minimax-m1-40k/)319.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiniMax-M1-80k](https://whatcanirunai.vercel.app/models/minimax-m1-80k/)319.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiniMax-M3](https://whatcanirunai.vercel.app/models/minimax-m3/)298.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [ERNIE-4.5-VL-424B-A47B-PT](https://whatcanirunai.vercel.app/models/ernie-4.5-vl-424b-a47b-pt/)296.3 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Intern-S2-397B](https://whatcanirunai.vercel.app/models/intern-s2-397b/)282.3 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3.5-397B-A17B](https://whatcanirunai.vercel.app/models/qwen3.5-397b-a17b/)282.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Llama-4-Maverick-17B-128E-Instruct](https://whatcanirunai.vercel.app/models/llama-4-maverick-17b-128e-instruct/)281.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Trinity-Large-Thinking](https://whatcanirunai.vercel.app/models/trinity-large-thinking/)278.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Trinity-Large-Preview](https://whatcanirunai.vercel.app/models/trinity-large-preview/)278.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Trinity-Large-TrueBase](https://whatcanirunai.vercel.app/models/trinity-large-truebase/)278.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Trinity-Large-Base](https://whatcanirunai.vercel.app/models/trinity-large-base/)278.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Nex-N2.5-Pro](https://whatcanirunai.vercel.app/models/nex-n2.5-pro/)277.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Nex-N2-Pro](https://whatcanirunai.vercel.app/models/nex-n2-pro/)277.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [NorthCUA-Pro](https://whatcanirunai.vercel.app/models/northcua-pro/)277.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [GLM-4.5](https://whatcanirunai.vercel.app/models/glm-4.5/)250.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [GLM-4.7](https://whatcanirunai.vercel.app/models/glm-4.7/)250.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [GLM-4.6](https://whatcanirunai.vercel.app/models/glm-4.6/)249.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [GLM-5.3-Flash](https://whatcanirunai.vercel.app/models/glm-5.3-flash/)225.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Motif-3](https://whatcanirunai.vercel.app/models/motif-3/)220.5 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [MiMo-V2.5](https://whatcanirunai.vercel.app/models/mimo-v2.5/)217.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiMo-V2.6-Flash-RL](https://whatcanirunai.vercel.app/models/mimo-v2.6-flash-rl/)217.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiMo-V2.6-Flash-MOPD](https://whatcanirunai.vercel.app/models/mimo-v2.6-flash-mopd/)217.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiMo-V2-Flash](https://whatcanirunai.vercel.app/models/mimo-v2-flash/)217.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-V4-Flash-Vision-Exp](https://whatcanirunai.vercel.app/models/deepseek-v4-flash-vision-exp/)213.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-V4-Flash-0731](https://whatcanirunai.vercel.app/models/deepseek-v4-flash-0731/)213.1 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [ERNIE-4.5-300B-A47B-PT](https://whatcanirunai.vercel.app/models/ernie-4.5-300b-a47b-pt/)210.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Hy3](https://whatcanirunai.vercel.app/models/hy3/)209.3 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Hy3-preview](https://whatcanirunai.vercel.app/models/hy3-preview/)209.3 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ling-plus](https://whatcanirunai.vercel.app/models/ling-plus/)205.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-V4-Flash](https://whatcanirunai.vercel.app/models/deepseek-v4-flash/)203.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MemT-1.0-Flash](https://whatcanirunai.vercel.app/models/memt-1.0-flash/)201.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [ERNIE-5.5-Flash-Base](https://whatcanirunai.vercel.app/models/ernie-5.5-flash-base/)200.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Inkling-Small](https://whatcanirunai.vercel.app/models/inkling-small/)186.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Llama-3\_1-Nemotron-Ultra-253B-v1](https://whatcanirunai.vercel.app/models/llama-3-1-nemotron-ultra-253b-v1/)177.7 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Solar-Open2-250B](https://whatcanirunai.vercel.app/models/solar-open2-250b/)175.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Intern-S1](https://whatcanirunai.vercel.app/models/intern-s1/)168.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [K-EXAONE-236B-A23B](https://whatcanirunai.vercel.app/models/k-exaone-236b-a23b/)166.3 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-V2.5](https://whatcanirunai.vercel.app/models/deepseek-v2.5/)165.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-Coder-V2-Instruct](https://whatcanirunai.vercel.app/models/deepseek-coder-v2-instruct/)165.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-V2.5-1210](https://whatcanirunai.vercel.app/models/deepseek-v2.5-1210/)165.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-V2-Chat-0628](https://whatcanirunai.vercel.app/models/deepseek-v2-chat-0628/)165.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-Coder-V2-Instruct-0724](https://whatcanirunai.vercel.app/models/deepseek-coder-v2-instruct-0724/)165.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3-VL-235B-A22B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-vl-235b-a22b-instruct/)165.3 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3-235B-A22B](https://whatcanirunai.vercel.app/models/qwen3-235b-a22b/)164.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3-235B-A22B-Instruct-2507](https://whatcanirunai.vercel.app/models/qwen3-235b-a22b-instruct-2507/)164.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3-235B-A22B-Thinking-2507](https://whatcanirunai.vercel.app/models/qwen3-235b-a22b-thinking-2507/)164.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiniMax-M2](https://whatcanirunai.vercel.app/models/minimax-m2/)160.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiniMax-M2.5](https://whatcanirunai.vercel.app/models/minimax-m2.5/)160.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiniMax-M2.7](https://whatcanirunai.vercel.app/models/minimax-m2.7/)160.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiniMax-M2.1](https://whatcanirunai.vercel.app/models/minimax-m2.1/)160.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [command-a-plus-05-2026-bf16](https://whatcanirunai.vercel.app/models/command-a-plus-05-2026-bf16/)153.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Step-3.7-Flash](https://whatcanirunai.vercel.app/models/step-3.7-flash/)141.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Step-3.5-Flash](https://whatcanirunai.vercel.app/models/step-3.5-flash/)140.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Step-3.5-Flash-Base-Midtrain](https://whatcanirunai.vercel.app/models/step-3.5-flash-base-midtrain/)138.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3.8-Flash-Next](https://whatcanirunai.vercel.app/models/qwen3.8-flash-next/)126.5 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Mixtral-8x22B-Instruct-v0.1](https://whatcanirunai.vercel.app/models/mixtral-8x22b-instruct-v0.1/)99.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ling-3.0-flash-Sante](https://whatcanirunai.vercel.app/models/ling-3.0-flash-sante/)89.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ling-3.0-flash](https://whatcanirunai.vercel.app/models/ling-3.0-flash/)89.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ling-3.0-flash-Fin](https://whatcanirunai.vercel.app/models/ling-3.0-flash-fin/)89.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ornith-1.5-122B](https://whatcanirunai.vercel.app/models/ornith-1.5-122b/)88.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3.5-122B-A10B](https://whatcanirunai.vercel.app/models/qwen3.5-122b-a10b/)88.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Devstral-2-123B-Instruct-2512](https://whatcanirunai.vercel.app/models/devstral-2-123b-instruct-2512/)88.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Ling-3.0-flash-VL](https://whatcanirunai.vercel.app/models/ling-3.0-flash-vl/)88.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [NVIDIA-Nemotron-3-Super-120B-A12B-BF16](https://whatcanirunai.vercel.app/models/nvidia-nemotron-3-super-120b-a12b-bf16/)87.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Mistral-Small-4-119B-2603](https://whatcanirunai.vercel.app/models/mistral-small-4-119b-2603/)84.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Youtu-LLM-A7B-Base](https://whatcanirunai.vercel.app/models/youtu-llm-a7b-base/)83.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Laguna-S-2.1](https://whatcanirunai.vercel.app/models/laguna-s-2.1/)83.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [gpt-oss-120b](https://whatcanirunai.vercel.app/models/gpt-oss-120b/)82.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [c4ai-command-a-03-2025](https://whatcanirunai.vercel.app/models/c4ai-command-a-03-2025/)78.4 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [GLM-4.5-Air](https://whatcanirunai.vercel.app/models/glm-4.5-air/)78.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Llama-4-Scout-17B-16E-Instruct](https://whatcanirunai.vercel.app/models/llama-4-scout-17b-16e-instruct/)76.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Llama-4-Scout-17B-16E](https://whatcanirunai.vercel.app/models/llama-4-scout-17b-16e/)76.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [GLM-4.5V](https://whatcanirunai.vercel.app/models/glm-4.5v/)76.1 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [GLM-4.6V](https://whatcanirunai.vercel.app/models/glm-4.6v/)76.1 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ling-2.6-flash](https://whatcanirunai.vercel.app/models/ling-2.6-flash/)75.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [sarvam-105b](https://whatcanirunai.vercel.app/models/sarvam-105b/)74.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ling-flash-2.0](https://whatcanirunai.vercel.app/models/ling-flash-2.0/)72.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [LLaDA2.1-flash](https://whatcanirunai.vercel.app/models/llada2.1-flash/)72.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ring-flash-2.0](https://whatcanirunai.vercel.app/models/ring-flash-2.0/)72.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [LLaDA2.2-flash](https://whatcanirunai.vercel.app/models/llada2.2-flash/)72.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Solar-Open-100B](https://whatcanirunai.vercel.app/models/solar-open-100b/)72.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3-Next-80B-A3B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-next-80b-a3b-instruct/)57.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3-Next-80B-A3B-Thinking](https://whatcanirunai.vercel.app/models/qwen3-next-80b-a3b-thinking/)57.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [AliceAI-Foundation-80B-A3B-Base](https://whatcanirunai.vercel.app/models/aliceai-foundation-80b-a3b-base/)57.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Hunyuan-A13B-Instruct](https://whatcanirunai.vercel.app/models/hunyuan-a13b-instruct/)57.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3-Coder-Next](https://whatcanirunai.vercel.app/models/qwen3-coder-next/)56.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Kolibri-1](https://whatcanirunai.vercel.app/models/kolibri-1/)55.5 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen2.5-VL-72B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-vl-72b-instruct/)52.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [UI-TARS-72B-DPO](https://whatcanirunai.vercel.app/models/ui-tars-72b-dpo/)52.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen2.5-72B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-72b-instruct/)51.7 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Apertus-70B-Instruct-2509](https://whatcanirunai.vercel.app/models/apertus-70b-instruct-2509/)50.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Apertus-70B-2509](https://whatcanirunai.vercel.app/models/apertus-70b-2509/)50.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Llama-3.3-70B-Instruct](https://whatcanirunai.vercel.app/models/llama-3.3-70b-instruct/)50.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-R1-Distill-Llama-70B](https://whatcanirunai.vercel.app/models/deepseek-r1-distill-llama-70b/)50.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Llama-3.1-70B](https://whatcanirunai.vercel.app/models/llama-3.1-70b/)50.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Hermes-2-Theta-Llama-3-70B](https://whatcanirunai.vercel.app/models/hermes-2-theta-llama-3-70b/)50.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Meta-Llama-3.1-70B-Instruct](https://whatcanirunai.vercel.app/models/meta-llama-3.1-70b-instruct/)50.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [LongCat-Flash-Lite](https://whatcanirunai.vercel.app/models/longcat-flash-lite/)49.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [AI21-Jamba2-Mini](https://whatcanirunai.vercel.app/models/ai21-jamba2-mini/)37.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Llama-3\_1-Nemotron-51B-Instruct](https://whatcanirunai.vercel.app/models/llama-3-1-nemotron-51b-instruct/)36.9 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Llama-3\_3-Nemotron-Super-49B-v1\_5](https://whatcanirunai.vercel.app/models/llama-3-3-nemotron-super-49b-v1-5/)35.8 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Llama-3\_3-Nemotron-Super-49B-v1](https://whatcanirunai.vercel.app/models/llama-3-3-nemotron-super-49b-v1/)35.8 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Phi-3.5-MoE-instruct](https://whatcanirunai.vercel.app/models/phi-3.5-moe-instruct/)30.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [GRIN-MoE](https://whatcanirunai.vercel.app/models/grin-moe/)30.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [ALIA-40b](https://whatcanirunai.vercel.app/models/alia-40b/)29.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [IQuest-Coder-V1-40B-Loop-Instruct](https://whatcanirunai.vercel.app/models/iquest-coder-v1-40b-loop-instruct/)28.7 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [IQuest-Coder-V1-40B-Instruct](https://whatcanirunai.vercel.app/models/iquest-coder-v1-40b-instruct/)28.7 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Recursive Flint](https://whatcanirunai.vercel.app/models/flint/)28.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [K2-Horizon-MoVA-36B-A4B](https://whatcanirunai.vercel.app/models/k2-horizon-mova-36b-a4b/)27.1 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Seed-OSS-36B-Instruct](https://whatcanirunai.vercel.app/models/seed-oss-36b-instruct/)26.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Seed-OSS-36B-Base-woSyn](https://whatcanirunai.vercel.app/models/seed-oss-36b-base-wosyn/)26.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Intern-S2-Preview](https://whatcanirunai.vercel.app/models/intern-s2-preview/)26.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ornith-1.5-35B-A3B](https://whatcanirunai.vercel.app/models/ornith-1.5-35b-a3b/)26.1 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Sage-A1.5](https://whatcanirunai.vercel.app/models/sage-a1.5/)26.1 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3.6-35B-A3B](https://whatcanirunai.vercel.app/models/qwen3.6-35b-a3b/)26.1 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3.5-35B-A3B](https://whatcanirunai.vercel.app/models/qwen3.5-35b-a3b/)26.1 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Apex-35B-V1.0](https://whatcanirunai.vercel.app/models/apex-35b-v1.0/)26.1 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiniCPM-V-4.7-35B-A3B](https://whatcanirunai.vercel.app/models/minicpm-v-4.7-35b-a3b/)25.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MemT-1.0-Nano](https://whatcanirunai.vercel.app/models/memt-1.0-nano/)25.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Agents-A1](https://whatcanirunai.vercel.app/models/agents-a1/)25.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Nex-N2.5-mini](https://whatcanirunai.vercel.app/models/nex-n2.5-mini/)25.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Nex-N2-mini](https://whatcanirunai.vercel.app/models/nex-n2-mini/)25.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Axion-1.0-35B](https://whatcanirunai.vercel.app/models/axion-1.0-35b/)25.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [NorthCUA-Mini](https://whatcanirunai.vercel.app/models/northcua-mini/)25.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Clover-35B-A3B-Preview](https://whatcanirunai.vercel.app/models/clover-35b-a3b-preview/)25.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen-AgentWorld-35B-A3B](https://whatcanirunai.vercel.app/models/qwen-agentworld-35b-a3b/)25.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [KAT-Coder-V2.5-Dev](https://whatcanirunai.vercel.app/models/kat-coder-v2.5-dev/)25.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [EXAONE-4.5-33B](https://whatcanirunai.vercel.app/models/exaone-4.5-33b/)24.9 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Falcon-H1-34B-Instruct](https://whatcanirunai.vercel.app/models/falcon-h1-34b-instruct/)24.5 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen2.5-VL-32B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-vl-32b-instruct/)24.3 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Laguna-XS.2](https://whatcanirunai.vercel.app/models/laguna-xs.2/)24.3 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3-VL-32B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-vl-32b-instruct/)24.3 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [HyperCLOVAX-SEED-Think-32B](https://whatcanirunai.vercel.app/models/hyperclovax-seed-think-32b/)24.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [FlexOlmo-7x7B-1T](https://whatcanirunai.vercel.app/models/flexolmo-7x7b-1t/)24.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [GLM-Z1-Rumination-32B-0414](https://whatcanirunai.vercel.app/models/glm-z1-rumination-32b-0414/)24.1 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Nanbeige4.3-33B](https://whatcanirunai.vercel.app/models/nanbeige4.3-33b/)24.1 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16](https://whatcanirunai.vercel.app/models/nemotron-3-nano-omni-30b-a3b-reasoning-bf16/)24.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen2.5-Coder-32B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-coder-32b-instruct/)23.8 GB at Q4 | Tight | Won’t fit | Won’t fit | 11–15 | | [DeepSeek-R1-Distill-Qwen-32B](https://whatcanirunai.vercel.app/models/deepseek-r1-distill-qwen-32b/)23.8 GB at Q4 | Tight | Won’t fit | Won’t fit | 11–15 | | [Qwen2.5-32B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-32b-instruct/)23.8 GB at Q4 | Tight | Won’t fit | Won’t fit | 11–15 | | [QwQ-32B](https://whatcanirunai.vercel.app/models/qwq-32b/)23.8 GB at Q4 | Tight | Won’t fit | Won’t fit | 11–15 | | [QwQ-32B-Preview](https://whatcanirunai.vercel.app/models/qwq-32b-preview/)23.8 GB at Q4 | Tight | Won’t fit | Won’t fit | 11–15 | | [Qwen2.5-32B](https://whatcanirunai.vercel.app/models/qwen2.5-32b/)23.8 GB at Q4 | Tight | Won’t fit | Won’t fit | 11–15 | | [Qwen2.5-Coder-32B](https://whatcanirunai.vercel.app/models/qwen2.5-coder-32b/)23.8 GB at Q4 | Tight | Won’t fit | Won’t fit | 11–15 | | [Qwen3-32B](https://whatcanirunai.vercel.app/models/qwen3-32b/)23.8 GB at Q4 | Tight | Won’t fit | Won’t fit | 11–15 | | [GLM-Z1-32B-0414](https://whatcanirunai.vercel.app/models/glm-z1-32b-0414/)23.7 GB at Q4 | Tight | Won’t fit | Won’t fit | 11–15 | | [GLM-4-32B-0414](https://whatcanirunai.vercel.app/models/glm-4-32b-0414/)23.7 GB at Q4 | Tight | Won’t fit | Won’t fit | 11–15 | | [OLMo-2-0325-32B-Instruct](https://whatcanirunai.vercel.app/models/olmo-2-0325-32b-instruct/)23.5 GB at Q4 | Tight | Won’t fit | Won’t fit | 11–16 | | [OLMo-2-0325-32B](https://whatcanirunai.vercel.app/models/olmo-2-0325-32b/)23.5 GB at Q4 | Tight | Won’t fit | Won’t fit | 11–16 | | [Olmo-3-32B-Think](https://whatcanirunai.vercel.app/models/olmo-3-32b-think/)23.5 GB at Q4 | Tight | Won’t fit | Won’t fit | 11–16 | | [Olmo-3-1125-32B](https://whatcanirunai.vercel.app/models/olmo-3-1125-32b/)23.5 GB at Q4 | Tight | Won’t fit | Won’t fit | 11–16 | | [Olmo-3.1-32B-Instruct](https://whatcanirunai.vercel.app/models/olmo-3.1-32b-instruct/)23.5 GB at Q4 | Tight | Won’t fit | Won’t fit | 11–16 | | [Olmo-3.1-32B-Think](https://whatcanirunai.vercel.app/models/olmo-3.1-32b-think/)23.5 GB at Q4 | Tight | Won’t fit | Won’t fit | 11–16 | | [Olmo-3.1-32B-Instruct-DPO](https://whatcanirunai.vercel.app/models/olmo-3.1-32b-instruct-dpo/)23.5 GB at Q4 | Tight | Won’t fit | Won’t fit | 11–16 | | [granite-4.0-h-small](https://whatcanirunai.vercel.app/models/granite-4.0-h-small/)23.5 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 56 | | [sarvam-30b](https://whatcanirunai.vercel.app/models/sarvam-30b/)23.4 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 210 | | [EXAONE-4.0-32B](https://whatcanirunai.vercel.app/models/exaone-4.0-32b/)23.3 GB at Q4 | Tight | Won’t fit | Won’t fit | 11–16 | | [EXAONE-4.0.1-32B](https://whatcanirunai.vercel.app/models/exaone-4.0.1-32b/)23.3 GB at Q4 | Tight | Won’t fit | Won’t fit | 11–16 | | [EXAONE-3.5-32B-Instruct](https://whatcanirunai.vercel.app/models/exaone-3.5-32b-instruct/)23.3 GB at Q4 | Tight | Won’t fit | Won’t fit | 11–16 | | [EXAONE-Deep-32B](https://whatcanirunai.vercel.app/models/exaone-deep-32b/)23.3 GB at Q4 | Tight | Won’t fit | Won’t fit | 11–16 | | [NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16](https://whatcanirunai.vercel.app/models/nvidia-nemotron-3.5-lightning-30b-a3b-bf16/)23.0 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 168 | | [NVIDIA-Nemotron-3-Nano-30B-A3B-BF16](https://whatcanirunai.vercel.app/models/nvidia-nemotron-3-nano-30b-a3b-bf16/)23.0 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 168 | | [Nemotron-Cascade-2-30B-A3B](https://whatcanirunai.vercel.app/models/nemotron-cascade-2-30b-a3b/)23.0 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 168 | | [Gemma 4 31B](https://whatcanirunai.vercel.app/models/gemma-4-31b-it/)22.8 GB at Q4 | Tight | Won’t fit | Won’t fit | 11–16 | | [gemma-4-31B](https://whatcanirunai.vercel.app/models/gemma-4-31b/)22.8 GB at Q4 | Tight | Won’t fit | Won’t fit | 11–16 | | [GLM-4.7-Flash](https://whatcanirunai.vercel.app/models/glm-4.7-flash/)22.8 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 168 | | [Xing4.0-29B-A4B](https://whatcanirunai.vercel.app/models/xing4.0-29b-a4b/)22.8 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 126 | | [Xing4.0-29B-Intent](https://whatcanirunai.vercel.app/models/xing4.0-29b-intent/)22.8 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 126 | | [Qwen3-VL-30B-A3B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-vl-30b-a3b-instruct/)22.7 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 168 | | [Qwen3-VL-30B-A3B-Thinking](https://whatcanirunai.vercel.app/models/qwen3-vl-30b-a3b-thinking/)22.7 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 168 | | [UI-Venus-1.5-30B-A3B](https://whatcanirunai.vercel.app/models/ui-venus-1.5-30b-a3b/)22.7 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 168 | | [kanana-2-30b-a3b-instruct-2601](https://whatcanirunai.vercel.app/models/kanana-2-30b-a3b-instruct-2601/)22.4 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 168 | | [kanana-2-30b-a3b-instruct](https://whatcanirunai.vercel.app/models/kanana-2-30b-a3b-instruct/)22.4 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 168 | | [kanana-2-30b-a3b-thinking-2601](https://whatcanirunai.vercel.app/models/kanana-2-30b-a3b-thinking-2601/)22.4 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 168 | | [Qwen3-30B-A3B](https://whatcanirunai.vercel.app/models/qwen3-30b-a3b/)22.3 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 168 | | [Qwen3-Coder-30B-A3B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-coder-30b-a3b-instruct/)22.3 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 168 | | [Qwen3-30B-A3B-Instruct-2507](https://whatcanirunai.vercel.app/models/qwen3-30b-a3b-instruct-2507/)22.3 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 168 | | [Qwen3-30B-A3B-Thinking-2507](https://whatcanirunai.vercel.app/models/qwen3-30b-a3b-thinking-2507/)22.3 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 168 | | [Tongyi-DeepResearch-30B-A3B](https://whatcanirunai.vercel.app/models/tongyi-deepresearch-30b-a3b/)22.3 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 168 | | [Rubicon-Preview](https://whatcanirunai.vercel.app/models/rubicon-preview/)22.3 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 168 | | [North-Mini-Code-1.0](https://whatcanirunai.vercel.app/models/north-mini-code-1.0/)22.3 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 168 | | [Hy-Memory-30B-A3B](https://whatcanirunai.vercel.app/models/hy-memory-30b-a3b/)22.0 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 168 | | [Hy-MT2-30B-A3B](https://whatcanirunai.vercel.app/models/hy-mt2-30b-a3b/)22.0 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 168 | | [granite-switch-4.1-30b](https://whatcanirunai.vercel.app/models/granite-switch-4.1-30b/)21.9 GB at Q4 | Tight | Won’t fit | Won’t fit | 12–17 | | [Muse-Glimmer-30B](https://whatcanirunai.vercel.app/models/muse-glimmer-30b/)21.8 GB at Q4 | Tight | Won’t fit | Won’t fit | 12–17 | | [ERNIE-4.5-VL-28B-A3B-Thinking](https://whatcanirunai.vercel.app/models/ernie-4.5-vl-28b-a3b-thinking/)21.7 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 168 | | [ERNIE-4.5-VL-28B-A3B-PT](https://whatcanirunai.vercel.app/models/ernie-4.5-vl-28b-a3b-pt/)21.5 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 168 | | [granite-4.2-30b](https://whatcanirunai.vercel.app/models/granite-4.2-30b/)21.4 GB at Q4 | Fits | Won’t fit | Won’t fit | 12–17 | | [granite-4.1-30b](https://whatcanirunai.vercel.app/models/granite-4.1-30b/)21.1 GB at Q4 | Fits | Won’t fit | Won’t fit | 12–17 | | [Raon-1 mini preview](https://whatcanirunai.vercel.app/models/raon-1-mini-preview/)21.1 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 117 | | [Qwen3.8-27B](https://whatcanirunai.vercel.app/models/qwen3.8-27b/)20.4 GB at Q4 | Fits | Won’t fit | Won’t fit | 13–18 | | [Tess-4.5-27B](https://whatcanirunai.vercel.app/models/tess-4.5-27b/)20.4 GB at Q4 | Fits | Won’t fit | Won’t fit | 13–18 | | [Qwen3.6-27B](https://whatcanirunai.vercel.app/models/qwen3.6-27b/)20.4 GB at Q4 | Fits | Won’t fit | Won’t fit | 13–18 | | [Qwen3.5-27B](https://whatcanirunai.vercel.app/models/qwen3.5-27b/)20.4 GB at Q4 | Fits | Won’t fit | Won’t fit | 13–18 | | [gemma-3-27b-it](https://whatcanirunai.vercel.app/models/gemma-3-27b-it/)20.1 GB at Q4 | Fits | Won’t fit | Won’t fit | 13–18 | | [Arete-27B](https://whatcanirunai.vercel.app/models/arete-27b/)20.1 GB at Q4 | Fits | Won’t fit | Won’t fit | 13–18 | | [gemma-2-27b-it](https://whatcanirunai.vercel.app/models/gemma-2-27b-it/)20.0 GB at Q4 | Fits | Won’t fit | Won’t fit | 13–19 | | [gemma-2-27b](https://whatcanirunai.vercel.app/models/gemma-2-27b/)20.0 GB at Q4 | Fits | Won’t fit | Won’t fit | 13–19 | | [Qwen3.8-27B-Longbook27-v2](https://whatcanirunai.vercel.app/models/qwen3.8-27b-longbook27-v2/)19.9 GB at Q4 | Fits | Won’t fit | Won’t fit | 13–19 | | [medgemma-27b-text-it](https://whatcanirunai.vercel.app/models/medgemma-27b-text-it/)19.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 13–19 | | [Hemmingway-1.5](https://whatcanirunai.vercel.app/models/hemmingway-1.5/)19.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 13–19 | | [Trinity-Mini](https://whatcanirunai.vercel.app/models/trinity-mini/)19.2 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 168 | | [diffusiongemma-26B-A4B-it](https://whatcanirunai.vercel.app/models/diffusiongemma-26b-a4b-it/)19.0 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 126 | | [Gemma 4 26B A4B](https://whatcanirunai.vercel.app/models/gemma-4-26b-a4b-it/)19.0 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 133 | | [gemma-4-26B-A4B](https://whatcanirunai.vercel.app/models/gemma-4-26b-a4b/)19.0 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 126 | | [Voxtral-Small-24B-2507](https://whatcanirunai.vercel.app/models/voxtral-small-24b-2507/)17.9 GB at Q4 | Fits | Won’t fit | Won’t fit | 15–21 | | [Mistral-Small-3.2-24B-Instruct-2506](https://whatcanirunai.vercel.app/models/mistral-small-3.2-24b-instruct-2506/)17.7 GB at Q4 | Fits | Won’t fit | Won’t fit | 15–21 | | [Mistral-Small-3.1-24B-Instruct-2503](https://whatcanirunai.vercel.app/models/mistral-small-3.1-24b-instruct-2503/)17.7 GB at Q4 | Fits | Won’t fit | Won’t fit | 15–21 | | [LFM2.5-24B-A2B](https://whatcanirunai.vercel.app/models/lfm2.5-24b-a2b/)17.7 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 252 | | [LFM2-24B-A2B](https://whatcanirunai.vercel.app/models/lfm2-24b-a2b/)17.6 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 252 | | [Mistral-Small-24B-Instruct-2501](https://whatcanirunai.vercel.app/models/mistral-small-24b-instruct-2501/)17.4 GB at Q4 | Fits | Won’t fit | Won’t fit | 15–21 | | [EuroLLM-22B-Instruct-2512](https://whatcanirunai.vercel.app/models/eurollm-22b-instruct-2512/)16.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 16–22 | | [EuroLLM-22B-2512](https://whatcanirunai.vercel.app/models/eurollm-22b-2512/)16.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 16–22 | | [solar-pro-preview-instruct](https://whatcanirunai.vercel.app/models/solar-pro-preview-instruct/)16.4 GB at Q4 | Fits | Won’t fit | Won’t fit | 16–23 | | [ERNIE-4.5-21B-A3B-PT](https://whatcanirunai.vercel.app/models/ernie-4.5-21b-a3b-pt/)16.3 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 168 | | [ERNIE-4.5-21B-A3B-Thinking](https://whatcanirunai.vercel.app/models/ernie-4.5-21b-a3b-thinking/)16.2 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 168 | | [gpt-oss-20b](https://whatcanirunai.vercel.app/models/gpt-oss-20b/)15.6 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 140 | | [reka-flash-3](https://whatcanirunai.vercel.app/models/reka-flash-3/)15.6 GB at Q4 | Fits | Won’t fit | Won’t fit | 17–24 | | [maple-preview](https://whatcanirunai.vercel.app/models/maple-preview/)15.1 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 504 | | [internlm2\_5-20b-chat](https://whatcanirunai.vercel.app/models/internlm2-5-20b-chat/)14.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 18–25 | | [Groot-19B-A3B-261023](https://whatcanirunai.vercel.app/models/groot-19b-a3b-261023/)14.5 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 168 | | [Ling-Coder-lite](https://whatcanirunai.vercel.app/models/ling-coder-lite/)12.7 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 184 | | [Ring-lite-distill-preview](https://whatcanirunai.vercel.app/models/ring-lite-distill-preview/)12.7 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 184 | | [Ling-lite](https://whatcanirunai.vercel.app/models/ling-lite/)12.7 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 184 | | [Ling-lite-1.5-2507](https://whatcanirunai.vercel.app/models/ling-lite-1.5-2507/)12.7 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 184 | | [Ling-lite-1.5](https://whatcanirunai.vercel.app/models/ling-lite-1.5/)12.7 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 184 | | [Ring-lite](https://whatcanirunai.vercel.app/models/ring-lite/)12.7 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 184 | | [Ring-mini-linear-2.0](https://whatcanirunai.vercel.app/models/ring-mini-linear-2.0/)12.5 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 316 | | [Kimi-VL-A3B-Instruct](https://whatcanirunai.vercel.app/models/kimi-vl-a3b-instruct/)12.4 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 168 | | [Kimi-VL-A3B-Thinking](https://whatcanirunai.vercel.app/models/kimi-vl-a3b-thinking/)12.4 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 168 | | [Kimi-VL-A3B-Thinking-2506](https://whatcanirunai.vercel.app/models/kimi-vl-a3b-thinking-2506/)12.4 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 168 | | [LLaDA2.1-mini](https://whatcanirunai.vercel.app/models/llada2.1-mini/)12.3 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 361 | | [LLaDA2.0-mini](https://whatcanirunai.vercel.app/models/llada2.0-mini/)12.3 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 361 | | [Ling-mini-2.0](https://whatcanirunai.vercel.app/models/ling-mini-2.0/)12.3 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 361 | | [Ring-mini-2.0](https://whatcanirunai.vercel.app/models/ring-mini-2.0/)12.3 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 361 | | [LLaDA2.2-mini](https://whatcanirunai.vercel.app/models/llada2.2-mini/)12.3 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 361 | | [LLaDA2.0-mini-preview](https://whatcanirunai.vercel.app/models/llada2.0-mini-preview/)12.3 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 361 | | [Moonlight-16B-A3B-Instruct](https://whatcanirunai.vercel.app/models/moonlight-16b-a3b-instruct/)12.1 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 168 | | [Moonlight-16B-A3B](https://whatcanirunai.vercel.app/models/moonlight-16b-a3b/)12.1 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 168 | | [Instella-MoE-16B-A3B-Think](https://whatcanirunai.vercel.app/models/instella-moe-16b-a3b-think/)12.1 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 168 | | [DeepSeek-Coder-V2-Lite-Instruct](https://whatcanirunai.vercel.app/models/deepseek-coder-v2-lite-instruct/)12.0 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 210 | | [kanana-1.5-15.7b-a3b-instruct](https://whatcanirunai.vercel.app/models/kanana-1.5-15.7b-a3b-instruct/)11.9 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 168 | | [Phi-4-reasoning-vision-15B](https://whatcanirunai.vercel.app/models/phi-4-reasoning-vision-15b/)11.5 GB at Q4 | Fits | Fits | Won’t fit | 24–33 | | [Apriel-Nemotron-15b-Thinker](https://whatcanirunai.vercel.app/models/apriel-nemotron-15b-thinker/)11.4 GB at Q4 | Fits | Fits | Won’t fit | 24–34 | | [Apriel-1.5-15b-Thinker](https://whatcanirunai.vercel.app/models/apriel-1.5-15b-thinker/)11.4 GB at Q4 | Fits | Fits | Won’t fit | 24–34 | | [Apriel-1.6-15b-Thinker](https://whatcanirunai.vercel.app/models/apriel-1.6-15b-thinker/)11.4 GB at Q4 | Fits | Fits | Won’t fit | 24–34 | | [Carbon-X (DNA)](https://whatcanirunai.vercel.app/models/carbon-x/)11.3 GB at Q4 | Fits | Fits | Won’t fit | 24–34 | | [Qwen2.5-Coder-14B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-coder-14b-instruct/)11.3 GB at Q4 | Fits | Fits | Won’t fit | 24–34 | | [DeepSeek-R1-Distill-Qwen-14B](https://whatcanirunai.vercel.app/models/deepseek-r1-distill-qwen-14b/)11.3 GB at Q4 | Fits | Fits | Won’t fit | 24–34 | | [Qwen2.5-14B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-14b-instruct/)11.3 GB at Q4 | Fits | Fits | Won’t fit | 24–34 | | [Qwen2.5-14B](https://whatcanirunai.vercel.app/models/qwen2.5-14b/)11.3 GB at Q4 | Fits | Fits | Won’t fit | 24–34 | | [Qwen2.5-14B-Instruct-1M](https://whatcanirunai.vercel.app/models/qwen2.5-14b-instruct-1m/)11.3 GB at Q4 | Fits | Fits | Won’t fit | 24–34 | | [Qwen2.5-Coder-14B](https://whatcanirunai.vercel.app/models/qwen2.5-coder-14b/)11.3 GB at Q4 | Fits | Fits | Won’t fit | 24–34 | | [Qwen3-14B](https://whatcanirunai.vercel.app/models/qwen3-14b/)11.3 GB at Q4 | Fits | Fits | Won’t fit | 24–34 | | [JanusCoder-14B](https://whatcanirunai.vercel.app/models/januscoder-14b/)11.3 GB at Q4 | Fits | Fits | Won’t fit | 24–34 | | [HyperCLOVAX-SEED-Think-14B](https://whatcanirunai.vercel.app/models/hyperclovax-seed-think-14b/)11.3 GB at Q4 | Fits | Fits | Won’t fit | 24–34 | | [phi-4](https://whatcanirunai.vercel.app/models/phi-4/)11.2 GB at Q4 | Fits | Fits | Won’t fit | 24–34 | | [Phi-4-reasoning](https://whatcanirunai.vercel.app/models/phi-4-reasoning/)11.2 GB at Q4 | Fits | Fits | Won’t fit | 24–34 | | [Phi-4-reasoning-plus](https://whatcanirunai.vercel.app/models/phi-4-reasoning-plus/)11.2 GB at Q4 | Fits | Fits | Won’t fit | 24–34 | | [OLMo-2-1124-13B-Instruct](https://whatcanirunai.vercel.app/models/olmo-2-1124-13b-instruct/)10.6 GB at Q4 | Fits | Fits | Won’t fit | 26–37 | | [Mistral-Nemo-Instruct-2407](https://whatcanirunai.vercel.app/models/mistral-nemo-instruct-2407/)9.5 GB at Q4 | Fits | Fits | Won’t fit | 29–41 | | [gemma-3-12b-it](https://whatcanirunai.vercel.app/models/gemma-3-12b-it/)9.5 GB at Q4 | Fits | Fits | Won’t fit | 29–41 | | [gemma-3-12b-pt](https://whatcanirunai.vercel.app/models/gemma-3-12b-pt/)9.5 GB at Q4 | Fits | Fits | Won’t fit | 29–41 | | [Mellum2.1-12B-A2.5B-Thinking](https://whatcanirunai.vercel.app/models/mellum2.1-12b-a2.5b-thinking/)9.5 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 202 | | [Mellum2-12B-A2.5B-Thinking](https://whatcanirunai.vercel.app/models/mellum2-12b-a2.5b-thinking/)9.5 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 202 | | [Mellum2-12B-A2.5B-Instruct](https://whatcanirunai.vercel.app/models/mellum2-12b-a2.5b-instruct/)9.5 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 202 | | [Mellum2-12B-A2.5B-Thinking-SFT](https://whatcanirunai.vercel.app/models/mellum2-12b-a2.5b-thinking-sft/)9.5 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 202 | | [Mellum2.1-12B-A2.5B-Thinking-MTP](https://whatcanirunai.vercel.app/models/mellum2.1-12b-a2.5b-thinking-mtp/)9.5 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 202 | | [Gemma 4 12B](https://whatcanirunai.vercel.app/models/gemma-4-12b-it/)9.3 GB at Q4 | Fits | Fits | Won’t fit | 30–42 | | [HyperCLOVAX-SEED-Omni-8B](https://whatcanirunai.vercel.app/models/hyperclovax-seed-omni-8b/)8.5 GB at Q4 | Fits | Fits | Won’t fit | 33–47 | | [Llama-3.2-11B-Vision-Instruct](https://whatcanirunai.vercel.app/models/llama-3.2-11b-vision-instruct/)8.4 GB at Q4 | Fits | Fits | Won’t fit | 33–47 | | [Llama-3.2-11B-Vision](https://whatcanirunai.vercel.app/models/llama-3.2-11b-vision/)8.4 GB at Q4 | Fits | Fits | Won’t fit | 33–47 | | [Falcon3-10B-Instruct](https://whatcanirunai.vercel.app/models/falcon3-10b-instruct/)8.2 GB at Q4 | Fits | Fits | Won’t fit | 35–49 | | [GLM-4.1V-9B-Thinking](https://whatcanirunai.vercel.app/models/glm-4.1v-9b-thinking/)8.2 GB at Q4 | Fits | Fits | Won’t fit | 35–49 | | [GLM-4.6V-Flash](https://whatcanirunai.vercel.app/models/glm-4.6v-flash/)8.2 GB at Q4 | Fits | Fits | Won’t fit | 35–49 | | [GLM-4.1V-9B-Base](https://whatcanirunai.vercel.app/models/glm-4.1v-9b-base/)8.2 GB at Q4 | Fits | Fits | Won’t fit | 35–49 | | [Glyph](https://whatcanirunai.vercel.app/models/glyph/)8.2 GB at Q4 | Fits | Fits | Won’t fit | 35–49 | | [INTELLECT-1-Instruct](https://whatcanirunai.vercel.app/models/intellect-1-instruct/)8.1 GB at Q4 | Fits | Fits | Won’t fit | 35–49 | | [INTELLECT-1](https://whatcanirunai.vercel.app/models/intellect-1/)8.1 GB at Q4 | Fits | Fits | Won’t fit | 35–49 | | [ZAYA1-VL-8B](https://whatcanirunai.vercel.app/models/zaya1-vl-8b/)7.8 GB at Q4 | Fits | Fits | Tight | 37–52 | | [SenseNova-Loop-9B-Preview](https://whatcanirunai.vercel.app/models/sensenova-loop-9b-preview/)7.7 GB at Q4 | Fits | Fits | Tight | 37–52 | | [Ornith-1.5-9B](https://whatcanirunai.vercel.app/models/ornith-1.5-9b/)7.7 GB at Q4 | Fits | Fits | Tight | 37–52 | | [Qwen3.5-9B](https://whatcanirunai.vercel.app/models/qwen3.5-9b/)7.7 GB at Q4 | Fits | Fits | Tight | 37–52 | | [MiniCPM-SALA](https://whatcanirunai.vercel.app/models/minicpm-sala/)7.6 GB at Q4 | Fits | Fits | Tight | 38–53 | | [NorthCUA-Nano](https://whatcanirunai.vercel.app/models/northcua-nano/)7.6 GB at Q4 | Fits | Fits | Tight | 38–54 | | [GLM-4-9B-0414](https://whatcanirunai.vercel.app/models/glm-4-9b-0414/)7.6 GB at Q4 | Fits | Fits | Tight | 38–54 | | [GLM-Z1-9B-0414](https://whatcanirunai.vercel.app/models/glm-z1-9b-0414/)7.6 GB at Q4 | Fits | Fits | Tight | 38–54 | | [codegeex4-all-9b](https://whatcanirunai.vercel.app/models/codegeex4-all-9b/)7.6 GB at Q4 | Fits | Fits | Tight | 38–54 | | [glm-4-9b-chat-hf](https://whatcanirunai.vercel.app/models/glm-4-9b-chat-hf/)7.6 GB at Q4 | Fits | Fits | Tight | 38–54 | | [moondream3-preview](https://whatcanirunai.vercel.app/models/moondream3-preview/)7.5 GB at Q4 | Fits | Fits | Tight | 38–54 | | [gemma-2-9b-it](https://whatcanirunai.vercel.app/models/gemma-2-9b-it/)7.4 GB at Q4 | Fits | Fits | Tight | 39–55 | | [gemma-2-9b](https://whatcanirunai.vercel.app/models/gemma-2-9b/)7.4 GB at Q4 | Fits | Fits | Tight | 39–55 | | [Gemma-SEA-LION-v3-9B-IT](https://whatcanirunai.vercel.app/models/gemma-sea-lion-v3-9b-it/)7.4 GB at Q4 | Fits | Fits | Tight | 39–55 | | [EuroLLM-9B-Instruct-2512](https://whatcanirunai.vercel.app/models/eurollm-9b-instruct-2512/)7.4 GB at Q4 | Fits | Fits | Tight | 39–55 | | [NVIDIA-Nemotron-Nano-9B-v2](https://whatcanirunai.vercel.app/models/nvidia-nemotron-nano-9b-v2/)7.2 GB at Q4 | Fits | Fits | Fits | 40–57 | | [ZAYA1-base](https://whatcanirunai.vercel.app/models/zaya1-base/)7.2 GB at Q4 | Fits | Fits | Fits | 40–57 | | [Yi-Coder-9B-Chat](https://whatcanirunai.vercel.app/models/yi-coder-9b-chat/)7.2 GB at Q4 | Fits | Fits | Fits | 40–57 | | [Yi-Coder-9B](https://whatcanirunai.vercel.app/models/yi-coder-9b/)7.2 GB at Q4 | Fits | Fits | Fits | 40–57 | | [internlm3-8b-instruct](https://whatcanirunai.vercel.app/models/internlm3-8b-instruct/)7.1 GB at Q4 | Fits | Fits | Fits | 40–57 | | [granite-4.1-8b](https://whatcanirunai.vercel.app/models/granite-4.1-8b/)7.1 GB at Q4 | Fits | Fits | Fits | 41–57 | | [granite-4.2-8b](https://whatcanirunai.vercel.app/models/granite-4.2-8b/)7.1 GB at Q4 | Fits | Fits | Fits | 41–57 | | [granite-switch-4.1-8b](https://whatcanirunai.vercel.app/models/granite-switch-4.1-8b/)7.1 GB at Q4 | Fits | Fits | Fits | 41–58 | | [Qwen3-VL-8B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-vl-8b-instruct/)7.1 GB at Q4 | Fits | Fits | Fits | 41–58 | | [Qwen3-VL-8B-Thinking](https://whatcanirunai.vercel.app/models/qwen3-vl-8b-thinking/)7.1 GB at Q4 | Fits | Fits | Fits | 41–58 | | [UI-Venus-1.5-8B](https://whatcanirunai.vercel.app/models/ui-venus-1.5-8b/)7.1 GB at Q4 | Fits | Fits | Fits | 41–58 | | [Llama-3.1-Nemotron-Nano-VL-8B-V1](https://whatcanirunai.vercel.app/models/llama-3.1-nemotron-nano-vl-8b-v1/)7.1 GB at Q4 | Fits | Fits | Fits | 41–58 | | [MiniCPM-V-4\_5](https://whatcanirunai.vercel.app/models/minicpm-v-4-5/)7.1 GB at Q4 | Fits | Fits | Fits | 41–58 | | [aya-vision-8b](https://whatcanirunai.vercel.app/models/aya-vision-8b/)7.0 GB at Q4 | Fits | Fits | Fits | 41–58 | | [Intern-S1-mini](https://whatcanirunai.vercel.app/models/intern-s1-mini/)7.0 GB at Q4 | Fits | Fits | Fits | 42–59 | | [Nemotron-Labs-Diffusion-8B-Base](https://whatcanirunai.vercel.app/models/nemotron-labs-diffusion-8b-base/)6.9 GB at Q4 | Fits | Fits | Fits | 42–59 | | [LFM2.5-8B-A1B](https://whatcanirunai.vercel.app/models/lfm2.5-8b-a1b/)6.9 GB at Q4 · MoE | Fits | Fits | Fits | up to 505 | | [Mistral-NeMo-Minitron-8B-Base](https://whatcanirunai.vercel.app/models/mistral-nemo-minitron-8b-base/)6.9 GB at Q4 | Fits | Fits | Fits | 42–60 | | [LFM2-8B-A1B](https://whatcanirunai.vercel.app/models/lfm2-8b-a1b/)6.8 GB at Q4 · MoE | Fits | Fits | Fits | up to 505 | | [rnj-1-instruct](https://whatcanirunai.vercel.app/models/rnj-1-instruct/)6.8 GB at Q4 | Fits | Fits | Fits | 43–61 | | [MiMo-VL-7B-RL-2508](https://whatcanirunai.vercel.app/models/mimo-vl-7b-rl-2508/)6.8 GB at Q4 | Fits | Fits | Fits | 43–61 | | [MiMo-VL-7B-RL](https://whatcanirunai.vercel.app/models/mimo-vl-7b-rl/)6.8 GB at Q4 | Fits | Fits | Fits | 43–61 | | [MiMo-Embodied-7B](https://whatcanirunai.vercel.app/models/mimo-embodied-7b/)6.8 GB at Q4 | Fits | Fits | Fits | 43–61 | | [MiMo-VL-7B-SFT](https://whatcanirunai.vercel.app/models/mimo-vl-7b-sft/)6.8 GB at Q4 | Fits | Fits | Fits | 43–61 | | [Qwen2.5-VL-7B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-vl-7b-instruct/)6.8 GB at Q4 | Fits | Fits | Fits | 43–61 | | [UI-TARS-1.5-7B](https://whatcanirunai.vercel.app/models/ui-tars-1.5-7b/)6.8 GB at Q4 | Fits | Fits | Fits | 43–61 | | [Fara-7B](https://whatcanirunai.vercel.app/models/fara-7b/)6.8 GB at Q4 | Fits | Fits | Fits | 43–61 | | [UI-Venus-Ground-7B](https://whatcanirunai.vercel.app/models/ui-venus-ground-7b/)6.8 GB at Q4 | Fits | Fits | Fits | 43–61 | | [Qwen2-VL-7B-Instruct](https://whatcanirunai.vercel.app/models/qwen2-vl-7b-instruct/)6.8 GB at Q4 | Fits | Fits | Fits | 43–61 | | [UI-TARS-7B-DPO](https://whatcanirunai.vercel.app/models/ui-tars-7b-dpo/)6.8 GB at Q4 | Fits | Fits | Fits | 43–61 | | [UI-TARS-7B-SFT](https://whatcanirunai.vercel.app/models/ui-tars-7b-sft/)6.8 GB at Q4 | Fits | Fits | Fits | 43–61 | | [Seed-Coder-8B-Instruct](https://whatcanirunai.vercel.app/models/seed-coder-8b-instruct/)6.8 GB at Q4 | Fits | Fits | Fits | 43–61 | | [Seed-Coder-8B-Reasoning](https://whatcanirunai.vercel.app/models/seed-coder-8b-reasoning/)6.8 GB at Q4 | Fits | Fits | Fits | 43–61 | | [Stable-DiffCoder-8B-Instruct](https://whatcanirunai.vercel.app/models/stable-diffcoder-8b-instruct/)6.8 GB at Q4 | Fits | Fits | Fits | 43–61 | | [Qwen3-8B](https://whatcanirunai.vercel.app/models/qwen3-8b/)6.7 GB at Q4 | Fits | Fits | Fits | 43–62 | | [DeepSeek-R1-0528-Qwen3-8B](https://whatcanirunai.vercel.app/models/deepseek-r1-0528-qwen3-8b/)6.7 GB at Q4 | Fits | Fits | Fits | 43–62 | | [Qwen3-8B-Base](https://whatcanirunai.vercel.app/models/qwen3-8b-base/)6.7 GB at Q4 | Fits | Fits | Fits | 43–62 | | [WeDLM-8B-Instruct](https://whatcanirunai.vercel.app/models/wedlm-8b-instruct/)6.7 GB at Q4 | Fits | Fits | Fits | 43–62 | | [PaCoRe-8B](https://whatcanirunai.vercel.app/models/pacore-8b/)6.7 GB at Q4 | Fits | Fits | Fits | 43–62 | | [MiniCPM4-8B](https://whatcanirunai.vercel.app/models/minicpm4-8b/)6.7 GB at Q4 | Fits | Fits | Fits | 44–62 | | [MiniCPM4.1-8B](https://whatcanirunai.vercel.app/models/minicpm4.1-8b/)6.7 GB at Q4 | Fits | Fits | Fits | 44–62 | | [AgentCPM-Report](https://whatcanirunai.vercel.app/models/agentcpm-report/)6.7 GB at Q4 | Fits | Fits | Fits | 44–62 | | [MiniCPM4-MCP](https://whatcanirunai.vercel.app/models/minicpm4-mcp/)6.7 GB at Q4 | Fits | Fits | Fits | 44–62 | | [granite-3.3-8b-instruct](https://whatcanirunai.vercel.app/models/granite-3.3-8b-instruct/)6.7 GB at Q4 | Fits | Fits | Fits | 44–62 | | [granite-3.1-8b-instruct](https://whatcanirunai.vercel.app/models/granite-3.1-8b-instruct/)6.7 GB at Q4 | Fits | Fits | Fits | 44–62 | | [granite-3.2-8b-instruct](https://whatcanirunai.vercel.app/models/granite-3.2-8b-instruct/)6.7 GB at Q4 | Fits | Fits | Fits | 44–62 | | [granite-3.0-8b-instruct](https://whatcanirunai.vercel.app/models/granite-3.0-8b-instruct/)6.7 GB at Q4 | Fits | Fits | Fits | 44–62 | | [Apertus-8B-Instruct-2509](https://whatcanirunai.vercel.app/models/apertus-8b-instruct-2509/)6.6 GB at Q4 | Fits | Fits | Fits | 44–63 | | [Apertus-8B-2509](https://whatcanirunai.vercel.app/models/apertus-8b-2509/)6.6 GB at Q4 | Fits | Fits | Fits | 44–63 | | [Llama-3.1-Tulu-3-8B](https://whatcanirunai.vercel.app/models/llama-3.1-tulu-3-8b/)6.6 GB at Q4 | Fits | Fits | Fits | 44–63 | | [Llama-3.1-Tulu-3-8B-DPO](https://whatcanirunai.vercel.app/models/llama-3.1-tulu-3-8b-dpo/)6.6 GB at Q4 | Fits | Fits | Fits | 44–63 | | [Llama-3.1-Tulu-3.1-8B](https://whatcanirunai.vercel.app/models/llama-3.1-tulu-3.1-8b/)6.6 GB at Q4 | Fits | Fits | Fits | 44–63 | | [kanana-1.5-8b-instruct-2505](https://whatcanirunai.vercel.app/models/kanana-1.5-8b-instruct-2505/)6.6 GB at Q4 | Fits | Fits | Fits | 44–63 | | [Llama-3.1-8B-Instruct](https://whatcanirunai.vercel.app/models/llama-3.1-8b-instruct/)6.6 GB at Q4 | Fits | Fits | Fits | 44–63 | | [Llama-3.1-8B](https://whatcanirunai.vercel.app/models/llama-3.1-8b/)6.6 GB at Q4 | Fits | Fits | Fits | 44–63 | | [DeepSeek-R1-Distill-Llama-8B](https://whatcanirunai.vercel.app/models/deepseek-r1-distill-llama-8b/)6.6 GB at Q4 | Fits | Fits | Fits | 44–63 | | [Meta-Llama-3.1-8B-Instruct](https://whatcanirunai.vercel.app/models/meta-llama-3.1-8b-instruct/)6.6 GB at Q4 | Fits | Fits | Fits | 44–63 | | [L3-8B-Stheno-v3.2](https://whatcanirunai.vercel.app/models/l3-8b-stheno-v3.2/)6.6 GB at Q4 | Fits | Fits | Fits | 44–63 | | [Llama-3.1-Nemotron-Nano-8B-v1](https://whatcanirunai.vercel.app/models/llama-3.1-nemotron-nano-8b-v1/)6.6 GB at Q4 | Fits | Fits | Fits | 44–63 | | [Meta-Llama-3.1-8B](https://whatcanirunai.vercel.app/models/meta-llama-3.1-8b/)6.6 GB at Q4 | Fits | Fits | Fits | 44–63 | | [LongWriter-llama3.1-8b](https://whatcanirunai.vercel.app/models/longwriter-llama3.1-8b/)6.6 GB at Q4 | Fits | Fits | Fits | 44–63 | | [Hy-MT2-7B](https://whatcanirunai.vercel.app/models/hy-mt2-7b/)6.6 GB at Q4 | Fits | Fits | Fits | 44–63 | | [Nemotron 3.5 Bolt E4B](https://whatcanirunai.vercel.app/models/nemotron-3.5-bolt-e4b/)6.6 GB at Q4 | Fits | Fits | Fits | 45–63 | | [Gemma 4 E4B](https://whatcanirunai.vercel.app/models/gemma-4-e4b-it/)6.6 GB at Q4 | Fits | Fits | Fits | 45–63 | | [Ling-3.0-tiny](https://whatcanirunai.vercel.app/models/ling-3.0-tiny/)6.5 GB at Q4 · MoE | Fits | Fits | Fits | up to 388 | | [MiMo-7B-RL](https://whatcanirunai.vercel.app/models/mimo-7b-rl/)6.5 GB at Q4 | Fits | Fits | Fits | 45–64 | | [MiMo-7B-Base](https://whatcanirunai.vercel.app/models/mimo-7b-base/)6.5 GB at Q4 | Fits | Fits | Fits | 45–64 | | [MiMo-7B-RL-0530](https://whatcanirunai.vercel.app/models/mimo-7b-rl-0530/)6.5 GB at Q4 | Fits | Fits | Fits | 45–64 | | [MiMo-7B-SFT](https://whatcanirunai.vercel.app/models/mimo-7b-sft/)6.5 GB at Q4 | Fits | Fits | Fits | 45–64 | | [EXAONE-3.5-7.8B-Instruct](https://whatcanirunai.vercel.app/models/exaone-3.5-7.8b-instruct/)6.5 GB at Q4 | Fits | Fits | Fits | 46–65 | | [EXAONE-Deep-7.8B](https://whatcanirunai.vercel.app/models/exaone-deep-7.8b/)6.5 GB at Q4 | Fits | Fits | Fits | 46–65 | | [salamandra-7b-instruct](https://whatcanirunai.vercel.app/models/salamandra-7b-instruct/)6.4 GB at Q4 | Fits | Fits | Fits | 46–65 | | [salamandra-7b](https://whatcanirunai.vercel.app/models/salamandra-7b/)6.4 GB at Q4 | Fits | Fits | Fits | 46–65 | | [salamandra-7b-instruct-2606](https://whatcanirunai.vercel.app/models/salamandra-7b-instruct-2606/)6.4 GB at Q4 | Fits | Fits | Fits | 46–65 | | [FastVLM-7B](https://whatcanirunai.vercel.app/models/fastvlm-7b/)6.4 GB at Q4 | Fits | Fits | Fits | 46–65 | | [Molmo2-O-7B](https://whatcanirunai.vercel.app/models/molmo2-o-7b/)6.4 GB at Q4 | Fits | Fits | Fits | 46–65 | | [internlm2\_5-7b-chat](https://whatcanirunai.vercel.app/models/internlm2-5-7b-chat/)6.4 GB at Q4 | Fits | Fits | Fits | 46–65 | | [internlm2\_5-7b-chat-1m](https://whatcanirunai.vercel.app/models/internlm2-5-7b-chat-1m/)6.4 GB at Q4 | Fits | Fits | Fits | 46–65 | | [Phi-mini-MoE-instruct](https://whatcanirunai.vercel.app/models/phi-mini-moe-instruct/)6.3 GB at Q4 · MoE | Fits | Fits | Fits | up to 210 | | [Qwen2.5-Coder-7B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-coder-7b-instruct/)6.3 GB at Q4 | Fits | Fits | Fits | 47–66 | | [DeepSeek-R1-Distill-Qwen-7B](https://whatcanirunai.vercel.app/models/deepseek-r1-distill-qwen-7b/)6.3 GB at Q4 | Fits | Fits | Fits | 47–66 | | [Qwen2.5-7B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-7b-instruct/)6.3 GB at Q4 | Fits | Fits | Fits | 47–66 | | [Qwen2.5-7B](https://whatcanirunai.vercel.app/models/qwen2.5-7b/)6.3 GB at Q4 | Fits | Fits | Fits | 47–66 | | [Qwen2-7B-Instruct](https://whatcanirunai.vercel.app/models/qwen2-7b-instruct/)6.3 GB at Q4 | Fits | Fits | Fits | 47–66 | | [Qwen2.5-Coder-7B](https://whatcanirunai.vercel.app/models/qwen2.5-coder-7b/)6.3 GB at Q4 | Fits | Fits | Fits | 47–66 | | [Qwen2-7B](https://whatcanirunai.vercel.app/models/qwen2-7b/)6.3 GB at Q4 | Fits | Fits | Fits | 47–66 | | [Qwen2.5-7B-Instruct-1M](https://whatcanirunai.vercel.app/models/qwen2.5-7b-instruct-1m/)6.3 GB at Q4 | Fits | Fits | Fits | 47–66 | | [Qwen2.5-Math-7B](https://whatcanirunai.vercel.app/models/qwen2.5-math-7b/)6.3 GB at Q4 | Fits | Fits | Fits | 47–66 | | [Qwen2.5-Math-7B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-math-7b-instruct/)6.3 GB at Q4 | Fits | Fits | Fits | 47–66 | | [Marco-o1](https://whatcanirunai.vercel.app/models/marco-o1/)6.3 GB at Q4 | Fits | Fits | Fits | 47–66 | | [SeaLLMs-v3-7B-Chat](https://whatcanirunai.vercel.app/models/seallms-v3-7b-chat/)6.3 GB at Q4 | Fits | Fits | Fits | 47–66 | | [Arcee-Spark](https://whatcanirunai.vercel.app/models/arcee-spark/)6.3 GB at Q4 | Fits | Fits | Fits | 47–66 | | [Falcon-H1-7B-Instruct](https://whatcanirunai.vercel.app/models/falcon-h1-7b-instruct/)6.3 GB at Q4 | Fits | Fits | Fits | 47–67 | | [Falcon-H1R-7B](https://whatcanirunai.vercel.app/models/falcon-h1r-7b/)6.3 GB at Q4 | Fits | Fits | Fits | 47–67 | | [starvector-8b-im2svg](https://whatcanirunai.vercel.app/models/starvector-8b-im2svg/)6.2 GB at Q4 | Fits | Fits | Fits | 47–67 | | [Falcon3-7B-Instruct](https://whatcanirunai.vercel.app/models/falcon3-7b-instruct/)6.2 GB at Q4 | Fits | Fits | Fits | 48–68 | | [Olmo-Hybrid-7B](https://whatcanirunai.vercel.app/models/olmo-hybrid-7b/)6.2 GB at Q4 | Fits | Fits | Fits | 48–68 | | [LLaDA-MoE-7B-A1B-Base](https://whatcanirunai.vercel.app/models/llada-moe-7b-a1b-base/)6.1 GB at Q4 · MoE | Fits | Fits | Fits | up to 505 | | [Zamba2-7B-Instruct](https://whatcanirunai.vercel.app/models/zamba2-7b-instruct/)6.1 GB at Q4 | Fits | Fits | Fits | 48–69 | | [OLMo-2-1124-7B-Instruct](https://whatcanirunai.vercel.app/models/olmo-2-1124-7b-instruct/)6.1 GB at Q4 | Fits | Fits | Fits | 49–69 | | [Olmo-3-7B-Think](https://whatcanirunai.vercel.app/models/olmo-3-7b-think/)6.1 GB at Q4 | Fits | Fits | Fits | 49–69 | | [Olmo-3-7B-Instruct](https://whatcanirunai.vercel.app/models/olmo-3-7b-instruct/)6.1 GB at Q4 | Fits | Fits | Fits | 49–69 | | [Olmo-3-1025-7B](https://whatcanirunai.vercel.app/models/olmo-3-1025-7b/)6.1 GB at Q4 | Fits | Fits | Fits | 49–69 | | [Olmo-3-7B-Instruct-SFT](https://whatcanirunai.vercel.app/models/olmo-3-7b-instruct-sft/)6.1 GB at Q4 | Fits | Fits | Fits | 49–69 | | [Olmo-3-7B-Think-SFT](https://whatcanirunai.vercel.app/models/olmo-3-7b-think-sft/)6.1 GB at Q4 | Fits | Fits | Fits | 49–69 | | [Olmo-3-7B-Instruct-DPO](https://whatcanirunai.vercel.app/models/olmo-3-7b-instruct-dpo/)6.1 GB at Q4 | Fits | Fits | Fits | 49–69 | | [Olmo-3-7B-RL-Zero-Math](https://whatcanirunai.vercel.app/models/olmo-3-7b-rl-zero-math/)6.1 GB at Q4 | Fits | Fits | Fits | 49–69 | | [Olmo-3.1-7B-RL-Zero-Math](https://whatcanirunai.vercel.app/models/olmo-3.1-7b-rl-zero-math/)6.1 GB at Q4 | Fits | Fits | Fits | 49–69 | | [Olmo-3-7B-Think-DPO](https://whatcanirunai.vercel.app/models/olmo-3-7b-think-dpo/)6.1 GB at Q4 | Fits | Fits | Fits | 49–69 | | [Mistral-7B-Instruct-v0.3](https://whatcanirunai.vercel.app/models/mistral-7b-instruct-v0.3/)6.1 GB at Q4 | Fits | Fits | Fits | 49–70 | | [granite-4.0-h-tiny](https://whatcanirunai.vercel.app/models/granite-4.0-h-tiny/)5.8 GB at Q4 · MoE | Fits | Fits | Fits | up to 505 | | [OLMoE-1B-7B-0924-Instruct](https://whatcanirunai.vercel.app/models/olmoe-1b-7b-0924-instruct/)5.8 GB at Q4 · MoE | Fits | Fits | Fits | up to 388 | | [OLMoE-1B-7B-0924](https://whatcanirunai.vercel.app/models/olmoe-1b-7b-0924/)5.8 GB at Q4 · MoE | Fits | Fits | Fits | up to 388 | | [OLMoE-1B-7B-0125-Instruct](https://whatcanirunai.vercel.app/models/olmoe-1b-7b-0125-instruct/)5.8 GB at Q4 · MoE | Fits | Fits | Fits | up to 388 | | [OLMoE-1B-7B-0125](https://whatcanirunai.vercel.app/models/olmoe-1b-7b-0125/)5.8 GB at Q4 · MoE | Fits | Fits | Fits | up to 388 | | [OLMo-7B-0724-hf](https://whatcanirunai.vercel.app/models/olmo-7b-0724-hf/)5.8 GB at Q4 | Fits | Fits | Fits | 52–73 | | [granite-4.0-tiny-preview](https://whatcanirunai.vercel.app/models/granite-4.0-tiny-preview/)5.7 GB at Q4 · MoE | Fits | Fits | Fits | up to 505 | | [YuE-s1-7B-anneal-en-cot](https://whatcanirunai.vercel.app/models/yue-s1-7b-anneal-en-cot/)5.3 GB at Q4 | Fits | Fits | Fits | 57–81 | | [Trinity-Nano-Preview](https://whatcanirunai.vercel.app/models/trinity-nano-preview/)5.3 GB at Q4 · MoE | Fits | Fits | Fits | up to 505 | | [Trinity-Nano-Base](https://whatcanirunai.vercel.app/models/trinity-nano-base/)5.3 GB at Q4 · MoE | Fits | Fits | Fits | up to 505 | | [gemma-3n-E2B-it](https://whatcanirunai.vercel.app/models/gemma-3n-e2b-it/)4.8 GB at Q4 | Fits | Fits | Fits | 66–93 | | [Youtu-VL-4B-Instruct](https://whatcanirunai.vercel.app/models/youtu-vl-4b-instruct/)4.7 GB at Q4 | Fits | Fits | Fits | 67–95 | | [Gemma 4 E2B](https://whatcanirunai.vercel.app/models/gemma-4-e2b-it/)4.6 GB at Q4 | Fits | Fits | Fits | 70–99 | | [Molmo2-ER](https://whatcanirunai.vercel.app/models/molmo2-er/)4.4 GB at Q4 | Fits | Fits | Fits | 73–104 | | [Apriel-5B-Instruct](https://whatcanirunai.vercel.app/models/apriel-5b-instruct/)4.4 GB at Q4 | Fits | Fits | Fits | 74–104 | | [WeVisOne-VL-4B](https://whatcanirunai.vercel.app/models/wevisone-vl-4b/)4.4 GB at Q4 | Fits | Fits | Fits | 74–104 | | [Mage-VL](https://whatcanirunai.vercel.app/models/mage-vl/)4.3 GB at Q4 | Fits | Fits | Fits | 75–106 | | [Mage-VL-Cowork](https://whatcanirunai.vercel.app/models/mage-vl-cowork/)4.3 GB at Q4 | Fits | Fits | Fits | 75–106 | | [Qwen3.5-4B](https://whatcanirunai.vercel.app/models/qwen3.5-4b/)4.2 GB at Q4 | Fits | Fits | Fits | 76–108 | | [S5-nano](https://whatcanirunai.vercel.app/models/s5-nano/)4.2 GB at Q4 | Fits | Fits | Fits | 76–108 | | [AFM-4.5B](https://whatcanirunai.vercel.app/models/afm-4.5b/)4.2 GB at Q4 | Fits | Fits | Fits | 77–109 | | [Llama-3.1-Minitron-4B-Width-Base](https://whatcanirunai.vercel.app/models/llama-3.1-minitron-4b-width-base/)4.1 GB at Q4 | Fits | Fits | Fits | 79–112 | | [Qwen3-VL-4B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-vl-4b-instruct/)4.1 GB at Q4 | Fits | Fits | Fits | 80–114 | | [CapRL-Qwen3VL-4B](https://whatcanirunai.vercel.app/models/caprl-qwen3vl-4b/)4.1 GB at Q4 | Fits | Fits | Fits | 80–114 | | [glm-edge-4b-chat](https://whatcanirunai.vercel.app/models/glm-edge-4b-chat/)4.0 GB at Q4 | Fits | Fits | Fits | 82–117 | | [gemma-3-4b-it](https://whatcanirunai.vercel.app/models/gemma-3-4b-it/)4.0 GB at Q4 | Fits | Fits | Fits | 83–117 | | [medgemma-4b-it](https://whatcanirunai.vercel.app/models/medgemma-4b-it/)4.0 GB at Q4 | Fits | Fits | Fits | 83–117 | | [medgemma-1.5-4b-it](https://whatcanirunai.vercel.app/models/medgemma-1.5-4b-it/)4.0 GB at Q4 | Fits | Fits | Fits | 83–117 | | [gemma-3-4b-pt](https://whatcanirunai.vercel.app/models/gemma-3-4b-pt/)4.0 GB at Q4 | Fits | Fits | Fits | 83–117 | | [Nanbeige4.2-3B](https://whatcanirunai.vercel.app/models/nanbeige4.2-3b/)3.9 GB at Q4 | Fits | Fits | Fits | 85–121 | | [Phi-3.5-vision-instruct](https://whatcanirunai.vercel.app/models/phi-3.5-vision-instruct/)3.9 GB at Q4 | Fits | Fits | Fits | 86–122 | | [Spark-X2.6-4B](https://whatcanirunai.vercel.app/models/spark-x2.6-4b/)3.9 GB at Q4 | Fits | Fits | Fits | 87–123 | | [Spark-X2.5-4B](https://whatcanirunai.vercel.app/models/spark-x2.5-4b/)3.9 GB at Q4 | Fits | Fits | Fits | 87–123 | | [POINTS-Reader](https://whatcanirunai.vercel.app/models/points-reader/)3.9 GB at Q4 | Fits | Fits | Fits | 87–123 | | [MiniCPM-V-4](https://whatcanirunai.vercel.app/models/minicpm-v-4/)3.8 GB at Q4 | Fits | Fits | Fits | 88–124 | | [Qwen3-4B](https://whatcanirunai.vercel.app/models/qwen3-4b/)3.8 GB at Q4 | Fits | Fits | Fits | 89–125 | | [Qwen3-4B-Instruct-2507](https://whatcanirunai.vercel.app/models/qwen3-4b-instruct-2507/)3.8 GB at Q4 | Fits | Fits | Fits | 89–125 | | [Qwen3-4B-Thinking-2507](https://whatcanirunai.vercel.app/models/qwen3-4b-thinking-2507/)3.8 GB at Q4 | Fits | Fits | Fits | 89–125 | | [Mellum-4b-base](https://whatcanirunai.vercel.app/models/mellum-4b-base/)3.8 GB at Q4 | Fits | Fits | Fits | 89–126 | | [granite-4.0-3b-vision](https://whatcanirunai.vercel.app/models/granite-4.0-3b-vision/)3.8 GB at Q4 | Fits | Fits | Fits | 89–126 | | [granite-vision-4.1-4b](https://whatcanirunai.vercel.app/models/granite-vision-4.1-4b/)3.8 GB at Q4 | Fits | Fits | Fits | 89–126 | | [Nemotron Labs Dory 1.0 4B](https://whatcanirunai.vercel.app/models/nemotron-labs-dory1.0-4b/)3.8 GB at Q4 | Fits | Fits | Fits | 90–127 | | [NVIDIA-Nemotron-3-Nano-4B-BF16](https://whatcanirunai.vercel.app/models/nvidia-nemotron-3-nano-4b-bf16/)3.8 GB at Q4 | Fits | Fits | Fits | 90–127 | | [Nanbeige4.1-3B](https://whatcanirunai.vercel.app/models/nanbeige4.1-3b/)3.7 GB at Q4 | Fits | Fits | Fits | 91–128 | | [Nanbeige4-3B-Thinking-2511](https://whatcanirunai.vercel.app/models/nanbeige4-3b-thinking-2511/)3.7 GB at Q4 | Fits | Fits | Fits | 91–128 | | [Phi-4-mini-flash-reasoning](https://whatcanirunai.vercel.app/models/phi-4-mini-flash-reasoning/)3.7 GB at Q4 | Fits | Fits | Fits | 92–131 | | [Phi-4-mini-instruct](https://whatcanirunai.vercel.app/models/phi-4-mini-instruct/)3.7 GB at Q4 | Fits | Fits | Fits | 93–132 | | [Phi-4-mini-reasoning](https://whatcanirunai.vercel.app/models/phi-4-mini-reasoning/)3.7 GB at Q4 | Fits | Fits | Fits | 93–132 | | [Nemotron-Labs-Diffusion-3B](https://whatcanirunai.vercel.app/models/nemotron-labs-diffusion-3b/)3.7 GB at Q4 | Fits | Fits | Fits | 93–132 | | [Phi-3.5-mini-instruct](https://whatcanirunai.vercel.app/models/phi-3.5-mini-instruct/)3.7 GB at Q4 | Fits | Fits | Fits | 93–132 | | [MediPhi-Instruct](https://whatcanirunai.vercel.app/models/mediphi-instruct/)3.7 GB at Q4 | Fits | Fits | Fits | 93–132 | | [MediPhi](https://whatcanirunai.vercel.app/models/mediphi/)3.7 GB at Q4 | Fits | Fits | Fits | 93–132 | | [MediPhi-Clinical](https://whatcanirunai.vercel.app/models/mediphi-clinical/)3.7 GB at Q4 | Fits | Fits | Fits | 93–132 | | [MediPhi-PubMed](https://whatcanirunai.vercel.app/models/mediphi-pubmed/)3.7 GB at Q4 | Fits | Fits | Fits | 93–132 | | [HY-Embodied-0.5](https://whatcanirunai.vercel.app/models/hy-embodied-0.5/)3.6 GB at Q4 | Fits | Fits | Fits | 94–133 | | [Phi-tiny-MoE-instruct](https://whatcanirunai.vercel.app/models/phi-tiny-moe-instruct/)3.6 GB at Q4 · MoE | Fits | Fits | Fits | up to 459 | | [CapRL-3B](https://whatcanirunai.vercel.app/models/caprl-3b/)3.6 GB at Q4 | Fits | Fits | Fits | 95–134 | | [HyperCLOVAX-SEED-Vision-Instruct-3B](https://whatcanirunai.vercel.app/models/hyperclovax-seed-vision-instruct-3b/)3.6 GB at Q4 | Fits | Fits | Fits | 96–136 | | [kanana-1.5-v-3b-instruct](https://whatcanirunai.vercel.app/models/kanana-1.5-v-3b-instruct/)3.6 GB at Q4 | Fits | Fits | Fits | 97–138 | | [granite-4.2-3b](https://whatcanirunai.vercel.app/models/granite-4.2-3b/)3.6 GB at Q4 | Fits | Fits | Fits | 97–138 | | [kanana-2-3b-instruct](https://whatcanirunai.vercel.app/models/kanana-2-3b-instruct/)3.4 GB at Q4 | Fits | Fits | Fits | 102–144 | | [granite-4.1-3b](https://whatcanirunai.vercel.app/models/granite-4.1-3b/)3.4 GB at Q4 | Fits | Fits | Fits | 105–148 | | [granite-4.0-micro](https://whatcanirunai.vercel.app/models/granite-4.0-micro/)3.4 GB at Q4 | Fits | Fits | Fits | 105–148 | | [granite-3.1-3b-a800m-instruct](https://whatcanirunai.vercel.app/models/granite-3.1-3b-a800m-instruct/)3.3 GB at Q4 · MoE | Fits | Fits | Fits | up to 631 | | [Falcon3-3B-Instruct](https://whatcanirunai.vercel.app/models/falcon3-3b-instruct/)3.3 GB at Q4 | Fits | Fits | Fits | 110–156 | | [Llama-3.2-3B-Instruct](https://whatcanirunai.vercel.app/models/llama-3.2-3b-instruct/)3.2 GB at Q4 | Fits | Fits | Fits | 111–157 | | [Llama-3.2-3B](https://whatcanirunai.vercel.app/models/llama-3.2-3b/)3.2 GB at Q4 | Fits | Fits | Fits | 111–157 | | [Hermes-3-Llama-3.2-3B](https://whatcanirunai.vercel.app/models/hermes-3-llama-3.2-3b/)3.2 GB at Q4 | Fits | Fits | Fits | 111–157 | | [DeepHermes-3-Llama-3-3B-Preview](https://whatcanirunai.vercel.app/models/deephermes-3-llama-3-3b-preview/)3.2 GB at Q4 | Fits | Fits | Fits | 111–157 | | [AI21-Jamba-Reasoning-3B](https://whatcanirunai.vercel.app/models/ai21-jamba-reasoning-3b/)3.2 GB at Q4 | Fits | Fits | Fits | 111–158 | | [granite-4.0-h-micro](https://whatcanirunai.vercel.app/models/granite-4.0-h-micro/)3.2 GB at Q4 | Fits | Fits | Fits | 112–158 | | [Falcon-H1-3B-Instruct](https://whatcanirunai.vercel.app/models/falcon-h1-3b-instruct/)3.2 GB at Q4 | Fits | Fits | Fits | 113–160 | | [d1-3B](https://whatcanirunai.vercel.app/models/d1-3b/)3.2 GB at Q4 | Fits | Fits | Fits | 114–162 | | [LFM2.5-VL-3B](https://whatcanirunai.vercel.app/models/lfm2.5-vl-3b/)3.2 GB at Q4 | Fits | Fits | Fits | 114–162 | | [Qwen2.5-3B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-3b-instruct/)3.2 GB at Q4 | Fits | Fits | Fits | 115–164 | | [Qwen2.5-Coder-3B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-coder-3b-instruct/)3.2 GB at Q4 | Fits | Fits | Fits | 115–164 | | [Qwen2.5-3B](https://whatcanirunai.vercel.app/models/qwen2.5-3b/)3.2 GB at Q4 | Fits | Fits | Fits | 115–164 | | [Qwen2.5-Coder-3B](https://whatcanirunai.vercel.app/models/qwen2.5-coder-3b/)3.2 GB at Q4 | Fits | Fits | Fits | 115–164 | | [SmolLM3-3B](https://whatcanirunai.vercel.app/models/smollm3-3b/)3.1 GB at Q4 | Fits | Fits | Fits | 116–164 | | [AI21-Jamba2-3B](https://whatcanirunai.vercel.app/models/ai21-jamba2-3b/)3.1 GB at Q4 | Fits | Fits | Fits | 118–167 | | [granite-swash-3b-a600m](https://whatcanirunai.vercel.app/models/granite-swash-3b-a600m/)3.1 GB at Q4 · MoE | Fits | Fits | Fits | up to 844 | | [granite-vision-3.2-2b](https://whatcanirunai.vercel.app/models/granite-vision-3.2-2b/)3.1 GB at Q4 | Fits | Fits | Fits | 120–170 | | [granite-vision-3.1-2b-preview](https://whatcanirunai.vercel.app/models/granite-vision-3.1-2b-preview/)3.1 GB at Q4 | Fits | Fits | Fits | 120–170 | | [granite-vision-3.3-2b-chart2csv-preview](https://whatcanirunai.vercel.app/models/granite-vision-3.3-2b-chart2csv-preview/)3.1 GB at Q4 | Fits | Fits | Fits | 120–170 | | [LFM2.5-2.6B](https://whatcanirunai.vercel.app/models/lfm2.5-2.6b/)2.9 GB at Q4 | Fits | Fits | Fits | 132–187 | | [Zamba2-2.7B](https://whatcanirunai.vercel.app/models/zamba2-2.7b/)2.9 GB at Q4 | Fits | Fits | Fits | 134–190 | | [Zamba2-2.7B-instruct](https://whatcanirunai.vercel.app/models/zamba2-2.7b-instruct/)2.9 GB at Q4 | Fits | Fits | Fits | 134–190 | | [granite-3.0-2b-instruct](https://whatcanirunai.vercel.app/models/granite-3.0-2b-instruct/)2.8 GB at Q4 | Fits | Fits | Fits | 135–192 | | [gemma-2-2b-it](https://whatcanirunai.vercel.app/models/gemma-2-2b-it/)2.8 GB at Q4 | Fits | Fits | Fits | 136–193 | | [gemma-2-2b](https://whatcanirunai.vercel.app/models/gemma-2-2b/)2.8 GB at Q4 | Fits | Fits | Fits | 136–193 | | [EuroMoE-2.6B-A0.6B-Instruct-Preview](https://whatcanirunai.vercel.app/models/euromoe-2.6b-a0.6b-instruct-preview/)2.8 GB at Q4 · MoE | Fits | Fits | Fits | up to 841 | | [Motif-2.6B](https://whatcanirunai.vercel.app/models/motif-2.6b/)2.8 GB at Q4 | Fits | Fits | Fits | 137–194 | | [LFM2-2.6B](https://whatcanirunai.vercel.app/models/lfm2-2.6b/)2.8 GB at Q4 | Fits | Fits | Fits | 139–196 | | [LFM2-2.6B-Exp](https://whatcanirunai.vercel.app/models/lfm2-2.6b-exp/)2.8 GB at Q4 | Fits | Fits | Fits | 139–196 | | [LFM2-2.6B-Transcript](https://whatcanirunai.vercel.app/models/lfm2-2.6b-transcript/)2.8 GB at Q4 | Fits | Fits | Fits | 139–196 | | [granite-3.3-2b-instruct](https://whatcanirunai.vercel.app/models/granite-3.3-2b-instruct/)2.8 GB at Q4 | Fits | Fits | Fits | 141–199 | | [granite-3.1-2b-instruct](https://whatcanirunai.vercel.app/models/granite-3.1-2b-instruct/)2.8 GB at Q4 | Fits | Fits | Fits | 141–199 | | [granite-3.2-2b-instruct](https://whatcanirunai.vercel.app/models/granite-3.2-2b-instruct/)2.8 GB at Q4 | Fits | Fits | Fits | 141–199 | | [MiniCPM5-2B](https://whatcanirunai.vercel.app/models/minicpm5-2b/)2.8 GB at Q4 | Fits | Fits | Fits | 142–201 | | [MiniCPM5-2B-SFT](https://whatcanirunai.vercel.app/models/minicpm5-2b-sft/)2.8 GB at Q4 | Fits | Fits | Fits | 142–201 | | [MiniCPM5-2B-Midtrain](https://whatcanirunai.vercel.app/models/minicpm5-2b-midtrain/)2.8 GB at Q4 | Fits | Fits | Fits | 142–201 | | [sarvam-1-v0.5](https://whatcanirunai.vercel.app/models/sarvam-1-v0.5/)2.7 GB at Q4 | Fits | Fits | Fits | 142–201 | | [North-Micro-Vision-Instruct](https://whatcanirunai.vercel.app/models/north-micro-vision-instruct/)2.7 GB at Q4 | Fits | Fits | Fits | 143–203 | | [UI-TARS-2B-SFT](https://whatcanirunai.vercel.app/models/ui-tars-2b-sft/)2.7 GB at Q4 | Fits | Fits | Fits | 146–207 | | [WeVisOne-VL-2B](https://whatcanirunai.vercel.app/models/wevisone-vl-2b/)2.7 GB at Q4 | Fits | Fits | Fits | 146–207 | | [UI-Venus-1.5-2B](https://whatcanirunai.vercel.app/models/ui-venus-1.5-2b/)2.7 GB at Q4 | Fits | Fits | Fits | 146–207 | | [bitnet-b1.58-2B-4T-bf16](https://whatcanirunai.vercel.app/models/bitnet-b1.58-2b-4t-bf16/)2.7 GB at Q4 | Fits | Fits | Fits | 148–209 | | [EXAONE-3.5-2.4B-Instruct](https://whatcanirunai.vercel.app/models/exaone-3.5-2.4b-instruct/)2.7 GB at Q4 | Fits | Fits | Fits | 148–210 | | [EXAONE-Deep-2.4B](https://whatcanirunai.vercel.app/models/exaone-deep-2.4b/)2.7 GB at Q4 | Fits | Fits | Fits | 148–210 | | [kanana-1.5-2.1b-instruct-2505](https://whatcanirunai.vercel.app/models/kanana-1.5-2.1b-instruct-2505/)2.6 GB at Q4 | Fits | Fits | Fits | 154–218 | | [Qwen3.5-2B](https://whatcanirunai.vercel.app/models/qwen3.5-2b/)2.6 GB at Q4 | Fits | Fits | Fits | 157–222 | | [salamandra-2b](https://whatcanirunai.vercel.app/models/salamandra-2b/)2.6 GB at Q4 | Fits | Fits | Fits | 158–224 | | [salamandra-2b-instruct](https://whatcanirunai.vercel.app/models/salamandra-2b-instruct/)2.6 GB at Q4 | Fits | Fits | Fits | 158–224 | | [SmolVLM2-2.2B-Instruct](https://whatcanirunai.vercel.app/models/smolvlm2-2.2b-instruct/)2.6 GB at Q4 | Fits | Fits | Fits | 159–225 | | [SmolVLM-Base](https://whatcanirunai.vercel.app/models/smolvlm-base/)2.6 GB at Q4 | Fits | Fits | Fits | 159–225 | | [Qwen2-VL-2B-Instruct](https://whatcanirunai.vercel.app/models/qwen2-vl-2b-instruct/)2.5 GB at Q4 | Fits | Fits | Fits | 161–228 | | [LFM3-Omni-2B](https://whatcanirunai.vercel.app/models/lfm3-omni-2b/)2.5 GB at Q4 | Fits | Fits | Fits | 164–233 | | [granite-swash-2b](https://whatcanirunai.vercel.app/models/granite-swash-2b/)2.5 GB at Q4 | Fits | Fits | Fits | 166–235 | | [Qwen3-VL-2B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-vl-2b-instruct/)2.5 GB at Q4 | Fits | Fits | Fits | 167–237 | | [kanana-nano-2.1b-instruct](https://whatcanirunai.vercel.app/models/kanana-nano-2.1b-instruct/)2.5 GB at Q4 | Fits | Fits | Fits | 171–242 | | [Hy-MT2-1.8B](https://whatcanirunai.vercel.app/models/hy-mt2-1.8b/)2.4 GB at Q4 | Fits | Fits | Fits | 175–248 | | [Qwen3-1.7B](https://whatcanirunai.vercel.app/models/qwen3-1.7b/)2.4 GB at Q4 | Fits | Fits | Fits | 175–248 | | [Youtu-LLM-2B](https://whatcanirunai.vercel.app/models/youtu-llm-2b/)2.4 GB at Q4 | Fits | Fits | Fits | 182–257 | | [LFM3-VL-2B](https://whatcanirunai.vercel.app/models/lfm3-vl-2b/)2.3 GB at Q4 | Fits | Fits | Fits | 186–263 | | [d1-2B](https://whatcanirunai.vercel.app/models/d1-2b/)2.3 GB at Q4 | Fits | Fits | Fits | 186–263 | | [FastVLM-1.5B](https://whatcanirunai.vercel.app/models/fastvlm-1.5b/)2.3 GB at Q4 | Fits | Fits | Fits | 187–264 | | [internlm2\_5-1\_8b-chat](https://whatcanirunai.vercel.app/models/internlm2-5-1-8b-chat/)2.3 GB at Q4 | Fits | Fits | Fits | 189–267 | | [DeepSeek-R1-Distill-Qwen-1.5B](https://whatcanirunai.vercel.app/models/deepseek-r1-distill-qwen-1.5b/)2.2 GB at Q4 | Fits | Fits | Fits | 200–284 | | [LFM3-1.7B](https://whatcanirunai.vercel.app/models/lfm3-1.7b/)2.2 GB at Q4 | Fits | Fits | Fits | 206–292 | | [Qwen3-1.7B-Base](https://whatcanirunai.vercel.app/models/qwen3-1.7b-base/)2.2 GB at Q4 | Fits | Fits | Fits | 207–293 | | [SmolLM2-1.7B](https://whatcanirunai.vercel.app/models/smollm2-1.7b/)2.2 GB at Q4 | Fits | Fits | Fits | 208–295 | | [SmolLM-1.7B](https://whatcanirunai.vercel.app/models/smollm-1.7b/)2.2 GB at Q4 | Fits | Fits | Fits | 208–295 | | [Spark-X2.6-1.7B](https://whatcanirunai.vercel.app/models/spark-x2.6-1.7b/)2.2 GB at Q4 | Fits | Fits | Fits | 209–296 | | [Falcon3-1B-Instruct](https://whatcanirunai.vercel.app/models/falcon3-1b-instruct/)2.2 GB at Q4 | Fits | Fits | Fits | 213–302 | | [EuroLLM-1.7B-Instruct](https://whatcanirunai.vercel.app/models/eurollm-1.7b-instruct/)2.2 GB at Q4 | Fits | Fits | Fits | 215–305 | | [granite-4.0-1b](https://whatcanirunai.vercel.app/models/granite-4.0-1b/)2.1 GB at Q4 | Fits | Fits | Fits | 218–309 | | [LFM2.5-VL-1.6B](https://whatcanirunai.vercel.app/models/lfm2.5-vl-1.6b/)2.1 GB at Q4 | Fits | Fits | Fits | 223–316 | | [glm-edge-1.5b-chat](https://whatcanirunai.vercel.app/models/glm-edge-1.5b-chat/)2.1 GB at Q4 | Fits | Fits | Fits | 224–317 | | [LFM2-VL-1.6B](https://whatcanirunai.vercel.app/models/lfm2-vl-1.6b/)2.1 GB at Q4 | Fits | Fits | Fits | 225–318 | | [Falcon-H1-1.5B-Deep-Instruct](https://whatcanirunai.vercel.app/models/falcon-h1-1.5b-deep-instruct/)2.1 GB at Q4 | Fits | Fits | Fits | 229–325 | | [Falcon-H1-1.5B-Instruct](https://whatcanirunai.vercel.app/models/falcon-h1-1.5b-instruct/)2.1 GB at Q4 | Fits | Fits | Fits | 229–325 | | [MiniCPM-V-4.7-1B](https://whatcanirunai.vercel.app/models/minicpm-v-4.7-1b/)2.1 GB at Q4 | Fits | Fits | Fits | 229–325 | | [Qwen2.5-1.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-1.5b-instruct/)2.1 GB at Q4 | Fits | Fits | Fits | 231–327 | | [Qwen2.5-1.5B](https://whatcanirunai.vercel.app/models/qwen2.5-1.5b/)2.1 GB at Q4 | Fits | Fits | Fits | 231–327 | | [Qwen2.5-Coder-1.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-coder-1.5b-instruct/)2.1 GB at Q4 | Fits | Fits | Fits | 231–327 | | [Qwen2.5-Coder-1.5B](https://whatcanirunai.vercel.app/models/qwen2.5-coder-1.5b/)2.1 GB at Q4 | Fits | Fits | Fits | 231–327 | | [Qwen2.5-Math-1.5B](https://whatcanirunai.vercel.app/models/qwen2.5-math-1.5b/)2.1 GB at Q4 | Fits | Fits | Fits | 231–327 | | [Qwen2-1.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2-1.5b-instruct/)2.1 GB at Q4 | Fits | Fits | Fits | 231–327 | | [Qwen2.5-Math-1.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-math-1.5b-instruct/)2.1 GB at Q4 | Fits | Fits | Fits | 231–327 | | [ReaderLM-v2](https://whatcanirunai.vercel.app/models/readerlm-v2/)2.1 GB at Q4 | Fits | Fits | Fits | 231–327 | | [reader-lm-1.5b](https://whatcanirunai.vercel.app/models/reader-lm-1.5b/)2.1 GB at Q4 | Fits | Fits | Fits | 231–327 | | [Hymba-1.5B-Instruct](https://whatcanirunai.vercel.app/models/hymba-1.5b-instruct/)2.1 GB at Q4 | Fits | Fits | Fits | 234–331 | | [OLMo-2-0425-1B](https://whatcanirunai.vercel.app/models/olmo-2-0425-1b/)2.0 GB at Q4 | Fits | Fits | Fits | 240–340 | | [OLMo-2-0425-1B-Instruct](https://whatcanirunai.vercel.app/models/olmo-2-0425-1b-instruct/)2.0 GB at Q4 | Fits | Fits | Fits | 240–340 | | [Yi-Coder-1.5B-Chat](https://whatcanirunai.vercel.app/models/yi-coder-1.5b-chat/)2.0 GB at Q4 | Fits | Fits | Fits | 241–342 | | [Bolmo-1B](https://whatcanirunai.vercel.app/models/bolmo-1b/)2.0 GB at Q4 | Fits | Fits | Fits | 243–344 | | [granite-4.0-h-1b](https://whatcanirunai.vercel.app/models/granite-4.0-h-1b/)2.0 GB at Q4 | Fits | Fits | Fits | 244–345 | | [granite-3.1-1b-a400m-instruct](https://whatcanirunai.vercel.app/models/granite-3.1-1b-a400m-instruct/)1.9 GB at Q4 · MoE | Fits | Fits | Fits | up to 1262 | | [granite-3.0-1b-a400m-instruct](https://whatcanirunai.vercel.app/models/granite-3.0-1b-a400m-instruct/)1.9 GB at Q4 · MoE | Fits | Fits | Fits | up to 1262 | | [MiniCPM-V-4.6](https://whatcanirunai.vercel.app/models/minicpm-v-4.6/)1.9 GB at Q4 | Fits | Fits | Fits | 274–388 | | [MiniCPM-V-4.6-Thinking](https://whatcanirunai.vercel.app/models/minicpm-v-4.6-thinking/)1.9 GB at Q4 | Fits | Fits | Fits | 274–388 | | [kanana-2-1.3b-instruct](https://whatcanirunai.vercel.app/models/kanana-2-1.3b-instruct/)1.9 GB at Q4 | Fits | Fits | Fits | 276–391 | | [OLMo-1B-0724-hf](https://whatcanirunai.vercel.app/models/olmo-1b-0724-hf/)1.9 GB at Q4 | Fits | Fits | Fits | 278–394 | | [EXAONE-4.0-1.2B](https://whatcanirunai.vercel.app/models/exaone-4.0-1.2b/)1.9 GB at Q4 | Fits | Fits | Fits | 278–395 | | [Llama-3.2-1B-Instruct](https://whatcanirunai.vercel.app/models/llama-3.2-1b-instruct/)1.9 GB at Q4 | Fits | Fits | Fits | 288–408 | | [Llama-3.2-1B](https://whatcanirunai.vercel.app/models/llama-3.2-1b/)1.9 GB at Q4 | Fits | Fits | Fits | 288–408 | | [Llama-3.2-1B](https://whatcanirunai.vercel.app/models/llama-3.2-1b-nousresearch/)1.9 GB at Q4 | Fits | Fits | Fits | 288–408 | | [Zamba2-1.2B-instruct](https://whatcanirunai.vercel.app/models/zamba2-1.2b-instruct/)1.8 GB at Q4 | Fits | Fits | Fits | 293–415 | | [HRM-Text-1B](https://whatcanirunai.vercel.app/models/hrm-text-1b/)1.8 GB at Q4 | Fits | Fits | Fits | 301–427 | | [AMD-OLMo-1B](https://whatcanirunai.vercel.app/models/amd-olmo-1b/)1.8 GB at Q4 | Fits | Fits | Fits | 303–429 | | [LFM2.5-1.2B-Instruct](https://whatcanirunai.vercel.app/models/lfm2.5-1.2b-instruct/)1.8 GB at Q4 | Fits | Fits | Fits | 304–431 | | [LFM2-1.2B](https://whatcanirunai.vercel.app/models/lfm2-1.2b/)1.8 GB at Q4 | Fits | Fits | Fits | 304–431 | | [LFM2.5-1.2B-Thinking](https://whatcanirunai.vercel.app/models/lfm2.5-1.2b-thinking/)1.8 GB at Q4 | Fits | Fits | Fits | 304–431 | | [LFM2.5-1.2B-JP-202606](https://whatcanirunai.vercel.app/models/lfm2.5-1.2b-jp-202606/)1.8 GB at Q4 | Fits | Fits | Fits | 304–431 | | [MiniCPM5-1B](https://whatcanirunai.vercel.app/models/minicpm5-1b/)1.8 GB at Q4 | Fits | Fits | Fits | 330–467 | | [MiniCPM5-1B-SFT](https://whatcanirunai.vercel.app/models/minicpm5-1b-sft/)1.8 GB at Q4 | Fits | Fits | Fits | 330–467 | | [gemma-3-1b-it](https://whatcanirunai.vercel.app/models/gemma-3-1b-it/)1.7 GB at Q4 | Fits | Fits | Fits | 356–505 | | [gemma-3-1b-pt](https://whatcanirunai.vercel.app/models/gemma-3-1b-pt/)1.7 GB at Q4 | Fits | Fits | Fits | 356–505 | | [Qwen3.5-0.8B](https://whatcanirunai.vercel.app/models/qwen3.5-0.8b/)1.6 GB at Q4 | Fits | Fits | Fits | 408–578 | | [Falcon-E-3B-Instruct](https://whatcanirunai.vercel.app/models/falcon-e-3b-instruct/)1.6 GB at Q4 | Fits | Fits | Fits | 412–584 | | [bitnet-b1.58-2B-4T](https://whatcanirunai.vercel.app/models/bitnet-b1.58-2b-4t/)1.6 GB at Q4 | Fits | Fits | Fits | 419–594 | | [FastVLM-0.5B](https://whatcanirunai.vercel.app/models/fastvlm-0.5b/)1.5 GB at Q4 | Fits | Fits | Fits | 470–665 | | [Qwen3-0.6B](https://whatcanirunai.vercel.app/models/qwen3-0.6b/)1.5 GB at Q4 | Fits | Fits | Fits | 474–672 | | [LFM2-700M](https://whatcanirunai.vercel.app/models/lfm2-700m/)1.5 GB at Q4 | Fits | Fits | Fits | 480–680 | | [Falcon-H1-Tiny-R-0.6B](https://whatcanirunai.vercel.app/models/falcon-h1-tiny-r-0.6b/)1.4 GB at Q4 | Fits | Fits | Fits | 573–811 | | [Qwen3-0.6B-Base](https://whatcanirunai.vercel.app/models/qwen3-0.6b-base/)1.4 GB at Q4 | Fits | Fits | Fits | 598–847 | | [d1-omni-600M](https://whatcanirunai.vercel.app/models/d1-omni-600m/)1.4 GB at Q4 | Fits | Fits | Fits | 607–860 | | [HyperCLOVAX-SEED-Text-Instruct-0.5B](https://whatcanirunai.vercel.app/models/hyperclovax-seed-text-instruct-0.5b/)1.4 GB at Q4 | Fits | Fits | Fits | 629–891 | | [Falcon-H1-0.5B-Instruct](https://whatcanirunai.vercel.app/models/falcon-h1-0.5b-instruct/)1.4 GB at Q4 | Fits | Fits | Fits | 683–968 | | [Qwen2.5-0.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-0.5b-instruct/)1.3 GB at Q4 | Fits | Fits | Fits | 721–1022 | | [Qwen2.5-0.5B](https://whatcanirunai.vercel.app/models/qwen2.5-0.5b/)1.3 GB at Q4 | Fits | Fits | Fits | 721–1022 | | [Qwen2-0.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2-0.5b-instruct/)1.3 GB at Q4 | Fits | Fits | Fits | 721–1022 | | [Qwen2.5-Coder-0.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-coder-0.5b-instruct/)1.3 GB at Q4 | Fits | Fits | Fits | 721–1022 | | [LFM2-VL-450M](https://whatcanirunai.vercel.app/models/lfm2-vl-450m/)1.3 GB at Q4 | Fits | Fits | Fits | 790–1120 | | [LFM2.5-VL-450M](https://whatcanirunai.vercel.app/models/lfm2.5-vl-450m/)1.3 GB at Q4 | Fits | Fits | Fits | 794–1125 | | [Apertus-v1.1-0.5B](https://whatcanirunai.vercel.app/models/apertus-v1.1-0.5b/)1.3 GB at Q4 | Fits | Fits | Fits | 813–1151 | | [MiniCPM4-0.5B](https://whatcanirunai.vercel.app/models/minicpm4-0.5b/)1.3 GB at Q4 | Fits | Fits | Fits | 821–1163 | | [circuit-sparsity](https://whatcanirunai.vercel.app/models/circuit-sparsity/)1.3 GB at Q4 | Fits | Fits | Fits | 850–1204 | | [SmolLM2-360M](https://whatcanirunai.vercel.app/models/smollm2-360m/)1.3 GB at Q4 | Fits | Fits | Fits | 985–1395 | | [SmolLM-360M](https://whatcanirunai.vercel.app/models/smollm-360m/)1.3 GB at Q4 | Fits | Fits | Fits | 985–1395 | | [ERNIE-4.5-0.3B-PT](https://whatcanirunai.vercel.app/models/ernie-4.5-0.3b-pt/)1.3 GB at Q4 | Fits | Fits | Fits | 988–1399 | | [LFM2.5-350M](https://whatcanirunai.vercel.app/models/lfm2.5-350m/)1.2 GB at Q4 | Fits | Fits | Fits | 1005–1424 | | [LFM2-350M](https://whatcanirunai.vercel.app/models/lfm2-350m/)1.2 GB at Q4 | Fits | Fits | Fits | 1005–1424 | | [granite-4.0-350m](https://whatcanirunai.vercel.app/models/granite-4.0-350m/)1.2 GB at Q4 | Fits | Fits | Fits | 1011–1432 | | [granite-4.0-h-350m](https://whatcanirunai.vercel.app/models/granite-4.0-h-350m/)1.2 GB at Q4 | Fits | Fits | Fits | 1047–1483 | ## Copy the parts list Two used RTX 3060 12GB cards for 24 GB GPU: 2× Used RTX 3060 12GB (Gigabyte Eagle OC, "Like New") — $780 (used listing) CPU: AMD Ryzen 5 9600X — $219 (Newegg price (sold by Newegg)) Motherboard: ASUS TUF GAMING B650E-PLUS WIFI — $150 (Newegg price (sold by Newegg)) RAM: Corsair Vengeance 32GB (2x16) DDR5-6000 C36 — $644 (Corsair store price) Power supply: Corsair RM850x — $140 (Corsair store price) Case: Corsair FRAME 4000D RS — $85 (Corsair store price) Storage: Samsung 990 1TB NVMe — $190 (Newegg price (sold by Newegg)) Total: $2,208 Usable memory: 24.0 GB Built with whatcanirunai.vercel.app/planner/ (estimates; prices are dated snapshots) Copy parts list [Open in planner and tweak](https://whatcanirunai.vercel.app/planner/?gpu=used-rtx-3060-12gb&n=2&plat=plat-9600x-b650e&ram=ram-32-6000&psu=psu-rm850x&case=case-frame-4000d&ssd=ssd-samsung-990-1tb) [Compare with other builds](https://whatcanirunai.vercel.app/builds/compare/?a=r:dual-used-rtx-3060-24gb&b=r:24gb-budget-build&m=qwen3-32b) --- Agent guide: https://whatcanirunai.vercel.app/llms.txt · JSON API: https://whatcanirunai.vercel.app/developers/