# RTX 5090 single-GPU build (32 GB) | What Can I Run AI? > RTX 5090 single-GPU build (32 GB): parts, total $4,533, 32.0 GB usable, estimated speed, PSU math and fit checks. Source: https://whatcanirunai.vercel.app/builds/rtx-5090-32gb-build/ [Builds](https://whatcanirunai.vercel.app/builds/) # RTX 5090 single-GPU build (32 GB) The fastest single consumer card for decode: 1,792 GB/s and 32 GB. Total $4,533 Usable memory 32.0 GB Qwen3-32B Q4 Fits Est. tok/s 54–77 PSU needed 1050 W $ per tok/s $69 ## Parts | Part | Item | Price | Buy | | ------------ | -------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | -------------------------------------------------------------------------------------------------------------------- | | GPU | GeForce RTX 5090 | $1,999[list price (MSRP)](https://www.nvidia.com/en-us/geforce/graphics-cards/50-series/rtx-5090/) | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%205090&tag=whatcanirunai-20) | | CPU | AMD Ryzen 7 9700X | $339[Newegg price (sold by Newegg)](https://www.newegg.com/p/N82E16819113843) | [Amazon](https://www.amazon.com/s?k=AMD%20Ryzen%207%209700X&tag=whatcanirunai-20) | | Motherboard | ASUS TUF GAMING B650E-PLUS WIFI | $150[Newegg price (sold by Newegg)](https://www.newegg.com/p/N82E16813119739) | [Amazon](https://www.amazon.com/s?k=ASUS%20TUF%20GAMING%20B650E-PLUS%20WIFI&tag=whatcanirunai-20) | | RAM | Corsair Vengeance 64GB (2x32) DDR5-6000 CL30 | $1,275[Corsair store price](https://www.corsair.com/us/en/p/memory/cmk64gx5m2b6000c30/vengeance-64gb-2x32gb-ddr5-dram-6000mt-s-cl30-memory-kit-black-cmk64gx5m2b6000c30) | [Amazon](https://www.amazon.com/s?k=Corsair%20Vengeance%2064GB%20%282x32%29%20DDR5-6000%20CL30&tag=whatcanirunai-20) | | Power supply | Corsair HX1200i | $280[Corsair store price](https://www.corsair.com/us/en/p/psu/cp-9020307-na/hx1200i-fully-modular-ultra-low-noise-platinum-atx-1200-watt-pc-power-supply-cp-9020307-na) | [Amazon](https://www.amazon.com/s?k=Corsair%20HX1200i&tag=whatcanirunai-20) | | Case | Corsair FRAME 5000D RS | $160[Corsair store price](https://www.corsair.com/us/en/p/pc-cases/cc-9011307-ww/frame-5000d-rs-high-airflow-mid-tower-pc-case-cc-9011307-ww) | [Amazon](https://www.amazon.com/s?k=Corsair%20FRAME%205000D%20RS&tag=whatcanirunai-20) | | Storage | Samsung 990 2TB NVMe | $330[Newegg price (sold by Newegg)](https://www.newegg.com/p/N82E16820147923) | [Amazon](https://www.amazon.com/s?k=Samsung%20990%202TB%20NVMe&tag=whatcanirunai-20) | | Total | **$4,533** | | | We may earn a commission when you buy through these links, at no extra cost to you. Prices are dated snapshots (2026-10-23 for parts; GPUs at list price unless marked used). Used prices come from one dated listing each. ## Will Qwen3-32B run? | Model | Q4\_K\_M | Q8\_0 | FP16 | Est. tok/s (Q4) | | -------------------------------------------- | -------- | --------- | --------- | --------------- | | [Qwen3-32B](https://whatcanirunai.vercel.app/models/qwen3-32b/)23.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 54–77 | Tok/s = memory bandwidth ÷ model weight size × a 60–85% efficiency band, calibrated on llama.cpp scoreboards. Mixture-of-experts models show only an upper bound ("up to"). [How we estimate speed](https://whatcanirunai.vercel.app/method/#speed). ## Power math (GPU 575×1 W + CPU 65 W + 150 W rest of system) × 1.3 = 1027 W → 1050 W PSU Running cost at full load: about 790 W, so **$0.14/hour** at an example $0.18/kWh (enter your own rate in the [planner](https://whatcanirunai.vercel.app/planner/)). Decode rarely holds the GPUs at full board power, so treat this as a ceiling. ## Fit checks * PSU: 1200 W vs. 1027 W recommended ((GPU 575 W + CPU 65 W + 150 W) × 1.3). Headroom 173 W. * Power connectors: need 1× 12V-2x6 cable + 0× PCIe 8-pin; PSU has 2× 12V-2x6 + 5× 8-pin. * Length: 304 mm card vs. 450 mm case limit. * Expansion slots: 1 card × 2-slot needs about 2; case has 8. ## All models on this build | Model | Q4\_K\_M | Q8\_0 | FP16 | Est. tok/s (Q4) | | ---------------------------------------------------------------------------------------------------------------------- | --------- | --------- | --------- | --------------- | | [Kimi-K3.1-Pro](https://whatcanirunai.vercel.app/models/kimi-k3.1-pro/)1939.3 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Kimi-K3](https://whatcanirunai.vercel.app/models/kimi-k3/)1939.1 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3.8-2.4T-A95B](https://whatcanirunai.vercel.app/models/qwen3.8-2.4t-a95b/)1706.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [LongCat-2.5](https://whatcanirunai.vercel.app/models/longcat-2.5/)1241.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [LongCat-2.0](https://whatcanirunai.vercel.app/models/longcat-2.0/)1238.9 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-V4-Pro-0813](https://whatcanirunai.vercel.app/models/deepseek-v4-pro-0813/)1151.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-V4-Pro](https://whatcanirunai.vercel.app/models/deepseek-v4-pro/)1115.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Kimi-K2.5](https://whatcanirunai.vercel.app/models/kimi-k2.5/)716.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Kimi-K2.6](https://whatcanirunai.vercel.app/models/kimi-k2.6/)716.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Kimi-K2.7-Code](https://whatcanirunai.vercel.app/models/kimi-k2.7-code/)716.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Kimi-K2-Thinking](https://whatcanirunai.vercel.app/models/kimi-k2-thinking/)716.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Kimi-K2-Instruct-0905](https://whatcanirunai.vercel.app/models/kimi-k2-instruct-0905/)716.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Kimi-K2-Instruct](https://whatcanirunai.vercel.app/models/kimi-k2-instruct/)716.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiMo-V2.6-Pro-RL](https://whatcanirunai.vercel.app/models/mimo-v2.6-pro-rl/)715.1 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiMo-V2.6-Pro-MOPD](https://whatcanirunai.vercel.app/models/mimo-v2.6-pro-mopd/)715.1 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiMo-V2.5-Pro](https://whatcanirunai.vercel.app/models/mimo-v2.5-pro/)714.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ring-2.5-1T](https://whatcanirunai.vercel.app/models/ring-2.5-1t/)706.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ling-2.5-1T](https://whatcanirunai.vercel.app/models/ling-2.5-1t/)706.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ling-1T](https://whatcanirunai.vercel.app/models/ling-1t/)698.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ring-1T](https://whatcanirunai.vercel.app/models/ring-1t/)698.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Inkling](https://whatcanirunai.vercel.app/models/inkling/)665.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Intern-S1-Pro](https://whatcanirunai.vercel.app/models/intern-s1-pro/)640.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Muse-Spark-Open-816B-A42B](https://whatcanirunai.vercel.app/models/muse-spark-open-816b-a42b/)574.1 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Hy4-preview](https://whatcanirunai.vercel.app/models/hy4-preview/)544.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [GLM-5](https://whatcanirunai.vercel.app/models/glm-5/)526.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [GLM-5.1](https://whatcanirunai.vercel.app/models/glm-5.1/)526.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [GLM-5.3](https://whatcanirunai.vercel.app/models/glm-5.3/)526.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [GLM-5.2](https://whatcanirunai.vercel.app/models/glm-5.2/)526.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [GLM-5.3-BF16](https://whatcanirunai.vercel.app/models/glm-5.3-bf16/)526.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [K-EXAONE-2.0-750B-A37B](https://whatcanirunai.vercel.app/models/k-exaone-2.0-750b-a37b/)523.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-V3.2-Exp](https://whatcanirunai.vercel.app/models/deepseek-v3.2-exp/)478.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-V3.2-Speciale](https://whatcanirunai.vercel.app/models/deepseek-v3.2-speciale/)478.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-V3.2](https://whatcanirunai.vercel.app/models/deepseek-v3.2/)478.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-V3-0324](https://whatcanirunai.vercel.app/models/deepseek-v3-0324/)478.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-R1-0528](https://whatcanirunai.vercel.app/models/deepseek-r1-0528/)478.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-V3.1-Base](https://whatcanirunai.vercel.app/models/deepseek-v3.1-base/)478.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-R1](https://whatcanirunai.vercel.app/models/deepseek-r1/)478.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-R1-Zero](https://whatcanirunai.vercel.app/models/deepseek-r1-zero/)478.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Step-5-Preview](https://whatcanirunai.vercel.app/models/step-5-preview/)422.3 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ling-3.1-flash](https://whatcanirunai.vercel.app/models/ling-3.1-flash/)399.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ling-3.1-flash-1019](https://whatcanirunai.vercel.app/models/ling-3.1-flash-1019/)399.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [LongCat-Flash-Chat](https://whatcanirunai.vercel.app/models/longcat-flash-chat/)392.7 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [LongCat-Flash-Thinking](https://whatcanirunai.vercel.app/models/longcat-flash-thinking/)392.7 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [LongCat-Flash-Thinking-2601](https://whatcanirunai.vercel.app/models/longcat-flash-thinking-2601/)392.7 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16](https://whatcanirunai.vercel.app/models/nvidia-nemotron-3-ultra-550b-a55b-bf16/)391.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Beam-1.0-501B-A23B](https://whatcanirunai.vercel.app/models/beam-1.0-501b-a23b/)350.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3-Coder-480B-A35B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-coder-480b-a35b-instruct/)335.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiniMax-M1-40k](https://whatcanirunai.vercel.app/models/minimax-m1-40k/)319.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiniMax-M1-80k](https://whatcanirunai.vercel.app/models/minimax-m1-80k/)319.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiniMax-M3](https://whatcanirunai.vercel.app/models/minimax-m3/)298.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [ERNIE-4.5-VL-424B-A47B-PT](https://whatcanirunai.vercel.app/models/ernie-4.5-vl-424b-a47b-pt/)296.3 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Intern-S2-397B](https://whatcanirunai.vercel.app/models/intern-s2-397b/)282.3 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3.5-397B-A17B](https://whatcanirunai.vercel.app/models/qwen3.5-397b-a17b/)282.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Llama-4-Maverick-17B-128E-Instruct](https://whatcanirunai.vercel.app/models/llama-4-maverick-17b-128e-instruct/)281.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Trinity-Large-Thinking](https://whatcanirunai.vercel.app/models/trinity-large-thinking/)278.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Trinity-Large-Preview](https://whatcanirunai.vercel.app/models/trinity-large-preview/)278.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Trinity-Large-TrueBase](https://whatcanirunai.vercel.app/models/trinity-large-truebase/)278.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Trinity-Large-Base](https://whatcanirunai.vercel.app/models/trinity-large-base/)278.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Nex-N2.5-Pro](https://whatcanirunai.vercel.app/models/nex-n2.5-pro/)277.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Nex-N2-Pro](https://whatcanirunai.vercel.app/models/nex-n2-pro/)277.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [NorthCUA-Pro](https://whatcanirunai.vercel.app/models/northcua-pro/)277.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [GLM-4.5](https://whatcanirunai.vercel.app/models/glm-4.5/)250.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [GLM-4.7](https://whatcanirunai.vercel.app/models/glm-4.7/)250.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [GLM-4.6](https://whatcanirunai.vercel.app/models/glm-4.6/)249.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [GLM-5.3-Flash](https://whatcanirunai.vercel.app/models/glm-5.3-flash/)225.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Motif-3](https://whatcanirunai.vercel.app/models/motif-3/)220.5 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [MiMo-V2.5](https://whatcanirunai.vercel.app/models/mimo-v2.5/)217.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiMo-V2.6-Flash-RL](https://whatcanirunai.vercel.app/models/mimo-v2.6-flash-rl/)217.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiMo-V2.6-Flash-MOPD](https://whatcanirunai.vercel.app/models/mimo-v2.6-flash-mopd/)217.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiMo-V2-Flash](https://whatcanirunai.vercel.app/models/mimo-v2-flash/)217.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-V4-Flash-Vision-Exp](https://whatcanirunai.vercel.app/models/deepseek-v4-flash-vision-exp/)213.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-V4-Flash-0731](https://whatcanirunai.vercel.app/models/deepseek-v4-flash-0731/)213.1 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [ERNIE-4.5-300B-A47B-PT](https://whatcanirunai.vercel.app/models/ernie-4.5-300b-a47b-pt/)210.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Hy3](https://whatcanirunai.vercel.app/models/hy3/)209.3 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Hy3-preview](https://whatcanirunai.vercel.app/models/hy3-preview/)209.3 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ling-plus](https://whatcanirunai.vercel.app/models/ling-plus/)205.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-V4-Flash](https://whatcanirunai.vercel.app/models/deepseek-v4-flash/)203.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MemT-1.0-Flash](https://whatcanirunai.vercel.app/models/memt-1.0-flash/)201.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [ERNIE-5.5-Flash-Base](https://whatcanirunai.vercel.app/models/ernie-5.5-flash-base/)200.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Inkling-Small](https://whatcanirunai.vercel.app/models/inkling-small/)186.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Llama-3\_1-Nemotron-Ultra-253B-v1](https://whatcanirunai.vercel.app/models/llama-3-1-nemotron-ultra-253b-v1/)177.7 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Solar-Open2-250B](https://whatcanirunai.vercel.app/models/solar-open2-250b/)175.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Intern-S1](https://whatcanirunai.vercel.app/models/intern-s1/)168.8 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [K-EXAONE-236B-A23B](https://whatcanirunai.vercel.app/models/k-exaone-236b-a23b/)166.3 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-V2.5](https://whatcanirunai.vercel.app/models/deepseek-v2.5/)165.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-Coder-V2-Instruct](https://whatcanirunai.vercel.app/models/deepseek-coder-v2-instruct/)165.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-V2.5-1210](https://whatcanirunai.vercel.app/models/deepseek-v2.5-1210/)165.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-V2-Chat-0628](https://whatcanirunai.vercel.app/models/deepseek-v2-chat-0628/)165.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-Coder-V2-Instruct-0724](https://whatcanirunai.vercel.app/models/deepseek-coder-v2-instruct-0724/)165.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3-VL-235B-A22B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-vl-235b-a22b-instruct/)165.3 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3-235B-A22B](https://whatcanirunai.vercel.app/models/qwen3-235b-a22b/)164.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3-235B-A22B-Instruct-2507](https://whatcanirunai.vercel.app/models/qwen3-235b-a22b-instruct-2507/)164.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3-235B-A22B-Thinking-2507](https://whatcanirunai.vercel.app/models/qwen3-235b-a22b-thinking-2507/)164.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiniMax-M2](https://whatcanirunai.vercel.app/models/minimax-m2/)160.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiniMax-M2.5](https://whatcanirunai.vercel.app/models/minimax-m2.5/)160.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiniMax-M2.7](https://whatcanirunai.vercel.app/models/minimax-m2.7/)160.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [MiniMax-M2.1](https://whatcanirunai.vercel.app/models/minimax-m2.1/)160.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [command-a-plus-05-2026-bf16](https://whatcanirunai.vercel.app/models/command-a-plus-05-2026-bf16/)153.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Step-3.7-Flash](https://whatcanirunai.vercel.app/models/step-3.7-flash/)141.4 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Step-3.5-Flash](https://whatcanirunai.vercel.app/models/step-3.5-flash/)140.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Step-3.5-Flash-Base-Midtrain](https://whatcanirunai.vercel.app/models/step-3.5-flash-base-midtrain/)138.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3.8-Flash-Next](https://whatcanirunai.vercel.app/models/qwen3.8-flash-next/)126.5 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Mixtral-8x22B-Instruct-v0.1](https://whatcanirunai.vercel.app/models/mixtral-8x22b-instruct-v0.1/)99.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ling-3.0-flash-Sante](https://whatcanirunai.vercel.app/models/ling-3.0-flash-sante/)89.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ling-3.0-flash](https://whatcanirunai.vercel.app/models/ling-3.0-flash/)89.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ling-3.0-flash-Fin](https://whatcanirunai.vercel.app/models/ling-3.0-flash-fin/)89.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ornith-1.5-122B](https://whatcanirunai.vercel.app/models/ornith-1.5-122b/)88.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3.5-122B-A10B](https://whatcanirunai.vercel.app/models/qwen3.5-122b-a10b/)88.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Devstral-2-123B-Instruct-2512](https://whatcanirunai.vercel.app/models/devstral-2-123b-instruct-2512/)88.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Ling-3.0-flash-VL](https://whatcanirunai.vercel.app/models/ling-3.0-flash-vl/)88.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [NVIDIA-Nemotron-3-Super-120B-A12B-BF16](https://whatcanirunai.vercel.app/models/nvidia-nemotron-3-super-120b-a12b-bf16/)87.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Mistral-Small-4-119B-2603](https://whatcanirunai.vercel.app/models/mistral-small-4-119b-2603/)84.2 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Youtu-LLM-A7B-Base](https://whatcanirunai.vercel.app/models/youtu-llm-a7b-base/)83.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Laguna-S-2.1](https://whatcanirunai.vercel.app/models/laguna-s-2.1/)83.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [gpt-oss-120b](https://whatcanirunai.vercel.app/models/gpt-oss-120b/)82.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [c4ai-command-a-03-2025](https://whatcanirunai.vercel.app/models/c4ai-command-a-03-2025/)78.4 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [GLM-4.5-Air](https://whatcanirunai.vercel.app/models/glm-4.5-air/)78.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Llama-4-Scout-17B-16E-Instruct](https://whatcanirunai.vercel.app/models/llama-4-scout-17b-16e-instruct/)76.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Llama-4-Scout-17B-16E](https://whatcanirunai.vercel.app/models/llama-4-scout-17b-16e/)76.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [GLM-4.5V](https://whatcanirunai.vercel.app/models/glm-4.5v/)76.1 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [GLM-4.6V](https://whatcanirunai.vercel.app/models/glm-4.6v/)76.1 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ling-2.6-flash](https://whatcanirunai.vercel.app/models/ling-2.6-flash/)75.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [sarvam-105b](https://whatcanirunai.vercel.app/models/sarvam-105b/)74.9 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ling-flash-2.0](https://whatcanirunai.vercel.app/models/ling-flash-2.0/)72.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [LLaDA2.1-flash](https://whatcanirunai.vercel.app/models/llada2.1-flash/)72.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Ring-flash-2.0](https://whatcanirunai.vercel.app/models/ring-flash-2.0/)72.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [LLaDA2.2-flash](https://whatcanirunai.vercel.app/models/llada2.2-flash/)72.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Solar-Open-100B](https://whatcanirunai.vercel.app/models/solar-open-100b/)72.6 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3-Next-80B-A3B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-next-80b-a3b-instruct/)57.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3-Next-80B-A3B-Thinking](https://whatcanirunai.vercel.app/models/qwen3-next-80b-a3b-thinking/)57.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [AliceAI-Foundation-80B-A3B-Base](https://whatcanirunai.vercel.app/models/aliceai-foundation-80b-a3b-base/)57.7 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Hunyuan-A13B-Instruct](https://whatcanirunai.vercel.app/models/hunyuan-a13b-instruct/)57.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen3-Coder-Next](https://whatcanirunai.vercel.app/models/qwen3-coder-next/)56.5 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Kolibri-1](https://whatcanirunai.vercel.app/models/kolibri-1/)55.5 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen2.5-VL-72B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-vl-72b-instruct/)52.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [UI-TARS-72B-DPO](https://whatcanirunai.vercel.app/models/ui-tars-72b-dpo/)52.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Qwen2.5-72B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-72b-instruct/)51.7 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Apertus-70B-Instruct-2509](https://whatcanirunai.vercel.app/models/apertus-70b-instruct-2509/)50.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Apertus-70B-2509](https://whatcanirunai.vercel.app/models/apertus-70b-2509/)50.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Llama-3.3-70B-Instruct](https://whatcanirunai.vercel.app/models/llama-3.3-70b-instruct/)50.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [DeepSeek-R1-Distill-Llama-70B](https://whatcanirunai.vercel.app/models/deepseek-r1-distill-llama-70b/)50.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Llama-3.1-70B](https://whatcanirunai.vercel.app/models/llama-3.1-70b/)50.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Hermes-2-Theta-Llama-3-70B](https://whatcanirunai.vercel.app/models/hermes-2-theta-llama-3-70b/)50.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Meta-Llama-3.1-70B-Instruct](https://whatcanirunai.vercel.app/models/meta-llama-3.1-70b-instruct/)50.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [LongCat-Flash-Lite](https://whatcanirunai.vercel.app/models/longcat-flash-lite/)49.2 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [AI21-Jamba2-Mini](https://whatcanirunai.vercel.app/models/ai21-jamba2-mini/)37.0 GB at Q4 · MoE | Won’t fit | Won’t fit | Won’t fit | — | | [Llama-3\_1-Nemotron-51B-Instruct](https://whatcanirunai.vercel.app/models/llama-3-1-nemotron-51b-instruct/)36.9 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Llama-3\_3-Nemotron-Super-49B-v1\_5](https://whatcanirunai.vercel.app/models/llama-3-3-nemotron-super-49b-v1-5/)35.8 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Llama-3\_3-Nemotron-Super-49B-v1](https://whatcanirunai.vercel.app/models/llama-3-3-nemotron-super-49b-v1/)35.8 GB at Q4 | Won’t fit | Won’t fit | Won’t fit | — | | [Phi-3.5-MoE-instruct](https://whatcanirunai.vercel.app/models/phi-3.5-moe-instruct/)30.2 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 381 | | [GRIN-MoE](https://whatcanirunai.vercel.app/models/grin-moe/)30.2 GB at Q4 · MoE | Tight | Won’t fit | Won’t fit | up to 381 | | [ALIA-40b](https://whatcanirunai.vercel.app/models/alia-40b/)29.2 GB at Q4 | Tight | Won’t fit | Won’t fit | 44–62 | | [IQuest-Coder-V1-40B-Loop-Instruct](https://whatcanirunai.vercel.app/models/iquest-coder-v1-40b-loop-instruct/)28.7 GB at Q4 | Fits | Won’t fit | Won’t fit | 45–63 | | [IQuest-Coder-V1-40B-Instruct](https://whatcanirunai.vercel.app/models/iquest-coder-v1-40b-instruct/)28.7 GB at Q4 | Fits | Won’t fit | Won’t fit | 45–63 | | [Recursive Flint](https://whatcanirunai.vercel.app/models/flint/)28.7 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 1006 | | [K2-Horizon-MoVA-36B-A4B](https://whatcanirunai.vercel.app/models/k2-horizon-mova-36b-a4b/)27.1 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 628 | | [Seed-OSS-36B-Instruct](https://whatcanirunai.vercel.app/models/seed-oss-36b-instruct/)26.2 GB at Q4 | Fits | Won’t fit | Won’t fit | 49–69 | | [Seed-OSS-36B-Base-woSyn](https://whatcanirunai.vercel.app/models/seed-oss-36b-base-wosyn/)26.2 GB at Q4 | Fits | Won’t fit | Won’t fit | 49–69 | | [Intern-S2-Preview](https://whatcanirunai.vercel.app/models/intern-s2-preview/)26.2 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 | | [Ornith-1.5-35B-A3B](https://whatcanirunai.vercel.app/models/ornith-1.5-35b-a3b/)26.1 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 | | [Sage-A1.5](https://whatcanirunai.vercel.app/models/sage-a1.5/)26.1 GB at Q4 | Fits | Won’t fit | Won’t fit | 49–70 | | [Qwen3.6-35B-A3B](https://whatcanirunai.vercel.app/models/qwen3.6-35b-a3b/)26.1 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 | | [Qwen3.5-35B-A3B](https://whatcanirunai.vercel.app/models/qwen3.5-35b-a3b/)26.1 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 | | [Apex-35B-V1.0](https://whatcanirunai.vercel.app/models/apex-35b-v1.0/)26.1 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 | | [MiniCPM-V-4.7-35B-A3B](https://whatcanirunai.vercel.app/models/minicpm-v-4.7-35b-a3b/)25.5 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 | | [MemT-1.0-Nano](https://whatcanirunai.vercel.app/models/memt-1.0-nano/)25.5 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 | | [Agents-A1](https://whatcanirunai.vercel.app/models/agents-a1/)25.5 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 | | [Nex-N2.5-mini](https://whatcanirunai.vercel.app/models/nex-n2.5-mini/)25.5 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 | | [Nex-N2-mini](https://whatcanirunai.vercel.app/models/nex-n2-mini/)25.5 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 | | [Axion-1.0-35B](https://whatcanirunai.vercel.app/models/axion-1.0-35b/)25.5 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 | | [NorthCUA-Mini](https://whatcanirunai.vercel.app/models/northcua-mini/)25.5 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 | | [Clover-35B-A3B-Preview](https://whatcanirunai.vercel.app/models/clover-35b-a3b-preview/)25.2 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 | | [Qwen-AgentWorld-35B-A3B](https://whatcanirunai.vercel.app/models/qwen-agentworld-35b-a3b/)25.2 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 | | [KAT-Coder-V2.5-Dev](https://whatcanirunai.vercel.app/models/kat-coder-v2.5-dev/)25.2 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 | | [EXAONE-4.5-33B](https://whatcanirunai.vercel.app/models/exaone-4.5-33b/)24.9 GB at Q4 | Fits | Won’t fit | Won’t fit | 52–73 | | [Falcon-H1-34B-Instruct](https://whatcanirunai.vercel.app/models/falcon-h1-34b-instruct/)24.5 GB at Q4 | Fits | Won’t fit | Won’t fit | 53–75 | | [Qwen2.5-VL-32B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-vl-32b-instruct/)24.3 GB at Q4 | Fits | Won’t fit | Won’t fit | 53–75 | | [Laguna-XS.2](https://whatcanirunai.vercel.app/models/laguna-xs.2/)24.3 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 | | [Qwen3-VL-32B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-vl-32b-instruct/)24.3 GB at Q4 | Fits | Won’t fit | Won’t fit | 53–75 | | [HyperCLOVAX-SEED-Think-32B](https://whatcanirunai.vercel.app/models/hyperclovax-seed-think-32b/)24.2 GB at Q4 | Fits | Won’t fit | Won’t fit | 53–75 | | [FlexOlmo-7x7B-1T](https://whatcanirunai.vercel.app/models/flexolmo-7x7b-1t/)24.2 GB at Q4 | Fits | Won’t fit | Won’t fit | 53–76 | | [GLM-Z1-Rumination-32B-0414](https://whatcanirunai.vercel.app/models/glm-z1-rumination-32b-0414/)24.1 GB at Q4 | Fits | Won’t fit | Won’t fit | 54–76 | | [Nanbeige4.3-33B](https://whatcanirunai.vercel.app/models/nanbeige4.3-33b/)24.1 GB at Q4 | Fits | Won’t fit | Won’t fit | 54–76 | | [Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16](https://whatcanirunai.vercel.app/models/nemotron-3-nano-omni-30b-a3b-reasoning-bf16/)24.0 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 | | [Qwen2.5-Coder-32B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-coder-32b-instruct/)23.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 54–77 | | [DeepSeek-R1-Distill-Qwen-32B](https://whatcanirunai.vercel.app/models/deepseek-r1-distill-qwen-32b/)23.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 54–77 | | [Qwen2.5-32B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-32b-instruct/)23.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 54–77 | | [QwQ-32B](https://whatcanirunai.vercel.app/models/qwq-32b/)23.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 54–77 | | [QwQ-32B-Preview](https://whatcanirunai.vercel.app/models/qwq-32b-preview/)23.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 54–77 | | [Qwen2.5-32B](https://whatcanirunai.vercel.app/models/qwen2.5-32b/)23.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 54–77 | | [Qwen2.5-Coder-32B](https://whatcanirunai.vercel.app/models/qwen2.5-coder-32b/)23.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 54–77 | | [Qwen3-32B](https://whatcanirunai.vercel.app/models/qwen3-32b/)23.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 54–77 | | [GLM-Z1-32B-0414](https://whatcanirunai.vercel.app/models/glm-z1-32b-0414/)23.7 GB at Q4 | Fits | Won’t fit | Won’t fit | 54–77 | | [GLM-4-32B-0414](https://whatcanirunai.vercel.app/models/glm-4-32b-0414/)23.7 GB at Q4 | Fits | Won’t fit | Won’t fit | 54–77 | | [OLMo-2-0325-32B-Instruct](https://whatcanirunai.vercel.app/models/olmo-2-0325-32b-instruct/)23.5 GB at Q4 | Fits | Won’t fit | Won’t fit | 55–78 | | [OLMo-2-0325-32B](https://whatcanirunai.vercel.app/models/olmo-2-0325-32b/)23.5 GB at Q4 | Fits | Won’t fit | Won’t fit | 55–78 | | [Olmo-3-32B-Think](https://whatcanirunai.vercel.app/models/olmo-3-32b-think/)23.5 GB at Q4 | Fits | Won’t fit | Won’t fit | 55–78 | | [Olmo-3-1125-32B](https://whatcanirunai.vercel.app/models/olmo-3-1125-32b/)23.5 GB at Q4 | Fits | Won’t fit | Won’t fit | 55–78 | | [Olmo-3.1-32B-Instruct](https://whatcanirunai.vercel.app/models/olmo-3.1-32b-instruct/)23.5 GB at Q4 | Fits | Won’t fit | Won’t fit | 55–78 | | [Olmo-3.1-32B-Think](https://whatcanirunai.vercel.app/models/olmo-3.1-32b-think/)23.5 GB at Q4 | Fits | Won’t fit | Won’t fit | 55–78 | | [Olmo-3.1-32B-Instruct-DPO](https://whatcanirunai.vercel.app/models/olmo-3.1-32b-instruct-dpo/)23.5 GB at Q4 | Fits | Won’t fit | Won’t fit | 55–78 | | [granite-4.0-h-small](https://whatcanirunai.vercel.app/models/granite-4.0-h-small/)23.5 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 279 | | [sarvam-30b](https://whatcanirunai.vercel.app/models/sarvam-30b/)23.4 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 1047 | | [EXAONE-4.0-32B](https://whatcanirunai.vercel.app/models/exaone-4.0-32b/)23.3 GB at Q4 | Fits | Won’t fit | Won’t fit | 55–79 | | [EXAONE-4.0.1-32B](https://whatcanirunai.vercel.app/models/exaone-4.0.1-32b/)23.3 GB at Q4 | Fits | Won’t fit | Won’t fit | 55–79 | | [EXAONE-3.5-32B-Instruct](https://whatcanirunai.vercel.app/models/exaone-3.5-32b-instruct/)23.3 GB at Q4 | Fits | Won’t fit | Won’t fit | 55–79 | | [EXAONE-Deep-32B](https://whatcanirunai.vercel.app/models/exaone-deep-32b/)23.3 GB at Q4 | Fits | Won’t fit | Won’t fit | 55–79 | | [NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16](https://whatcanirunai.vercel.app/models/nvidia-nemotron-3.5-lightning-30b-a3b-bf16/)23.0 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 | | [NVIDIA-Nemotron-3-Nano-30B-A3B-BF16](https://whatcanirunai.vercel.app/models/nvidia-nemotron-3-nano-30b-a3b-bf16/)23.0 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 | | [Nemotron-Cascade-2-30B-A3B](https://whatcanirunai.vercel.app/models/nemotron-cascade-2-30b-a3b/)23.0 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 | | [Gemma 4 31B](https://whatcanirunai.vercel.app/models/gemma-4-31b-it/)22.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 57–80 | | [gemma-4-31B](https://whatcanirunai.vercel.app/models/gemma-4-31b/)22.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 57–80 | | [GLM-4.7-Flash](https://whatcanirunai.vercel.app/models/glm-4.7-flash/)22.8 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 | | [Xing4.0-29B-A4B](https://whatcanirunai.vercel.app/models/xing4.0-29b-a4b/)22.8 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 628 | | [Xing4.0-29B-Intent](https://whatcanirunai.vercel.app/models/xing4.0-29b-intent/)22.8 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 628 | | [Qwen3-VL-30B-A3B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-vl-30b-a3b-instruct/)22.7 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 | | [Qwen3-VL-30B-A3B-Thinking](https://whatcanirunai.vercel.app/models/qwen3-vl-30b-a3b-thinking/)22.7 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 | | [UI-Venus-1.5-30B-A3B](https://whatcanirunai.vercel.app/models/ui-venus-1.5-30b-a3b/)22.7 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 | | [kanana-2-30b-a3b-instruct-2601](https://whatcanirunai.vercel.app/models/kanana-2-30b-a3b-instruct-2601/)22.4 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 | | [kanana-2-30b-a3b-instruct](https://whatcanirunai.vercel.app/models/kanana-2-30b-a3b-instruct/)22.4 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 | | [kanana-2-30b-a3b-thinking-2601](https://whatcanirunai.vercel.app/models/kanana-2-30b-a3b-thinking-2601/)22.4 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 | | [Qwen3-30B-A3B](https://whatcanirunai.vercel.app/models/qwen3-30b-a3b/)22.3 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 | | [Qwen3-Coder-30B-A3B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-coder-30b-a3b-instruct/)22.3 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 | | [Qwen3-30B-A3B-Instruct-2507](https://whatcanirunai.vercel.app/models/qwen3-30b-a3b-instruct-2507/)22.3 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 | | [Qwen3-30B-A3B-Thinking-2507](https://whatcanirunai.vercel.app/models/qwen3-30b-a3b-thinking-2507/)22.3 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 | | [Tongyi-DeepResearch-30B-A3B](https://whatcanirunai.vercel.app/models/tongyi-deepresearch-30b-a3b/)22.3 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 | | [Rubicon-Preview](https://whatcanirunai.vercel.app/models/rubicon-preview/)22.3 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 | | [North-Mini-Code-1.0](https://whatcanirunai.vercel.app/models/north-mini-code-1.0/)22.3 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 | | [Hy-Memory-30B-A3B](https://whatcanirunai.vercel.app/models/hy-memory-30b-a3b/)22.0 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 | | [Hy-MT2-30B-A3B](https://whatcanirunai.vercel.app/models/hy-mt2-30b-a3b/)22.0 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 837 | | [granite-switch-4.1-30b](https://whatcanirunai.vercel.app/models/granite-switch-4.1-30b/)21.9 GB at Q4 | Fits | Won’t fit | Won’t fit | 59–84 | | [Muse-Glimmer-30B](https://whatcanirunai.vercel.app/models/muse-glimmer-30b/)21.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 60–84 | | [ERNIE-4.5-VL-28B-A3B-Thinking](https://whatcanirunai.vercel.app/models/ernie-4.5-vl-28b-a3b-thinking/)21.7 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 | | [ERNIE-4.5-VL-28B-A3B-PT](https://whatcanirunai.vercel.app/models/ernie-4.5-vl-28b-a3b-pt/)21.5 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 | | [granite-4.2-30b](https://whatcanirunai.vercel.app/models/granite-4.2-30b/)21.4 GB at Q4 | Fits | Won’t fit | Won’t fit | 61–86 | | [granite-4.1-30b](https://whatcanirunai.vercel.app/models/granite-4.1-30b/)21.1 GB at Q4 | Fits | Won’t fit | Won’t fit | 61–87 | | [Raon-1 mini preview](https://whatcanirunai.vercel.app/models/raon-1-mini-preview/)21.1 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 584 | | [Qwen3.8-27B](https://whatcanirunai.vercel.app/models/qwen3.8-27b/)20.4 GB at Q4 | Fits | Won’t fit | Won’t fit | 64–90 | | [Tess-4.5-27B](https://whatcanirunai.vercel.app/models/tess-4.5-27b/)20.4 GB at Q4 | Fits | Won’t fit | Won’t fit | 64–90 | | [Qwen3.6-27B](https://whatcanirunai.vercel.app/models/qwen3.6-27b/)20.4 GB at Q4 | Fits | Won’t fit | Won’t fit | 64–90 | | [Qwen3.5-27B](https://whatcanirunai.vercel.app/models/qwen3.5-27b/)20.4 GB at Q4 | Fits | Won’t fit | Won’t fit | 64–90 | | [gemma-3-27b-it](https://whatcanirunai.vercel.app/models/gemma-3-27b-it/)20.1 GB at Q4 | Fits | Won’t fit | Won’t fit | 65–92 | | [Arete-27B](https://whatcanirunai.vercel.app/models/arete-27b/)20.1 GB at Q4 | Fits | Won’t fit | Won’t fit | 65–92 | | [gemma-2-27b-it](https://whatcanirunai.vercel.app/models/gemma-2-27b-it/)20.0 GB at Q4 | Fits | Won’t fit | Won’t fit | 65–92 | | [gemma-2-27b](https://whatcanirunai.vercel.app/models/gemma-2-27b/)20.0 GB at Q4 | Fits | Won’t fit | Won’t fit | 65–92 | | [Qwen3.8-27B-Longbook27-v2](https://whatcanirunai.vercel.app/models/qwen3.8-27b-longbook27-v2/)19.9 GB at Q4 | Fits | Won’t fit | Won’t fit | 66–93 | | [medgemma-27b-text-it](https://whatcanirunai.vercel.app/models/medgemma-27b-text-it/)19.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 66–93 | | [Hemmingway-1.5](https://whatcanirunai.vercel.app/models/hemmingway-1.5/)19.8 GB at Q4 | Fits | Won’t fit | Won’t fit | 66–93 | | [Trinity-Mini](https://whatcanirunai.vercel.app/models/trinity-mini/)19.2 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 838 | | [diffusiongemma-26B-A4B-it](https://whatcanirunai.vercel.app/models/diffusiongemma-26b-a4b-it/)19.0 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 628 | | [Gemma 4 26B A4B](https://whatcanirunai.vercel.app/models/gemma-4-26b-a4b-it/)19.0 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 661 | | [gemma-4-26B-A4B](https://whatcanirunai.vercel.app/models/gemma-4-26b-a4b/)19.0 GB at Q4 · MoE | Fits | Won’t fit | Won’t fit | up to 628 | | [Voxtral-Small-24B-2507](https://whatcanirunai.vercel.app/models/voxtral-small-24b-2507/)17.9 GB at Q4 | Fits | Tight | Won’t fit | 73–104 | | [Mistral-Small-3.2-24B-Instruct-2506](https://whatcanirunai.vercel.app/models/mistral-small-3.2-24b-instruct-2506/)17.7 GB at Q4 | Fits | Tight | Won’t fit | 74–105 | | [Mistral-Small-3.1-24B-Instruct-2503](https://whatcanirunai.vercel.app/models/mistral-small-3.1-24b-instruct-2503/)17.7 GB at Q4 | Fits | Tight | Won’t fit | 74–105 | | [LFM2.5-24B-A2B](https://whatcanirunai.vercel.app/models/lfm2.5-24b-a2b/)17.7 GB at Q4 · MoE | Fits | Tight | Won’t fit | up to 1257 | | [LFM2-24B-A2B](https://whatcanirunai.vercel.app/models/lfm2-24b-a2b/)17.6 GB at Q4 · MoE | Fits | Tight | Won’t fit | up to 1256 | | [Mistral-Small-24B-Instruct-2501](https://whatcanirunai.vercel.app/models/mistral-small-24b-instruct-2501/)17.4 GB at Q4 | Fits | Tight | Won’t fit | 75–107 | | [EuroLLM-22B-Instruct-2512](https://whatcanirunai.vercel.app/models/eurollm-22b-instruct-2512/)16.8 GB at Q4 | Fits | Fits | Won’t fit | 78–111 | | [EuroLLM-22B-2512](https://whatcanirunai.vercel.app/models/eurollm-22b-2512/)16.8 GB at Q4 | Fits | Fits | Won’t fit | 78–111 | | [solar-pro-preview-instruct](https://whatcanirunai.vercel.app/models/solar-pro-preview-instruct/)16.4 GB at Q4 | Fits | Fits | Won’t fit | 80–113 | | [ERNIE-4.5-21B-A3B-PT](https://whatcanirunai.vercel.app/models/ernie-4.5-21b-a3b-pt/)16.3 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 837 | | [ERNIE-4.5-21B-A3B-Thinking](https://whatcanirunai.vercel.app/models/ernie-4.5-21b-a3b-thinking/)16.2 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 837 | | [gpt-oss-20b](https://whatcanirunai.vercel.app/models/gpt-oss-20b/)15.6 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 698 | | [reka-flash-3](https://whatcanirunai.vercel.app/models/reka-flash-3/)15.6 GB at Q4 | Fits | Fits | Won’t fit | 85–120 | | [maple-preview](https://whatcanirunai.vercel.app/models/maple-preview/)15.1 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 2511 | | [internlm2\_5-20b-chat](https://whatcanirunai.vercel.app/models/internlm2-5-20b-chat/)14.8 GB at Q4 | Fits | Fits | Won’t fit | 89–127 | | [Groot-19B-A3B-261023](https://whatcanirunai.vercel.app/models/groot-19b-a3b-261023/)14.5 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 837 | | [Ling-Coder-lite](https://whatcanirunai.vercel.app/models/ling-coder-lite/)12.7 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 913 | | [Ring-lite-distill-preview](https://whatcanirunai.vercel.app/models/ring-lite-distill-preview/)12.7 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 913 | | [Ling-lite](https://whatcanirunai.vercel.app/models/ling-lite/)12.7 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 913 | | [Ling-lite-1.5-2507](https://whatcanirunai.vercel.app/models/ling-lite-1.5-2507/)12.7 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 913 | | [Ling-lite-1.5](https://whatcanirunai.vercel.app/models/ling-lite-1.5/)12.7 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 913 | | [Ring-lite](https://whatcanirunai.vercel.app/models/ring-lite/)12.7 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 913 | | [Ring-mini-linear-2.0](https://whatcanirunai.vercel.app/models/ring-mini-linear-2.0/)12.5 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 1571 | | [Kimi-VL-A3B-Instruct](https://whatcanirunai.vercel.app/models/kimi-vl-a3b-instruct/)12.4 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 838 | | [Kimi-VL-A3B-Thinking](https://whatcanirunai.vercel.app/models/kimi-vl-a3b-thinking/)12.4 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 838 | | [Kimi-VL-A3B-Thinking-2506](https://whatcanirunai.vercel.app/models/kimi-vl-a3b-thinking-2506/)12.4 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 838 | | [LLaDA2.1-mini](https://whatcanirunai.vercel.app/models/llada2.1-mini/)12.3 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 1795 | | [LLaDA2.0-mini](https://whatcanirunai.vercel.app/models/llada2.0-mini/)12.3 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 1795 | | [Ling-mini-2.0](https://whatcanirunai.vercel.app/models/ling-mini-2.0/)12.3 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 1795 | | [Ring-mini-2.0](https://whatcanirunai.vercel.app/models/ring-mini-2.0/)12.3 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 1795 | | [LLaDA2.2-mini](https://whatcanirunai.vercel.app/models/llada2.2-mini/)12.3 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 1795 | | [LLaDA2.0-mini-preview](https://whatcanirunai.vercel.app/models/llada2.0-mini-preview/)12.3 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 1795 | | [Moonlight-16B-A3B-Instruct](https://whatcanirunai.vercel.app/models/moonlight-16b-a3b-instruct/)12.1 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 837 | | [Moonlight-16B-A3B](https://whatcanirunai.vercel.app/models/moonlight-16b-a3b/)12.1 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 837 | | [Instella-MoE-16B-A3B-Think](https://whatcanirunai.vercel.app/models/instella-moe-16b-a3b-think/)12.1 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 838 | | [DeepSeek-Coder-V2-Lite-Instruct](https://whatcanirunai.vercel.app/models/deepseek-coder-v2-lite-instruct/)12.0 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 1047 | | [kanana-1.5-15.7b-a3b-instruct](https://whatcanirunai.vercel.app/models/kanana-1.5-15.7b-a3b-instruct/)11.9 GB at Q4 · MoE | Fits | Fits | Won’t fit | up to 838 | | [Phi-4-reasoning-vision-15B](https://whatcanirunai.vercel.app/models/phi-4-reasoning-vision-15b/)11.5 GB at Q4 | Fits | Fits | Won’t fit | 117–166 | | [Apriel-Nemotron-15b-Thinker](https://whatcanirunai.vercel.app/models/apriel-nemotron-15b-thinker/)11.4 GB at Q4 | Fits | Fits | Won’t fit | 118–168 | | [Apriel-1.5-15b-Thinker](https://whatcanirunai.vercel.app/models/apriel-1.5-15b-thinker/)11.4 GB at Q4 | Fits | Fits | Won’t fit | 119–169 | | [Apriel-1.6-15b-Thinker](https://whatcanirunai.vercel.app/models/apriel-1.6-15b-thinker/)11.4 GB at Q4 | Fits | Fits | Won’t fit | 119–169 | | [Carbon-X (DNA)](https://whatcanirunai.vercel.app/models/carbon-x/)11.3 GB at Q4 | Fits | Fits | Won’t fit | 120–170 | | [Qwen2.5-Coder-14B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-coder-14b-instruct/)11.3 GB at Q4 | Fits | Fits | Won’t fit | 120–170 | | [DeepSeek-R1-Distill-Qwen-14B](https://whatcanirunai.vercel.app/models/deepseek-r1-distill-qwen-14b/)11.3 GB at Q4 | Fits | Fits | Won’t fit | 120–170 | | [Qwen2.5-14B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-14b-instruct/)11.3 GB at Q4 | Fits | Fits | Won’t fit | 120–170 | | [Qwen2.5-14B](https://whatcanirunai.vercel.app/models/qwen2.5-14b/)11.3 GB at Q4 | Fits | Fits | Won’t fit | 120–170 | | [Qwen2.5-14B-Instruct-1M](https://whatcanirunai.vercel.app/models/qwen2.5-14b-instruct-1m/)11.3 GB at Q4 | Fits | Fits | Won’t fit | 120–170 | | [Qwen2.5-Coder-14B](https://whatcanirunai.vercel.app/models/qwen2.5-coder-14b/)11.3 GB at Q4 | Fits | Fits | Won’t fit | 120–170 | | [Qwen3-14B](https://whatcanirunai.vercel.app/models/qwen3-14b/)11.3 GB at Q4 | Fits | Fits | Won’t fit | 120–170 | | [JanusCoder-14B](https://whatcanirunai.vercel.app/models/januscoder-14b/)11.3 GB at Q4 | Fits | Fits | Won’t fit | 120–170 | | [HyperCLOVAX-SEED-Think-14B](https://whatcanirunai.vercel.app/models/hyperclovax-seed-think-14b/)11.3 GB at Q4 | Fits | Fits | Won’t fit | 120–170 | | [phi-4](https://whatcanirunai.vercel.app/models/phi-4/)11.2 GB at Q4 | Fits | Fits | Won’t fit | 121–171 | | [Phi-4-reasoning](https://whatcanirunai.vercel.app/models/phi-4-reasoning/)11.2 GB at Q4 | Fits | Fits | Won’t fit | 121–171 | | [Phi-4-reasoning-plus](https://whatcanirunai.vercel.app/models/phi-4-reasoning-plus/)11.2 GB at Q4 | Fits | Fits | Won’t fit | 121–171 | | [OLMo-2-1124-13B-Instruct](https://whatcanirunai.vercel.app/models/olmo-2-1124-13b-instruct/)10.6 GB at Q4 | Fits | Fits | Won’t fit | 129–183 | | [Mistral-Nemo-Instruct-2407](https://whatcanirunai.vercel.app/models/mistral-nemo-instruct-2407/)9.5 GB at Q4 | Fits | Fits | Tight | 145–205 | | [gemma-3-12b-it](https://whatcanirunai.vercel.app/models/gemma-3-12b-it/)9.5 GB at Q4 | Fits | Fits | Tight | 146–206 | | [gemma-3-12b-pt](https://whatcanirunai.vercel.app/models/gemma-3-12b-pt/)9.5 GB at Q4 | Fits | Fits | Tight | 146–206 | | [Mellum2.1-12B-A2.5B-Thinking](https://whatcanirunai.vercel.app/models/mellum2.1-12b-a2.5b-thinking/)9.5 GB at Q4 · MoE | Fits | Fits | Tight | up to 1005 | | [Mellum2-12B-A2.5B-Thinking](https://whatcanirunai.vercel.app/models/mellum2-12b-a2.5b-thinking/)9.5 GB at Q4 · MoE | Fits | Fits | Tight | up to 1005 | | [Mellum2-12B-A2.5B-Instruct](https://whatcanirunai.vercel.app/models/mellum2-12b-a2.5b-instruct/)9.5 GB at Q4 · MoE | Fits | Fits | Tight | up to 1005 | | [Mellum2-12B-A2.5B-Thinking-SFT](https://whatcanirunai.vercel.app/models/mellum2-12b-a2.5b-thinking-sft/)9.5 GB at Q4 · MoE | Fits | Fits | Tight | up to 1005 | | [Mellum2.1-12B-A2.5B-Thinking-MTP](https://whatcanirunai.vercel.app/models/mellum2.1-12b-a2.5b-thinking-mtp/)9.5 GB at Q4 · MoE | Fits | Fits | Tight | up to 1005 | | [Gemma 4 12B](https://whatcanirunai.vercel.app/models/gemma-4-12b-it/)9.3 GB at Q4 | Fits | Fits | Fits | 148–210 | | [HyperCLOVAX-SEED-Omni-8B](https://whatcanirunai.vercel.app/models/hyperclovax-seed-omni-8b/)8.5 GB at Q4 | Fits | Fits | Fits | 165–234 | | [Llama-3.2-11B-Vision-Instruct](https://whatcanirunai.vercel.app/models/llama-3.2-11b-vision-instruct/)8.4 GB at Q4 | Fits | Fits | Fits | 166–235 | | [Llama-3.2-11B-Vision](https://whatcanirunai.vercel.app/models/llama-3.2-11b-vision/)8.4 GB at Q4 | Fits | Fits | Fits | 167–236 | | [Falcon3-10B-Instruct](https://whatcanirunai.vercel.app/models/falcon3-10b-instruct/)8.2 GB at Q4 | Fits | Fits | Fits | 172–244 | | [GLM-4.1V-9B-Thinking](https://whatcanirunai.vercel.app/models/glm-4.1v-9b-thinking/)8.2 GB at Q4 | Fits | Fits | Fits | 172–244 | | [GLM-4.6V-Flash](https://whatcanirunai.vercel.app/models/glm-4.6v-flash/)8.2 GB at Q4 | Fits | Fits | Fits | 172–244 | | [GLM-4.1V-9B-Base](https://whatcanirunai.vercel.app/models/glm-4.1v-9b-base/)8.2 GB at Q4 | Fits | Fits | Fits | 172–244 | | [Glyph](https://whatcanirunai.vercel.app/models/glyph/)8.2 GB at Q4 | Fits | Fits | Fits | 172–244 | | [INTELLECT-1-Instruct](https://whatcanirunai.vercel.app/models/intellect-1-instruct/)8.1 GB at Q4 | Fits | Fits | Fits | 174–246 | | [INTELLECT-1](https://whatcanirunai.vercel.app/models/intellect-1/)8.1 GB at Q4 | Fits | Fits | Fits | 174–246 | | [ZAYA1-VL-8B](https://whatcanirunai.vercel.app/models/zaya1-vl-8b/)7.8 GB at Q4 | Fits | Fits | Fits | 182–258 | | [SenseNova-Loop-9B-Preview](https://whatcanirunai.vercel.app/models/sensenova-loop-9b-preview/)7.7 GB at Q4 | Fits | Fits | Fits | 184–260 | | [Ornith-1.5-9B](https://whatcanirunai.vercel.app/models/ornith-1.5-9b/)7.7 GB at Q4 | Fits | Fits | Fits | 184–260 | | [Qwen3.5-9B](https://whatcanirunai.vercel.app/models/qwen3.5-9b/)7.7 GB at Q4 | Fits | Fits | Fits | 184–260 | | [MiniCPM-SALA](https://whatcanirunai.vercel.app/models/minicpm-sala/)7.6 GB at Q4 | Fits | Fits | Fits | 187–265 | | [NorthCUA-Nano](https://whatcanirunai.vercel.app/models/northcua-nano/)7.6 GB at Q4 | Fits | Fits | Fits | 188–267 | | [GLM-4-9B-0414](https://whatcanirunai.vercel.app/models/glm-4-9b-0414/)7.6 GB at Q4 | Fits | Fits | Fits | 189–267 | | [GLM-Z1-9B-0414](https://whatcanirunai.vercel.app/models/glm-z1-9b-0414/)7.6 GB at Q4 | Fits | Fits | Fits | 189–267 | | [codegeex4-all-9b](https://whatcanirunai.vercel.app/models/codegeex4-all-9b/)7.6 GB at Q4 | Fits | Fits | Fits | 189–267 | | [glm-4-9b-chat-hf](https://whatcanirunai.vercel.app/models/glm-4-9b-chat-hf/)7.6 GB at Q4 | Fits | Fits | Fits | 189–267 | | [moondream3-preview](https://whatcanirunai.vercel.app/models/moondream3-preview/)7.5 GB at Q4 | Fits | Fits | Fits | 191–271 | | [gemma-2-9b-it](https://whatcanirunai.vercel.app/models/gemma-2-9b-it/)7.4 GB at Q4 | Fits | Fits | Fits | 192–272 | | [gemma-2-9b](https://whatcanirunai.vercel.app/models/gemma-2-9b/)7.4 GB at Q4 | Fits | Fits | Fits | 192–272 | | [Gemma-SEA-LION-v3-9B-IT](https://whatcanirunai.vercel.app/models/gemma-sea-lion-v3-9b-it/)7.4 GB at Q4 | Fits | Fits | Fits | 192–272 | | [EuroLLM-9B-Instruct-2512](https://whatcanirunai.vercel.app/models/eurollm-9b-instruct-2512/)7.4 GB at Q4 | Fits | Fits | Fits | 194–275 | | [NVIDIA-Nemotron-Nano-9B-v2](https://whatcanirunai.vercel.app/models/nvidia-nemotron-nano-9b-v2/)7.2 GB at Q4 | Fits | Fits | Fits | 200–283 | | [ZAYA1-base](https://whatcanirunai.vercel.app/models/zaya1-base/)7.2 GB at Q4 | Fits | Fits | Fits | 201–284 | | [Yi-Coder-9B-Chat](https://whatcanirunai.vercel.app/models/yi-coder-9b-chat/)7.2 GB at Q4 | Fits | Fits | Fits | 201–285 | | [Yi-Coder-9B](https://whatcanirunai.vercel.app/models/yi-coder-9b/)7.2 GB at Q4 | Fits | Fits | Fits | 201–285 | | [internlm3-8b-instruct](https://whatcanirunai.vercel.app/models/internlm3-8b-instruct/)7.1 GB at Q4 | Fits | Fits | Fits | 201–285 | | [granite-4.1-8b](https://whatcanirunai.vercel.app/models/granite-4.1-8b/)7.1 GB at Q4 | Fits | Fits | Fits | 202–286 | | [granite-4.2-8b](https://whatcanirunai.vercel.app/models/granite-4.2-8b/)7.1 GB at Q4 | Fits | Fits | Fits | 202–286 | | [granite-switch-4.1-8b](https://whatcanirunai.vercel.app/models/granite-switch-4.1-8b/)7.1 GB at Q4 | Fits | Fits | Fits | 202–286 | | [Qwen3-VL-8B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-vl-8b-instruct/)7.1 GB at Q4 | Fits | Fits | Fits | 202–287 | | [Qwen3-VL-8B-Thinking](https://whatcanirunai.vercel.app/models/qwen3-vl-8b-thinking/)7.1 GB at Q4 | Fits | Fits | Fits | 202–287 | | [UI-Venus-1.5-8B](https://whatcanirunai.vercel.app/models/ui-venus-1.5-8b/)7.1 GB at Q4 | Fits | Fits | Fits | 202–287 | | [Llama-3.1-Nemotron-Nano-VL-8B-V1](https://whatcanirunai.vercel.app/models/llama-3.1-nemotron-nano-vl-8b-v1/)7.1 GB at Q4 | Fits | Fits | Fits | 203–288 | | [MiniCPM-V-4\_5](https://whatcanirunai.vercel.app/models/minicpm-v-4-5/)7.1 GB at Q4 | Fits | Fits | Fits | 204–289 | | [aya-vision-8b](https://whatcanirunai.vercel.app/models/aya-vision-8b/)7.0 GB at Q4 | Fits | Fits | Fits | 205–291 | | [Intern-S1-mini](https://whatcanirunai.vercel.app/models/intern-s1-mini/)7.0 GB at Q4 | Fits | Fits | Fits | 208–294 | | [Nemotron-Labs-Diffusion-8B-Base](https://whatcanirunai.vercel.app/models/nemotron-labs-diffusion-8b-base/)6.9 GB at Q4 | Fits | Fits | Fits | 209–296 | | [LFM2.5-8B-A1B](https://whatcanirunai.vercel.app/models/lfm2.5-8b-a1b/)6.9 GB at Q4 · MoE | Fits | Fits | Fits | up to 2512 | | [Mistral-NeMo-Minitron-8B-Base](https://whatcanirunai.vercel.app/models/mistral-nemo-minitron-8b-base/)6.9 GB at Q4 | Fits | Fits | Fits | 211–299 | | [LFM2-8B-A1B](https://whatcanirunai.vercel.app/models/lfm2-8b-a1b/)6.8 GB at Q4 · MoE | Fits | Fits | Fits | up to 2513 | | [rnj-1-instruct](https://whatcanirunai.vercel.app/models/rnj-1-instruct/)6.8 GB at Q4 | Fits | Fits | Fits | 213–302 | | [MiMo-VL-7B-RL-2508](https://whatcanirunai.vercel.app/models/mimo-vl-7b-rl-2508/)6.8 GB at Q4 | Fits | Fits | Fits | 214–302 | | [MiMo-VL-7B-RL](https://whatcanirunai.vercel.app/models/mimo-vl-7b-rl/)6.8 GB at Q4 | Fits | Fits | Fits | 214–302 | | [MiMo-Embodied-7B](https://whatcanirunai.vercel.app/models/mimo-embodied-7b/)6.8 GB at Q4 | Fits | Fits | Fits | 214–302 | | [MiMo-VL-7B-SFT](https://whatcanirunai.vercel.app/models/mimo-vl-7b-sft/)6.8 GB at Q4 | Fits | Fits | Fits | 214–302 | | [Qwen2.5-VL-7B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-vl-7b-instruct/)6.8 GB at Q4 | Fits | Fits | Fits | 214–303 | | [UI-TARS-1.5-7B](https://whatcanirunai.vercel.app/models/ui-tars-1.5-7b/)6.8 GB at Q4 | Fits | Fits | Fits | 214–303 | | [Fara-7B](https://whatcanirunai.vercel.app/models/fara-7b/)6.8 GB at Q4 | Fits | Fits | Fits | 214–303 | | [UI-Venus-Ground-7B](https://whatcanirunai.vercel.app/models/ui-venus-ground-7b/)6.8 GB at Q4 | Fits | Fits | Fits | 214–303 | | [Qwen2-VL-7B-Instruct](https://whatcanirunai.vercel.app/models/qwen2-vl-7b-instruct/)6.8 GB at Q4 | Fits | Fits | Fits | 214–303 | | [UI-TARS-7B-DPO](https://whatcanirunai.vercel.app/models/ui-tars-7b-dpo/)6.8 GB at Q4 | Fits | Fits | Fits | 214–303 | | [UI-TARS-7B-SFT](https://whatcanirunai.vercel.app/models/ui-tars-7b-sft/)6.8 GB at Q4 | Fits | Fits | Fits | 214–303 | | [Seed-Coder-8B-Instruct](https://whatcanirunai.vercel.app/models/seed-coder-8b-instruct/)6.8 GB at Q4 | Fits | Fits | Fits | 215–305 | | [Seed-Coder-8B-Reasoning](https://whatcanirunai.vercel.app/models/seed-coder-8b-reasoning/)6.8 GB at Q4 | Fits | Fits | Fits | 215–305 | | [Stable-DiffCoder-8B-Instruct](https://whatcanirunai.vercel.app/models/stable-diffcoder-8b-instruct/)6.8 GB at Q4 | Fits | Fits | Fits | 215–305 | | [Qwen3-8B](https://whatcanirunai.vercel.app/models/qwen3-8b/)6.7 GB at Q4 | Fits | Fits | Fits | 217–307 | | [DeepSeek-R1-0528-Qwen3-8B](https://whatcanirunai.vercel.app/models/deepseek-r1-0528-qwen3-8b/)6.7 GB at Q4 | Fits | Fits | Fits | 217–307 | | [Qwen3-8B-Base](https://whatcanirunai.vercel.app/models/qwen3-8b-base/)6.7 GB at Q4 | Fits | Fits | Fits | 217–307 | | [WeDLM-8B-Instruct](https://whatcanirunai.vercel.app/models/wedlm-8b-instruct/)6.7 GB at Q4 | Fits | Fits | Fits | 217–307 | | [PaCoRe-8B](https://whatcanirunai.vercel.app/models/pacore-8b/)6.7 GB at Q4 | Fits | Fits | Fits | 217–307 | | [MiniCPM4-8B](https://whatcanirunai.vercel.app/models/minicpm4-8b/)6.7 GB at Q4 | Fits | Fits | Fits | 217–307 | | [MiniCPM4.1-8B](https://whatcanirunai.vercel.app/models/minicpm4.1-8b/)6.7 GB at Q4 | Fits | Fits | Fits | 217–307 | | [AgentCPM-Report](https://whatcanirunai.vercel.app/models/agentcpm-report/)6.7 GB at Q4 | Fits | Fits | Fits | 217–307 | | [MiniCPM4-MCP](https://whatcanirunai.vercel.app/models/minicpm4-mcp/)6.7 GB at Q4 | Fits | Fits | Fits | 217–307 | | [granite-3.3-8b-instruct](https://whatcanirunai.vercel.app/models/granite-3.3-8b-instruct/)6.7 GB at Q4 | Fits | Fits | Fits | 217–307 | | [granite-3.1-8b-instruct](https://whatcanirunai.vercel.app/models/granite-3.1-8b-instruct/)6.7 GB at Q4 | Fits | Fits | Fits | 217–307 | | [granite-3.2-8b-instruct](https://whatcanirunai.vercel.app/models/granite-3.2-8b-instruct/)6.7 GB at Q4 | Fits | Fits | Fits | 217–307 | | [granite-3.0-8b-instruct](https://whatcanirunai.vercel.app/models/granite-3.0-8b-instruct/)6.7 GB at Q4 | Fits | Fits | Fits | 217–307 | | [Apertus-8B-Instruct-2509](https://whatcanirunai.vercel.app/models/apertus-8b-instruct-2509/)6.6 GB at Q4 | Fits | Fits | Fits | 220–312 | | [Apertus-8B-2509](https://whatcanirunai.vercel.app/models/apertus-8b-2509/)6.6 GB at Q4 | Fits | Fits | Fits | 220–312 | | [Llama-3.1-Tulu-3-8B](https://whatcanirunai.vercel.app/models/llama-3.1-tulu-3-8b/)6.6 GB at Q4 | Fits | Fits | Fits | 221–313 | | [Llama-3.1-Tulu-3-8B-DPO](https://whatcanirunai.vercel.app/models/llama-3.1-tulu-3-8b-dpo/)6.6 GB at Q4 | Fits | Fits | Fits | 221–313 | | [Llama-3.1-Tulu-3.1-8B](https://whatcanirunai.vercel.app/models/llama-3.1-tulu-3.1-8b/)6.6 GB at Q4 | Fits | Fits | Fits | 221–313 | | [kanana-1.5-8b-instruct-2505](https://whatcanirunai.vercel.app/models/kanana-1.5-8b-instruct-2505/)6.6 GB at Q4 | Fits | Fits | Fits | 221–313 | | [Llama-3.1-8B-Instruct](https://whatcanirunai.vercel.app/models/llama-3.1-8b-instruct/)6.6 GB at Q4 | Fits | Fits | Fits | 221–313 | | [Llama-3.1-8B](https://whatcanirunai.vercel.app/models/llama-3.1-8b/)6.6 GB at Q4 | Fits | Fits | Fits | 221–313 | | [DeepSeek-R1-Distill-Llama-8B](https://whatcanirunai.vercel.app/models/deepseek-r1-distill-llama-8b/)6.6 GB at Q4 | Fits | Fits | Fits | 221–313 | | [Meta-Llama-3.1-8B-Instruct](https://whatcanirunai.vercel.app/models/meta-llama-3.1-8b-instruct/)6.6 GB at Q4 | Fits | Fits | Fits | 221–313 | | [L3-8B-Stheno-v3.2](https://whatcanirunai.vercel.app/models/l3-8b-stheno-v3.2/)6.6 GB at Q4 | Fits | Fits | Fits | 221–313 | | [Llama-3.1-Nemotron-Nano-8B-v1](https://whatcanirunai.vercel.app/models/llama-3.1-nemotron-nano-8b-v1/)6.6 GB at Q4 | Fits | Fits | Fits | 221–313 | | [Meta-Llama-3.1-8B](https://whatcanirunai.vercel.app/models/meta-llama-3.1-8b/)6.6 GB at Q4 | Fits | Fits | Fits | 221–313 | | [LongWriter-llama3.1-8b](https://whatcanirunai.vercel.app/models/longwriter-llama3.1-8b/)6.6 GB at Q4 | Fits | Fits | Fits | 221–313 | | [Hy-MT2-7B](https://whatcanirunai.vercel.app/models/hy-mt2-7b/)6.6 GB at Q4 | Fits | Fits | Fits | 221–313 | | [Nemotron 3.5 Bolt E4B](https://whatcanirunai.vercel.app/models/nemotron-3.5-bolt-e4b/)6.6 GB at Q4 | Fits | Fits | Fits | 222–314 | | [Gemma 4 E4B](https://whatcanirunai.vercel.app/models/gemma-4-e4b-it/)6.6 GB at Q4 | Fits | Fits | Fits | 222–314 | | [Ling-3.0-tiny](https://whatcanirunai.vercel.app/models/ling-3.0-tiny/)6.5 GB at Q4 · MoE | Fits | Fits | Fits | up to 1933 | | [MiMo-7B-RL](https://whatcanirunai.vercel.app/models/mimo-7b-rl/)6.5 GB at Q4 | Fits | Fits | Fits | 226–321 | | [MiMo-7B-Base](https://whatcanirunai.vercel.app/models/mimo-7b-base/)6.5 GB at Q4 | Fits | Fits | Fits | 226–321 | | [MiMo-7B-RL-0530](https://whatcanirunai.vercel.app/models/mimo-7b-rl-0530/)6.5 GB at Q4 | Fits | Fits | Fits | 226–321 | | [MiMo-7B-SFT](https://whatcanirunai.vercel.app/models/mimo-7b-sft/)6.5 GB at Q4 | Fits | Fits | Fits | 226–321 | | [EXAONE-3.5-7.8B-Instruct](https://whatcanirunai.vercel.app/models/exaone-3.5-7.8b-instruct/)6.5 GB at Q4 | Fits | Fits | Fits | 227–321 | | [EXAONE-Deep-7.8B](https://whatcanirunai.vercel.app/models/exaone-deep-7.8b/)6.5 GB at Q4 | Fits | Fits | Fits | 227–321 | | [salamandra-7b-instruct](https://whatcanirunai.vercel.app/models/salamandra-7b-instruct/)6.4 GB at Q4 | Fits | Fits | Fits | 228–323 | | [salamandra-7b](https://whatcanirunai.vercel.app/models/salamandra-7b/)6.4 GB at Q4 | Fits | Fits | Fits | 228–323 | | [salamandra-7b-instruct-2606](https://whatcanirunai.vercel.app/models/salamandra-7b-instruct-2606/)6.4 GB at Q4 | Fits | Fits | Fits | 228–323 | | [FastVLM-7B](https://whatcanirunai.vercel.app/models/fastvlm-7b/)6.4 GB at Q4 | Fits | Fits | Fits | 228–324 | | [Molmo2-O-7B](https://whatcanirunai.vercel.app/models/molmo2-o-7b/)6.4 GB at Q4 | Fits | Fits | Fits | 229–324 | | [internlm2\_5-7b-chat](https://whatcanirunai.vercel.app/models/internlm2-5-7b-chat/)6.4 GB at Q4 | Fits | Fits | Fits | 229–325 | | [internlm2\_5-7b-chat-1m](https://whatcanirunai.vercel.app/models/internlm2-5-7b-chat-1m/)6.4 GB at Q4 | Fits | Fits | Fits | 229–325 | | [Phi-mini-MoE-instruct](https://whatcanirunai.vercel.app/models/phi-mini-moe-instruct/)6.3 GB at Q4 · MoE | Fits | Fits | Fits | up to 1047 | | [Qwen2.5-Coder-7B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-coder-7b-instruct/)6.3 GB at Q4 | Fits | Fits | Fits | 233–330 | | [DeepSeek-R1-Distill-Qwen-7B](https://whatcanirunai.vercel.app/models/deepseek-r1-distill-qwen-7b/)6.3 GB at Q4 | Fits | Fits | Fits | 233–330 | | [Qwen2.5-7B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-7b-instruct/)6.3 GB at Q4 | Fits | Fits | Fits | 233–330 | | [Qwen2.5-7B](https://whatcanirunai.vercel.app/models/qwen2.5-7b/)6.3 GB at Q4 | Fits | Fits | Fits | 233–330 | | [Qwen2-7B-Instruct](https://whatcanirunai.vercel.app/models/qwen2-7b-instruct/)6.3 GB at Q4 | Fits | Fits | Fits | 233–330 | | [Qwen2.5-Coder-7B](https://whatcanirunai.vercel.app/models/qwen2.5-coder-7b/)6.3 GB at Q4 | Fits | Fits | Fits | 233–330 | | [Qwen2-7B](https://whatcanirunai.vercel.app/models/qwen2-7b/)6.3 GB at Q4 | Fits | Fits | Fits | 233–330 | | [Qwen2.5-7B-Instruct-1M](https://whatcanirunai.vercel.app/models/qwen2.5-7b-instruct-1m/)6.3 GB at Q4 | Fits | Fits | Fits | 233–330 | | [Qwen2.5-Math-7B](https://whatcanirunai.vercel.app/models/qwen2.5-math-7b/)6.3 GB at Q4 | Fits | Fits | Fits | 233–330 | | [Qwen2.5-Math-7B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-math-7b-instruct/)6.3 GB at Q4 | Fits | Fits | Fits | 233–330 | | [Marco-o1](https://whatcanirunai.vercel.app/models/marco-o1/)6.3 GB at Q4 | Fits | Fits | Fits | 233–330 | | [SeaLLMs-v3-7B-Chat](https://whatcanirunai.vercel.app/models/seallms-v3-7b-chat/)6.3 GB at Q4 | Fits | Fits | Fits | 233–330 | | [Arcee-Spark](https://whatcanirunai.vercel.app/models/arcee-spark/)6.3 GB at Q4 | Fits | Fits | Fits | 233–330 | | [Falcon-H1-7B-Instruct](https://whatcanirunai.vercel.app/models/falcon-h1-7b-instruct/)6.3 GB at Q4 | Fits | Fits | Fits | 234–331 | | [Falcon-H1R-7B](https://whatcanirunai.vercel.app/models/falcon-h1r-7b/)6.3 GB at Q4 | Fits | Fits | Fits | 234–331 | | [starvector-8b-im2svg](https://whatcanirunai.vercel.app/models/starvector-8b-im2svg/)6.2 GB at Q4 | Fits | Fits | Fits | 236–335 | | [Falcon3-7B-Instruct](https://whatcanirunai.vercel.app/models/falcon3-7b-instruct/)6.2 GB at Q4 | Fits | Fits | Fits | 238–337 | | [Olmo-Hybrid-7B](https://whatcanirunai.vercel.app/models/olmo-hybrid-7b/)6.2 GB at Q4 | Fits | Fits | Fits | 239–338 | | [LLaDA-MoE-7B-A1B-Base](https://whatcanirunai.vercel.app/models/llada-moe-7b-a1b-base/)6.1 GB at Q4 · MoE | Fits | Fits | Fits | up to 2513 | | [Zamba2-7B-Instruct](https://whatcanirunai.vercel.app/models/zamba2-7b-instruct/)6.1 GB at Q4 | Fits | Fits | Fits | 241–342 | | [OLMo-2-1124-7B-Instruct](https://whatcanirunai.vercel.app/models/olmo-2-1124-7b-instruct/)6.1 GB at Q4 | Fits | Fits | Fits | 243–344 | | [Olmo-3-7B-Think](https://whatcanirunai.vercel.app/models/olmo-3-7b-think/)6.1 GB at Q4 | Fits | Fits | Fits | 243–344 | | [Olmo-3-7B-Instruct](https://whatcanirunai.vercel.app/models/olmo-3-7b-instruct/)6.1 GB at Q4 | Fits | Fits | Fits | 243–344 | | [Olmo-3-1025-7B](https://whatcanirunai.vercel.app/models/olmo-3-1025-7b/)6.1 GB at Q4 | Fits | Fits | Fits | 243–344 | | [Olmo-3-7B-Instruct-SFT](https://whatcanirunai.vercel.app/models/olmo-3-7b-instruct-sft/)6.1 GB at Q4 | Fits | Fits | Fits | 243–344 | | [Olmo-3-7B-Think-SFT](https://whatcanirunai.vercel.app/models/olmo-3-7b-think-sft/)6.1 GB at Q4 | Fits | Fits | Fits | 243–344 | | [Olmo-3-7B-Instruct-DPO](https://whatcanirunai.vercel.app/models/olmo-3-7b-instruct-dpo/)6.1 GB at Q4 | Fits | Fits | Fits | 243–344 | | [Olmo-3-7B-RL-Zero-Math](https://whatcanirunai.vercel.app/models/olmo-3-7b-rl-zero-math/)6.1 GB at Q4 | Fits | Fits | Fits | 243–344 | | [Olmo-3.1-7B-RL-Zero-Math](https://whatcanirunai.vercel.app/models/olmo-3.1-7b-rl-zero-math/)6.1 GB at Q4 | Fits | Fits | Fits | 243–344 | | [Olmo-3-7B-Think-DPO](https://whatcanirunai.vercel.app/models/olmo-3-7b-think-dpo/)6.1 GB at Q4 | Fits | Fits | Fits | 243–344 | | [Mistral-7B-Instruct-v0.3](https://whatcanirunai.vercel.app/models/mistral-7b-instruct-v0.3/)6.1 GB at Q4 | Fits | Fits | Fits | 245–347 | | [granite-4.0-h-tiny](https://whatcanirunai.vercel.app/models/granite-4.0-h-tiny/)5.8 GB at Q4 · MoE | Fits | Fits | Fits | up to 2513 | | [OLMoE-1B-7B-0924-Instruct](https://whatcanirunai.vercel.app/models/olmoe-1b-7b-0924-instruct/)5.8 GB at Q4 · MoE | Fits | Fits | Fits | up to 1933 | | [OLMoE-1B-7B-0924](https://whatcanirunai.vercel.app/models/olmoe-1b-7b-0924/)5.8 GB at Q4 · MoE | Fits | Fits | Fits | up to 1933 | | [OLMoE-1B-7B-0125-Instruct](https://whatcanirunai.vercel.app/models/olmoe-1b-7b-0125-instruct/)5.8 GB at Q4 · MoE | Fits | Fits | Fits | up to 1933 | | [OLMoE-1B-7B-0125](https://whatcanirunai.vercel.app/models/olmoe-1b-7b-0125/)5.8 GB at Q4 · MoE | Fits | Fits | Fits | up to 1933 | | [OLMo-7B-0724-hf](https://whatcanirunai.vercel.app/models/olmo-7b-0724-hf/)5.8 GB at Q4 | Fits | Fits | Fits | 257–365 | | [granite-4.0-tiny-preview](https://whatcanirunai.vercel.app/models/granite-4.0-tiny-preview/)5.7 GB at Q4 · MoE | Fits | Fits | Fits | up to 2512 | | [YuE-s1-7B-anneal-en-cot](https://whatcanirunai.vercel.app/models/yue-s1-7b-anneal-en-cot/)5.3 GB at Q4 | Fits | Fits | Fits | 285–404 | | [Trinity-Nano-Preview](https://whatcanirunai.vercel.app/models/trinity-nano-preview/)5.3 GB at Q4 · MoE | Fits | Fits | Fits | up to 2512 | | [Trinity-Nano-Base](https://whatcanirunai.vercel.app/models/trinity-nano-base/)5.3 GB at Q4 · MoE | Fits | Fits | Fits | up to 2512 | | [gemma-3n-E2B-it](https://whatcanirunai.vercel.app/models/gemma-3n-e2b-it/)4.8 GB at Q4 | Fits | Fits | Fits | 326–462 | | [Youtu-VL-4B-Instruct](https://whatcanirunai.vercel.app/models/youtu-vl-4b-instruct/)4.7 GB at Q4 | Fits | Fits | Fits | 332–470 | | [Gemma 4 E2B](https://whatcanirunai.vercel.app/models/gemma-4-e2b-it/)4.6 GB at Q4 | Fits | Fits | Fits | 346–490 | | [Molmo2-ER](https://whatcanirunai.vercel.app/models/molmo2-er/)4.4 GB at Q4 | Fits | Fits | Fits | 366–518 | | [Apriel-5B-Instruct](https://whatcanirunai.vercel.app/models/apriel-5b-instruct/)4.4 GB at Q4 | Fits | Fits | Fits | 367–520 | | [WeVisOne-VL-4B](https://whatcanirunai.vercel.app/models/wevisone-vl-4b/)4.4 GB at Q4 | Fits | Fits | Fits | 367–520 | | [Mage-VL](https://whatcanirunai.vercel.app/models/mage-vl/)4.3 GB at Q4 | Fits | Fits | Fits | 374–530 | | [Mage-VL-Cowork](https://whatcanirunai.vercel.app/models/mage-vl-cowork/)4.3 GB at Q4 | Fits | Fits | Fits | 374–530 | | [Qwen3.5-4B](https://whatcanirunai.vercel.app/models/qwen3.5-4b/)4.2 GB at Q4 | Fits | Fits | Fits | 381–539 | | [S5-nano](https://whatcanirunai.vercel.app/models/s5-nano/)4.2 GB at Q4 | Fits | Fits | Fits | 381–539 | | [AFM-4.5B](https://whatcanirunai.vercel.app/models/afm-4.5b/)4.2 GB at Q4 | Fits | Fits | Fits | 384–544 | | [Llama-3.1-Minitron-4B-Width-Base](https://whatcanirunai.vercel.app/models/llama-3.1-minitron-4b-width-base/)4.1 GB at Q4 | Fits | Fits | Fits | 393–557 | | [Qwen3-VL-4B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-vl-4b-instruct/)4.1 GB at Q4 | Fits | Fits | Fits | 400–566 | | [CapRL-Qwen3VL-4B](https://whatcanirunai.vercel.app/models/caprl-qwen3vl-4b/)4.1 GB at Q4 | Fits | Fits | Fits | 400–566 | | [glm-edge-4b-chat](https://whatcanirunai.vercel.app/models/glm-edge-4b-chat/)4.0 GB at Q4 | Fits | Fits | Fits | 410–581 | | [gemma-3-4b-it](https://whatcanirunai.vercel.app/models/gemma-3-4b-it/)4.0 GB at Q4 | Fits | Fits | Fits | 412–584 | | [medgemma-4b-it](https://whatcanirunai.vercel.app/models/medgemma-4b-it/)4.0 GB at Q4 | Fits | Fits | Fits | 412–584 | | [medgemma-1.5-4b-it](https://whatcanirunai.vercel.app/models/medgemma-1.5-4b-it/)4.0 GB at Q4 | Fits | Fits | Fits | 412–584 | | [gemma-3-4b-pt](https://whatcanirunai.vercel.app/models/gemma-3-4b-pt/)4.0 GB at Q4 | Fits | Fits | Fits | 412–584 | | [Nanbeige4.2-3B](https://whatcanirunai.vercel.app/models/nanbeige4.2-3b/)3.9 GB at Q4 | Fits | Fits | Fits | 425–603 | | [Phi-3.5-vision-instruct](https://whatcanirunai.vercel.app/models/phi-3.5-vision-instruct/)3.9 GB at Q4 | Fits | Fits | Fits | 428–606 | | [Spark-X2.6-4B](https://whatcanirunai.vercel.app/models/spark-x2.6-4b/)3.9 GB at Q4 | Fits | Fits | Fits | 431–611 | | [Spark-X2.5-4B](https://whatcanirunai.vercel.app/models/spark-x2.5-4b/)3.9 GB at Q4 | Fits | Fits | Fits | 431–611 | | [POINTS-Reader](https://whatcanirunai.vercel.app/models/points-reader/)3.9 GB at Q4 | Fits | Fits | Fits | 432–611 | | [MiniCPM-V-4](https://whatcanirunai.vercel.app/models/minicpm-v-4/)3.8 GB at Q4 | Fits | Fits | Fits | 437–619 | | [Qwen3-4B](https://whatcanirunai.vercel.app/models/qwen3-4b/)3.8 GB at Q4 | Fits | Fits | Fits | 441–625 | | [Qwen3-4B-Instruct-2507](https://whatcanirunai.vercel.app/models/qwen3-4b-instruct-2507/)3.8 GB at Q4 | Fits | Fits | Fits | 441–625 | | [Qwen3-4B-Thinking-2507](https://whatcanirunai.vercel.app/models/qwen3-4b-thinking-2507/)3.8 GB at Q4 | Fits | Fits | Fits | 441–625 | | [Mellum-4b-base](https://whatcanirunai.vercel.app/models/mellum-4b-base/)3.8 GB at Q4 | Fits | Fits | Fits | 441–625 | | [granite-4.0-3b-vision](https://whatcanirunai.vercel.app/models/granite-4.0-3b-vision/)3.8 GB at Q4 | Fits | Fits | Fits | 444–629 | | [granite-vision-4.1-4b](https://whatcanirunai.vercel.app/models/granite-vision-4.1-4b/)3.8 GB at Q4 | Fits | Fits | Fits | 444–629 | | [Nemotron Labs Dory 1.0 4B](https://whatcanirunai.vercel.app/models/nemotron-labs-dory1.0-4b/)3.8 GB at Q4 | Fits | Fits | Fits | 446–632 | | [NVIDIA-Nemotron-3-Nano-4B-BF16](https://whatcanirunai.vercel.app/models/nvidia-nemotron-3-nano-4b-bf16/)3.8 GB at Q4 | Fits | Fits | Fits | 446–632 | | [Nanbeige4.1-3B](https://whatcanirunai.vercel.app/models/nanbeige4.1-3b/)3.7 GB at Q4 | Fits | Fits | Fits | 451–639 | | [Nanbeige4-3B-Thinking-2511](https://whatcanirunai.vercel.app/models/nanbeige4-3b-thinking-2511/)3.7 GB at Q4 | Fits | Fits | Fits | 451–639 | | [Phi-4-mini-flash-reasoning](https://whatcanirunai.vercel.app/models/phi-4-mini-flash-reasoning/)3.7 GB at Q4 | Fits | Fits | Fits | 460–652 | | [Phi-4-mini-instruct](https://whatcanirunai.vercel.app/models/phi-4-mini-instruct/)3.7 GB at Q4 | Fits | Fits | Fits | 462–655 | | [Phi-4-mini-reasoning](https://whatcanirunai.vercel.app/models/phi-4-mini-reasoning/)3.7 GB at Q4 | Fits | Fits | Fits | 462–655 | | [Nemotron-Labs-Diffusion-3B](https://whatcanirunai.vercel.app/models/nemotron-labs-diffusion-3b/)3.7 GB at Q4 | Fits | Fits | Fits | 463–656 | | [Phi-3.5-mini-instruct](https://whatcanirunai.vercel.app/models/phi-3.5-mini-instruct/)3.7 GB at Q4 | Fits | Fits | Fits | 464–658 | | [MediPhi-Instruct](https://whatcanirunai.vercel.app/models/mediphi-instruct/)3.7 GB at Q4 | Fits | Fits | Fits | 464–658 | | [MediPhi](https://whatcanirunai.vercel.app/models/mediphi/)3.7 GB at Q4 | Fits | Fits | Fits | 464–658 | | [MediPhi-Clinical](https://whatcanirunai.vercel.app/models/mediphi-clinical/)3.7 GB at Q4 | Fits | Fits | Fits | 464–658 | | [MediPhi-PubMed](https://whatcanirunai.vercel.app/models/mediphi-pubmed/)3.7 GB at Q4 | Fits | Fits | Fits | 464–658 | | [HY-Embodied-0.5](https://whatcanirunai.vercel.app/models/hy-embodied-0.5/)3.6 GB at Q4 | Fits | Fits | Fits | 469–664 | | [Phi-tiny-MoE-instruct](https://whatcanirunai.vercel.app/models/phi-tiny-moe-instruct/)3.6 GB at Q4 · MoE | Fits | Fits | Fits | up to 2284 | | [CapRL-3B](https://whatcanirunai.vercel.app/models/caprl-3b/)3.6 GB at Q4 | Fits | Fits | Fits | 472–669 | | [HyperCLOVAX-SEED-Vision-Instruct-3B](https://whatcanirunai.vercel.app/models/hyperclovax-seed-vision-instruct-3b/)3.6 GB at Q4 | Fits | Fits | Fits | 477–675 | | [kanana-1.5-v-3b-instruct](https://whatcanirunai.vercel.app/models/kanana-1.5-v-3b-instruct/)3.6 GB at Q4 | Fits | Fits | Fits | 484–685 | | [granite-4.2-3b](https://whatcanirunai.vercel.app/models/granite-4.2-3b/)3.6 GB at Q4 | Fits | Fits | Fits | 485–687 | | [kanana-2-3b-instruct](https://whatcanirunai.vercel.app/models/kanana-2-3b-instruct/)3.4 GB at Q4 | Fits | Fits | Fits | 505–716 | | [granite-4.1-3b](https://whatcanirunai.vercel.app/models/granite-4.1-3b/)3.4 GB at Q4 | Fits | Fits | Fits | 521–738 | | [granite-4.0-micro](https://whatcanirunai.vercel.app/models/granite-4.0-micro/)3.4 GB at Q4 | Fits | Fits | Fits | 521–738 | | [granite-3.1-3b-a800m-instruct](https://whatcanirunai.vercel.app/models/granite-3.1-3b-a800m-instruct/)3.3 GB at Q4 · MoE | Fits | Fits | Fits | up to 3141 | | [Falcon3-3B-Instruct](https://whatcanirunai.vercel.app/models/falcon3-3b-instruct/)3.3 GB at Q4 | Fits | Fits | Fits | 549–778 | | [Llama-3.2-3B-Instruct](https://whatcanirunai.vercel.app/models/llama-3.2-3b-instruct/)3.2 GB at Q4 | Fits | Fits | Fits | 552–782 | | [Llama-3.2-3B](https://whatcanirunai.vercel.app/models/llama-3.2-3b/)3.2 GB at Q4 | Fits | Fits | Fits | 552–782 | | [Hermes-3-Llama-3.2-3B](https://whatcanirunai.vercel.app/models/hermes-3-llama-3.2-3b/)3.2 GB at Q4 | Fits | Fits | Fits | 552–782 | | [DeepHermes-3-Llama-3-3B-Preview](https://whatcanirunai.vercel.app/models/deephermes-3-llama-3-3b-preview/)3.2 GB at Q4 | Fits | Fits | Fits | 552–782 | | [AI21-Jamba-Reasoning-3B](https://whatcanirunai.vercel.app/models/ai21-jamba-reasoning-3b/)3.2 GB at Q4 | Fits | Fits | Fits | 555–786 | | [granite-4.0-h-micro](https://whatcanirunai.vercel.app/models/granite-4.0-h-micro/)3.2 GB at Q4 | Fits | Fits | Fits | 556–787 | | [Falcon-H1-3B-Instruct](https://whatcanirunai.vercel.app/models/falcon-h1-3b-instruct/)3.2 GB at Q4 | Fits | Fits | Fits | 563–798 | | [d1-3B](https://whatcanirunai.vercel.app/models/d1-3b/)3.2 GB at Q4 | Fits | Fits | Fits | 568–804 | | [LFM2.5-VL-3B](https://whatcanirunai.vercel.app/models/lfm2.5-vl-3b/)3.2 GB at Q4 | Fits | Fits | Fits | 568–804 | | [Qwen2.5-3B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-3b-instruct/)3.2 GB at Q4 | Fits | Fits | Fits | 575–814 | | [Qwen2.5-Coder-3B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-coder-3b-instruct/)3.2 GB at Q4 | Fits | Fits | Fits | 575–814 | | [Qwen2.5-3B](https://whatcanirunai.vercel.app/models/qwen2.5-3b/)3.2 GB at Q4 | Fits | Fits | Fits | 575–814 | | [Qwen2.5-Coder-3B](https://whatcanirunai.vercel.app/models/qwen2.5-coder-3b/)3.2 GB at Q4 | Fits | Fits | Fits | 575–814 | | [SmolLM3-3B](https://whatcanirunai.vercel.app/models/smollm3-3b/)3.1 GB at Q4 | Fits | Fits | Fits | 577–817 | | [AI21-Jamba2-3B](https://whatcanirunai.vercel.app/models/ai21-jamba2-3b/)3.1 GB at Q4 | Fits | Fits | Fits | 585–829 | | [granite-swash-3b-a600m](https://whatcanirunai.vercel.app/models/granite-swash-3b-a600m/)3.1 GB at Q4 · MoE | Fits | Fits | Fits | up to 4201 | | [granite-vision-3.2-2b](https://whatcanirunai.vercel.app/models/granite-vision-3.2-2b/)3.1 GB at Q4 | Fits | Fits | Fits | 596–844 | | [granite-vision-3.1-2b-preview](https://whatcanirunai.vercel.app/models/granite-vision-3.1-2b-preview/)3.1 GB at Q4 | Fits | Fits | Fits | 596–844 | | [granite-vision-3.3-2b-chart2csv-preview](https://whatcanirunai.vercel.app/models/granite-vision-3.3-2b-chart2csv-preview/)3.1 GB at Q4 | Fits | Fits | Fits | 596–844 | | [LFM2.5-2.6B](https://whatcanirunai.vercel.app/models/lfm2.5-2.6b/)2.9 GB at Q4 | Fits | Fits | Fits | 658–932 | | [Zamba2-2.7B](https://whatcanirunai.vercel.app/models/zamba2-2.7b/)2.9 GB at Q4 | Fits | Fits | Fits | 666–944 | | [Zamba2-2.7B-instruct](https://whatcanirunai.vercel.app/models/zamba2-2.7b-instruct/)2.9 GB at Q4 | Fits | Fits | Fits | 666–944 | | [granite-3.0-2b-instruct](https://whatcanirunai.vercel.app/models/granite-3.0-2b-instruct/)2.8 GB at Q4 | Fits | Fits | Fits | 673–954 | | [gemma-2-2b-it](https://whatcanirunai.vercel.app/models/gemma-2-2b-it/)2.8 GB at Q4 | Fits | Fits | Fits | 678–961 | | [gemma-2-2b](https://whatcanirunai.vercel.app/models/gemma-2-2b/)2.8 GB at Q4 | Fits | Fits | Fits | 678–961 | | [EuroMoE-2.6B-A0.6B-Instruct-Preview](https://whatcanirunai.vercel.app/models/euromoe-2.6b-a0.6b-instruct-preview/)2.8 GB at Q4 · MoE | Fits | Fits | Fits | up to 4187 | | [Motif-2.6B](https://whatcanirunai.vercel.app/models/motif-2.6b/)2.8 GB at Q4 | Fits | Fits | Fits | 683–967 | | [LFM2-2.6B](https://whatcanirunai.vercel.app/models/lfm2-2.6b/)2.8 GB at Q4 | Fits | Fits | Fits | 690–978 | | [LFM2-2.6B-Exp](https://whatcanirunai.vercel.app/models/lfm2-2.6b-exp/)2.8 GB at Q4 | Fits | Fits | Fits | 690–978 | | [LFM2-2.6B-Transcript](https://whatcanirunai.vercel.app/models/lfm2-2.6b-transcript/)2.8 GB at Q4 | Fits | Fits | Fits | 690–978 | | [granite-3.3-2b-instruct](https://whatcanirunai.vercel.app/models/granite-3.3-2b-instruct/)2.8 GB at Q4 | Fits | Fits | Fits | 700–992 | | [granite-3.1-2b-instruct](https://whatcanirunai.vercel.app/models/granite-3.1-2b-instruct/)2.8 GB at Q4 | Fits | Fits | Fits | 700–992 | | [granite-3.2-2b-instruct](https://whatcanirunai.vercel.app/models/granite-3.2-2b-instruct/)2.8 GB at Q4 | Fits | Fits | Fits | 700–992 | | [MiniCPM5-2B](https://whatcanirunai.vercel.app/models/minicpm5-2b/)2.8 GB at Q4 | Fits | Fits | Fits | 705–998 | | [MiniCPM5-2B-SFT](https://whatcanirunai.vercel.app/models/minicpm5-2b-sft/)2.8 GB at Q4 | Fits | Fits | Fits | 705–998 | | [MiniCPM5-2B-Midtrain](https://whatcanirunai.vercel.app/models/minicpm5-2b-midtrain/)2.8 GB at Q4 | Fits | Fits | Fits | 705–998 | | [sarvam-1-v0.5](https://whatcanirunai.vercel.app/models/sarvam-1-v0.5/)2.7 GB at Q4 | Fits | Fits | Fits | 707–1001 | | [North-Micro-Vision-Instruct](https://whatcanirunai.vercel.app/models/north-micro-vision-instruct/)2.7 GB at Q4 | Fits | Fits | Fits | 714–1011 | | [UI-TARS-2B-SFT](https://whatcanirunai.vercel.app/models/ui-tars-2b-sft/)2.7 GB at Q4 | Fits | Fits | Fits | 726–1029 | | [WeVisOne-VL-2B](https://whatcanirunai.vercel.app/models/wevisone-vl-2b/)2.7 GB at Q4 | Fits | Fits | Fits | 726–1029 | | [UI-Venus-1.5-2B](https://whatcanirunai.vercel.app/models/ui-venus-1.5-2b/)2.7 GB at Q4 | Fits | Fits | Fits | 727–1030 | | [bitnet-b1.58-2B-4T-bf16](https://whatcanirunai.vercel.app/models/bitnet-b1.58-2b-4t-bf16/)2.7 GB at Q4 | Fits | Fits | Fits | 735–1041 | | [EXAONE-3.5-2.4B-Instruct](https://whatcanirunai.vercel.app/models/exaone-3.5-2.4b-instruct/)2.7 GB at Q4 | Fits | Fits | Fits | 737–1045 | | [EXAONE-Deep-2.4B](https://whatcanirunai.vercel.app/models/exaone-deep-2.4b/)2.7 GB at Q4 | Fits | Fits | Fits | 737–1045 | | [kanana-1.5-2.1b-instruct-2505](https://whatcanirunai.vercel.app/models/kanana-1.5-2.1b-instruct-2505/)2.6 GB at Q4 | Fits | Fits | Fits | 765–1084 | | [Qwen3.5-2B](https://whatcanirunai.vercel.app/models/qwen3.5-2b/)2.6 GB at Q4 | Fits | Fits | Fits | 780–1105 | | [salamandra-2b](https://whatcanirunai.vercel.app/models/salamandra-2b/)2.6 GB at Q4 | Fits | Fits | Fits | 787–1115 | | [salamandra-2b-instruct](https://whatcanirunai.vercel.app/models/salamandra-2b-instruct/)2.6 GB at Q4 | Fits | Fits | Fits | 787–1115 | | [SmolVLM2-2.2B-Instruct](https://whatcanirunai.vercel.app/models/smolvlm2-2.2b-instruct/)2.6 GB at Q4 | Fits | Fits | Fits | 789–1118 | | [SmolVLM-Base](https://whatcanirunai.vercel.app/models/smolvlm-base/)2.6 GB at Q4 | Fits | Fits | Fits | 790–1119 | | [Qwen2-VL-2B-Instruct](https://whatcanirunai.vercel.app/models/qwen2-vl-2b-instruct/)2.5 GB at Q4 | Fits | Fits | Fits | 803–1137 | | [LFM3-Omni-2B](https://whatcanirunai.vercel.app/models/lfm3-omni-2b/)2.5 GB at Q4 | Fits | Fits | Fits | 818–1159 | | [granite-swash-2b](https://whatcanirunai.vercel.app/models/granite-swash-2b/)2.5 GB at Q4 | Fits | Fits | Fits | 827–1172 | | [Qwen3-VL-2B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-vl-2b-instruct/)2.5 GB at Q4 | Fits | Fits | Fits | 834–1181 | | [kanana-nano-2.1b-instruct](https://whatcanirunai.vercel.app/models/kanana-nano-2.1b-instruct/)2.5 GB at Q4 | Fits | Fits | Fits | 850–1204 | | [Hy-MT2-1.8B](https://whatcanirunai.vercel.app/models/hy-mt2-1.8b/)2.4 GB at Q4 | Fits | Fits | Fits | 870–1233 | | [Qwen3-1.7B](https://whatcanirunai.vercel.app/models/qwen3-1.7b/)2.4 GB at Q4 | Fits | Fits | Fits | 873–1237 | | [Youtu-LLM-2B](https://whatcanirunai.vercel.app/models/youtu-llm-2b/)2.4 GB at Q4 | Fits | Fits | Fits | 904–1281 | | [LFM3-VL-2B](https://whatcanirunai.vercel.app/models/lfm3-vl-2b/)2.3 GB at Q4 | Fits | Fits | Fits | 925–1310 | | [d1-2B](https://whatcanirunai.vercel.app/models/d1-2b/)2.3 GB at Q4 | Fits | Fits | Fits | 925–1310 | | [FastVLM-1.5B](https://whatcanirunai.vercel.app/models/fastvlm-1.5b/)2.3 GB at Q4 | Fits | Fits | Fits | 929–1316 | | [internlm2\_5-1\_8b-chat](https://whatcanirunai.vercel.app/models/internlm2-5-1-8b-chat/)2.3 GB at Q4 | Fits | Fits | Fits | 939–1330 | | [DeepSeek-R1-Distill-Qwen-1.5B](https://whatcanirunai.vercel.app/models/deepseek-r1-distill-qwen-1.5b/)2.2 GB at Q4 | Fits | Fits | Fits | 998–1414 | | [LFM3-1.7B](https://whatcanirunai.vercel.app/models/lfm3-1.7b/)2.2 GB at Q4 | Fits | Fits | Fits | 1026–1453 | | [Qwen3-1.7B-Base](https://whatcanirunai.vercel.app/models/qwen3-1.7b-base/)2.2 GB at Q4 | Fits | Fits | Fits | 1031–1460 | | [SmolLM2-1.7B](https://whatcanirunai.vercel.app/models/smollm2-1.7b/)2.2 GB at Q4 | Fits | Fits | Fits | 1036–1468 | | [SmolLM-1.7B](https://whatcanirunai.vercel.app/models/smollm-1.7b/)2.2 GB at Q4 | Fits | Fits | Fits | 1036–1468 | | [Spark-X2.6-1.7B](https://whatcanirunai.vercel.app/models/spark-x2.6-1.7b/)2.2 GB at Q4 | Fits | Fits | Fits | 1039–1471 | | [Falcon3-1B-Instruct](https://whatcanirunai.vercel.app/models/falcon3-1b-instruct/)2.2 GB at Q4 | Fits | Fits | Fits | 1062–1505 | | [EuroLLM-1.7B-Instruct](https://whatcanirunai.vercel.app/models/eurollm-1.7b-instruct/)2.2 GB at Q4 | Fits | Fits | Fits | 1070–1516 | | [granite-4.0-1b](https://whatcanirunai.vercel.app/models/granite-4.0-1b/)2.1 GB at Q4 | Fits | Fits | Fits | 1087–1540 | | [LFM2.5-VL-1.6B](https://whatcanirunai.vercel.app/models/lfm2.5-vl-1.6b/)2.1 GB at Q4 | Fits | Fits | Fits | 1111–1574 | | [glm-edge-1.5b-chat](https://whatcanirunai.vercel.app/models/glm-edge-1.5b-chat/)2.1 GB at Q4 | Fits | Fits | Fits | 1113–1577 | | [LFM2-VL-1.6B](https://whatcanirunai.vercel.app/models/lfm2-vl-1.6b/)2.1 GB at Q4 | Fits | Fits | Fits | 1119–1585 | | [Falcon-H1-1.5B-Deep-Instruct](https://whatcanirunai.vercel.app/models/falcon-h1-1.5b-deep-instruct/)2.1 GB at Q4 | Fits | Fits | Fits | 1141–1616 | | [Falcon-H1-1.5B-Instruct](https://whatcanirunai.vercel.app/models/falcon-h1-1.5b-instruct/)2.1 GB at Q4 | Fits | Fits | Fits | 1141–1616 | | [MiniCPM-V-4.7-1B](https://whatcanirunai.vercel.app/models/minicpm-v-4.7-1b/)2.1 GB at Q4 | Fits | Fits | Fits | 1141–1616 | | [Qwen2.5-1.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-1.5b-instruct/)2.1 GB at Q4 | Fits | Fits | Fits | 1149–1628 | | [Qwen2.5-1.5B](https://whatcanirunai.vercel.app/models/qwen2.5-1.5b/)2.1 GB at Q4 | Fits | Fits | Fits | 1149–1628 | | [Qwen2.5-Coder-1.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-coder-1.5b-instruct/)2.1 GB at Q4 | Fits | Fits | Fits | 1149–1628 | | [Qwen2.5-Coder-1.5B](https://whatcanirunai.vercel.app/models/qwen2.5-coder-1.5b/)2.1 GB at Q4 | Fits | Fits | Fits | 1149–1628 | | [Qwen2.5-Math-1.5B](https://whatcanirunai.vercel.app/models/qwen2.5-math-1.5b/)2.1 GB at Q4 | Fits | Fits | Fits | 1149–1628 | | [Qwen2-1.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2-1.5b-instruct/)2.1 GB at Q4 | Fits | Fits | Fits | 1149–1628 | | [Qwen2.5-Math-1.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-math-1.5b-instruct/)2.1 GB at Q4 | Fits | Fits | Fits | 1149–1628 | | [ReaderLM-v2](https://whatcanirunai.vercel.app/models/readerlm-v2/)2.1 GB at Q4 | Fits | Fits | Fits | 1149–1628 | | [reader-lm-1.5b](https://whatcanirunai.vercel.app/models/reader-lm-1.5b/)2.1 GB at Q4 | Fits | Fits | Fits | 1149–1628 | | [Hymba-1.5B-Instruct](https://whatcanirunai.vercel.app/models/hymba-1.5b-instruct/)2.1 GB at Q4 | Fits | Fits | Fits | 1165–1650 | | [OLMo-2-0425-1B](https://whatcanirunai.vercel.app/models/olmo-2-0425-1b/)2.0 GB at Q4 | Fits | Fits | Fits | 1194–1692 | | [OLMo-2-0425-1B-Instruct](https://whatcanirunai.vercel.app/models/olmo-2-0425-1b-instruct/)2.0 GB at Q4 | Fits | Fits | Fits | 1194–1692 | | [Yi-Coder-1.5B-Chat](https://whatcanirunai.vercel.app/models/yi-coder-1.5b-chat/)2.0 GB at Q4 | Fits | Fits | Fits | 1201–1702 | | [Bolmo-1B](https://whatcanirunai.vercel.app/models/bolmo-1b/)2.0 GB at Q4 | Fits | Fits | Fits | 1207–1710 | | [granite-4.0-h-1b](https://whatcanirunai.vercel.app/models/granite-4.0-h-1b/)2.0 GB at Q4 | Fits | Fits | Fits | 1213–1719 | | [granite-3.1-1b-a400m-instruct](https://whatcanirunai.vercel.app/models/granite-3.1-1b-a400m-instruct/)1.9 GB at Q4 · MoE | Fits | Fits | Fits | up to 6281 | | [granite-3.0-1b-a400m-instruct](https://whatcanirunai.vercel.app/models/granite-3.0-1b-a400m-instruct/)1.9 GB at Q4 · MoE | Fits | Fits | Fits | up to 6281 | | [MiniCPM-V-4.6](https://whatcanirunai.vercel.app/models/minicpm-v-4.6/)1.9 GB at Q4 | Fits | Fits | Fits | 1364–1932 | | [MiniCPM-V-4.6-Thinking](https://whatcanirunai.vercel.app/models/minicpm-v-4.6-thinking/)1.9 GB at Q4 | Fits | Fits | Fits | 1364–1932 | | [kanana-2-1.3b-instruct](https://whatcanirunai.vercel.app/models/kanana-2-1.3b-instruct/)1.9 GB at Q4 | Fits | Fits | Fits | 1373–1945 | | [OLMo-1B-0724-hf](https://whatcanirunai.vercel.app/models/olmo-1b-0724-hf/)1.9 GB at Q4 | Fits | Fits | Fits | 1386–1963 | | [EXAONE-4.0-1.2B](https://whatcanirunai.vercel.app/models/exaone-4.0-1.2b/)1.9 GB at Q4 | Fits | Fits | Fits | 1386–1964 | | [Llama-3.2-1B-Instruct](https://whatcanirunai.vercel.app/models/llama-3.2-1b-instruct/)1.9 GB at Q4 | Fits | Fits | Fits | 1435–2033 | | [Llama-3.2-1B](https://whatcanirunai.vercel.app/models/llama-3.2-1b/)1.9 GB at Q4 | Fits | Fits | Fits | 1435–2033 | | [Llama-3.2-1B](https://whatcanirunai.vercel.app/models/llama-3.2-1b-nousresearch/)1.9 GB at Q4 | Fits | Fits | Fits | 1435–2033 | | [Zamba2-1.2B-instruct](https://whatcanirunai.vercel.app/models/zamba2-1.2b-instruct/)1.8 GB at Q4 | Fits | Fits | Fits | 1460–2068 | | [HRM-Text-1B](https://whatcanirunai.vercel.app/models/hrm-text-1b/)1.8 GB at Q4 | Fits | Fits | Fits | 1499–2124 | | [AMD-OLMo-1B](https://whatcanirunai.vercel.app/models/amd-olmo-1b/)1.8 GB at Q4 | Fits | Fits | Fits | 1507–2135 | | [LFM2.5-1.2B-Instruct](https://whatcanirunai.vercel.app/models/lfm2.5-1.2b-instruct/)1.8 GB at Q4 | Fits | Fits | Fits | 1515–2147 | | [LFM2-1.2B](https://whatcanirunai.vercel.app/models/lfm2-1.2b/)1.8 GB at Q4 | Fits | Fits | Fits | 1515–2147 | | [LFM2.5-1.2B-Thinking](https://whatcanirunai.vercel.app/models/lfm2.5-1.2b-thinking/)1.8 GB at Q4 | Fits | Fits | Fits | 1515–2147 | | [LFM2.5-1.2B-JP-202606](https://whatcanirunai.vercel.app/models/lfm2.5-1.2b-jp-202606/)1.8 GB at Q4 | Fits | Fits | Fits | 1515–2147 | | [MiniCPM5-1B](https://whatcanirunai.vercel.app/models/minicpm5-1b/)1.8 GB at Q4 | Fits | Fits | Fits | 1641–2325 | | [MiniCPM5-1B-SFT](https://whatcanirunai.vercel.app/models/minicpm5-1b-sft/)1.8 GB at Q4 | Fits | Fits | Fits | 1641–2325 | | [gemma-3-1b-it](https://whatcanirunai.vercel.app/models/gemma-3-1b-it/)1.7 GB at Q4 | Fits | Fits | Fits | 1774–2513 | | [gemma-3-1b-pt](https://whatcanirunai.vercel.app/models/gemma-3-1b-pt/)1.7 GB at Q4 | Fits | Fits | Fits | 1774–2513 | | [Qwen3.5-0.8B](https://whatcanirunai.vercel.app/models/qwen3.5-0.8b/)1.6 GB at Q4 | Fits | Fits | Fits | 2031–2877 | | [Falcon-E-3B-Instruct](https://whatcanirunai.vercel.app/models/falcon-e-3b-instruct/)1.6 GB at Q4 | Fits | Fits | Fits | 2052–2907 | | [bitnet-b1.58-2B-4T](https://whatcanirunai.vercel.app/models/bitnet-b1.58-2b-4t/)1.6 GB at Q4 | Fits | Fits | Fits | 2087–2957 | | [FastVLM-0.5B](https://whatcanirunai.vercel.app/models/fastvlm-0.5b/)1.5 GB at Q4 | Fits | Fits | Fits | 2337–3311 | | [Qwen3-0.6B](https://whatcanirunai.vercel.app/models/qwen3-0.6b/)1.5 GB at Q4 | Fits | Fits | Fits | 2360–3343 | | [LFM2-700M](https://whatcanirunai.vercel.app/models/lfm2-700m/)1.5 GB at Q4 | Fits | Fits | Fits | 2389–3384 | | [Falcon-H1-Tiny-R-0.6B](https://whatcanirunai.vercel.app/models/falcon-h1-tiny-r-0.6b/)1.4 GB at Q4 | Fits | Fits | Fits | 2850–4037 | | [Qwen3-0.6B-Base](https://whatcanirunai.vercel.app/models/qwen3-0.6b-base/)1.4 GB at Q4 | Fits | Fits | Fits | 2975–4215 | | [d1-omni-600M](https://whatcanirunai.vercel.app/models/d1-omni-600m/)1.4 GB at Q4 | Fits | Fits | Fits | 3021–4279 | | [HyperCLOVAX-SEED-Text-Instruct-0.5B](https://whatcanirunai.vercel.app/models/hyperclovax-seed-text-instruct-0.5b/)1.4 GB at Q4 | Fits | Fits | Fits | 3132–4437 | | [Falcon-H1-0.5B-Instruct](https://whatcanirunai.vercel.app/models/falcon-h1-0.5b-instruct/)1.4 GB at Q4 | Fits | Fits | Fits | 3401–4819 | | [Qwen2.5-0.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-0.5b-instruct/)1.3 GB at Q4 | Fits | Fits | Fits | 3590–5086 | | [Qwen2.5-0.5B](https://whatcanirunai.vercel.app/models/qwen2.5-0.5b/)1.3 GB at Q4 | Fits | Fits | Fits | 3590–5086 | | [Qwen2-0.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2-0.5b-instruct/)1.3 GB at Q4 | Fits | Fits | Fits | 3590–5086 | | [Qwen2.5-Coder-0.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-coder-0.5b-instruct/)1.3 GB at Q4 | Fits | Fits | Fits | 3590–5086 | | [LFM2-VL-450M](https://whatcanirunai.vercel.app/models/lfm2-vl-450m/)1.3 GB at Q4 | Fits | Fits | Fits | 3934–5573 | | [LFM2.5-VL-450M](https://whatcanirunai.vercel.app/models/lfm2.5-vl-450m/)1.3 GB at Q4 | Fits | Fits | Fits | 3952–5599 | | [Apertus-v1.1-0.5B](https://whatcanirunai.vercel.app/models/apertus-v1.1-0.5b/)1.3 GB at Q4 | Fits | Fits | Fits | 4046–5732 | | [MiniCPM4-0.5B](https://whatcanirunai.vercel.app/models/minicpm4-0.5b/)1.3 GB at Q4 | Fits | Fits | Fits | 4088–5791 | | [circuit-sparsity](https://whatcanirunai.vercel.app/models/circuit-sparsity/)1.3 GB at Q4 | Fits | Fits | Fits | 4231–5995 | | [SmolLM2-360M](https://whatcanirunai.vercel.app/models/smollm2-360m/)1.3 GB at Q4 | Fits | Fits | Fits | 4902–6944 | | [SmolLM-360M](https://whatcanirunai.vercel.app/models/smollm-360m/)1.3 GB at Q4 | Fits | Fits | Fits | 4902–6944 | | [ERNIE-4.5-0.3B-PT](https://whatcanirunai.vercel.app/models/ernie-4.5-0.3b-pt/)1.3 GB at Q4 | Fits | Fits | Fits | 4916–6965 | | [LFM2.5-350M](https://whatcanirunai.vercel.app/models/lfm2.5-350m/)1.2 GB at Q4 | Fits | Fits | Fits | 5003–7088 | | [LFM2-350M](https://whatcanirunai.vercel.app/models/lfm2-350m/)1.2 GB at Q4 | Fits | Fits | Fits | 5003–7088 | | [granite-4.0-350m](https://whatcanirunai.vercel.app/models/granite-4.0-350m/)1.2 GB at Q4 | Fits | Fits | Fits | 5033–7130 | | [granite-4.0-h-350m](https://whatcanirunai.vercel.app/models/granite-4.0-h-350m/)1.2 GB at Q4 | Fits | Fits | Fits | 5211–7382 | ## Copy the parts list RTX 5090 single-GPU build (32 GB) GPU: GeForce RTX 5090 — $1,999 (list price (MSRP)) CPU: AMD Ryzen 7 9700X — $339 (Newegg price (sold by Newegg)) Motherboard: ASUS TUF GAMING B650E-PLUS WIFI — $150 (Newegg price (sold by Newegg)) RAM: Corsair Vengeance 64GB (2x32) DDR5-6000 CL30 — $1,275 (Corsair store price) Power supply: Corsair HX1200i — $280 (Corsair store price) Case: Corsair FRAME 5000D RS — $160 (Corsair store price) Storage: Samsung 990 2TB NVMe — $330 (Newegg price (sold by Newegg)) Total: $4,533 Usable memory: 32.0 GB Built with whatcanirunai.vercel.app/planner/ (estimates; prices are dated snapshots) Copy parts list [Open in planner and tweak](https://whatcanirunai.vercel.app/planner/?gpu=rtx-5090&plat=plat-9700x-b650e&ram=ram-64-6000&psu=psu-hx1200i&case=case-frame-5000d&ssd=ssd-samsung-990-2tb) [Compare with other builds](https://whatcanirunai.vercel.app/builds/compare/?a=r:rtx-5090-32gb-build&b=r:24gb-budget-build&m=qwen3-32b) --- Agent guide: https://whatcanirunai.vercel.app/llms.txt · JSON API: https://whatcanirunai.vercel.app/developers/