# Radeon RX 6900 XT for local AI | What Can I Run AI? > Radeon RX 6900 XT has 16 GB of VRAM (16 GB usable) and runs 388 open models at Q4, up to Ling-Coder-lite. Specs, list price and the full list. Source: https://whatcanirunai.vercel.app/hardware/rx-6900-xt/ # Radeon RX 6900 XT for local LLMs The Radeon RX 6900 XT has 16 GB of VRAM (16 GB usable for models) and runs 388 of the 656 open models we track at Q4\_K\_M, up to Ling-Coder-lite (16.8B parameters, about 12.7 GB). These are estimates, not measured benchmarks. Looking for the model list first? See [what you can run on the Radeon RX 6900 XT](https://whatcanirunai.vercel.app/what-can-i-run/rx-6900-xt/). Memory 16 GB VRAM Memory bandwidth 512 GB/s Usable for models 16 GB Runs fully at Q4 388 / 656 [Spec source](https://en.wikipedia.org/wiki/List%5Fof%5FAMD%5Fgraphics%5Fprocessing%5Funits) · [Best GPU under $1,000](https://whatcanirunai.vercel.app/best-gpu-under/1000/) · [Best AMD GPU for local LLMs](https://whatcanirunai.vercel.app/best-amd-gpu-for-local-llm/) · [Best GPU for local LLMs](https://whatcanirunai.vercel.app/best-gpu-for-local-llm/) · [Multi-GPU](https://whatcanirunai.vercel.app/multi-gpu-for-local-llm/) · [Best used GPU for local LLMs](https://whatcanirunai.vercel.app/best-used-gpu-for-local-llm/) · [NVIDIA vs AMD vs Mac](https://whatcanirunai.vercel.app/nvidia-vs-amd-vs-mac/) · [Tokens per second](https://whatcanirunai.vercel.app/tokens-per-second/) · [Best LLMs for 16 GB](https://whatcanirunai.vercel.app/best-llm-for/16gb-vram/) **$999** list (launch MSRP; discontinued), [source](https://en.wikipedia.org/wiki/List%5Fof%5FAMD%5Fgraphics%5Fprocessing%5Funits), 2026-10-28 Street prices may be higher than list. Discontinued; buy used. Price shown is the original launch MSRP. [Check price on Amazon](https://www.amazon.com/s?k=Radeon%20RX%206900%20XT&tag=whatcanirunai-20)[Check price on eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%206900%20XT) We may earn a commission when you buy through these links, at no extra cost to you. ## Every tracked model on this machine Sorted largest first. The tick marks 90% of usable memory.FitsTightWon’t fit | Model | Q4 need vs. 16 GB | Verdict | | --------------------------------------------------------------------------------------------------------------- | -------------------- | ---------------------- | | [Kimi-K3.1-Pro](https://whatcanirunai.vercel.app/models/kimi-k3.1-pro/)2780.1B params | **1939.3** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Kimi-K3](https://whatcanirunai.vercel.app/models/kimi-k3/)2779.9B params | **1939.1** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen3.8-2.4T-A95B](https://whatcanirunai.vercel.app/models/qwen3.8-2.4t-a95b/)2446.2B params | **1706.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [LongCat-2.5](https://whatcanirunai.vercel.app/models/longcat-2.5/)1779.8B params | **1241.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [LongCat-2.0](https://whatcanirunai.vercel.app/models/longcat-2.0/)1775.6B params | **1238.9** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [DeepSeek-V4-Pro-0813](https://whatcanirunai.vercel.app/models/deepseek-v4-pro-0813/)1650.5B params | **1151.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [DeepSeek-V4-Pro](https://whatcanirunai.vercel.app/models/deepseek-v4-pro/)1598.8B params | **1115.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Kimi-K2.5](https://whatcanirunai.vercel.app/models/kimi-k2.5/)1026.9B params | **716.9** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Kimi-K2.6](https://whatcanirunai.vercel.app/models/kimi-k2.6/)1026.9B params | **716.9** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Kimi-K2.7-Code](https://whatcanirunai.vercel.app/models/kimi-k2.7-code/)1026.9B params | **716.9** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Kimi-K2-Thinking](https://whatcanirunai.vercel.app/models/kimi-k2-thinking/)1026.4B params | **716.6** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Kimi-K2-Instruct-0905](https://whatcanirunai.vercel.app/models/kimi-k2-instruct-0905/)1026.4B params | **716.6** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Kimi-K2-Instruct](https://whatcanirunai.vercel.app/models/kimi-k2-instruct/)1026.4B params | **716.6** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [MiMo-V2.6-Pro-RL](https://whatcanirunai.vercel.app/models/mimo-v2.6-pro-rl/)1024.2B params | **715.1** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [MiMo-V2.6-Pro-MOPD](https://whatcanirunai.vercel.app/models/mimo-v2.6-pro-mopd/)1024.2B params | **715.1** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [MiMo-V2.5-Pro](https://whatcanirunai.vercel.app/models/mimo-v2.5-pro/)1023.2B params | **714.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Ring-2.5-1T](https://whatcanirunai.vercel.app/models/ring-2.5-1t/)1012.2B params | **706.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Ling-2.5-1T](https://whatcanirunai.vercel.app/models/ling-2.5-1t/)1012.2B params | **706.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Ling-1T](https://whatcanirunai.vercel.app/models/ling-1t/)999.7B params | **698.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Ring-1T](https://whatcanirunai.vercel.app/models/ring-1t/)999.7B params | **698.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Inkling](https://whatcanirunai.vercel.app/models/inkling/)952.4B params | **665.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Intern-S1-Pro](https://whatcanirunai.vercel.app/models/intern-s1-pro/)917.0B params | **640.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Muse-Spark-Open-816B-A42B](https://whatcanirunai.vercel.app/models/muse-spark-open-816b-a42b/)822.0B params | **574.1** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Hy4-preview](https://whatcanirunai.vercel.app/models/hy4-preview/)780.0B params | **544.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [GLM-5](https://whatcanirunai.vercel.app/models/glm-5/)753.9B params | **526.6** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [GLM-5.1](https://whatcanirunai.vercel.app/models/glm-5.1/)753.9B params | **526.6** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [GLM-5.3](https://whatcanirunai.vercel.app/models/glm-5.3/)753.3B params | **526.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [GLM-5.2](https://whatcanirunai.vercel.app/models/glm-5.2/)753.3B params | **526.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [GLM-5.3-BF16](https://whatcanirunai.vercel.app/models/glm-5.3-bf16/)753.3B params | **526.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [K-EXAONE-2.0-750B-A37B](https://whatcanirunai.vercel.app/models/k-exaone-2.0-750b-a37b/)749.4B params | **523.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [DeepSeek-V3.2-Exp](https://whatcanirunai.vercel.app/models/deepseek-v3.2-exp/)685.4B params | **478.9** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [DeepSeek-V3.2-Speciale](https://whatcanirunai.vercel.app/models/deepseek-v3.2-speciale/)685.4B params | **478.9** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [DeepSeek-V3.2](https://whatcanirunai.vercel.app/models/deepseek-v3.2/)685.4B params | **478.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [DeepSeek-V3-0324](https://whatcanirunai.vercel.app/models/deepseek-v3-0324/)684.5B params | **478.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [DeepSeek-R1-0528](https://whatcanirunai.vercel.app/models/deepseek-r1-0528/)684.5B params | **478.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [DeepSeek-V3.1-Base](https://whatcanirunai.vercel.app/models/deepseek-v3.1-base/)684.5B params | **478.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [DeepSeek-R1](https://whatcanirunai.vercel.app/models/deepseek-r1/)684.5B params | **478.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [DeepSeek-R1-Zero](https://whatcanirunai.vercel.app/models/deepseek-r1-zero/)684.5B params | **478.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Step-5-Preview](https://whatcanirunai.vercel.app/models/step-5-preview/)604.3B params | **422.3** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Ling-3.1-flash](https://whatcanirunai.vercel.app/models/ling-3.1-flash/)572.1B params | **399.9** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Ling-3.1-flash-1019](https://whatcanirunai.vercel.app/models/ling-3.1-flash-1019/)572.1B params | **399.9** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [LongCat-Flash-Chat](https://whatcanirunai.vercel.app/models/longcat-flash-chat/)561.9B params | **392.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [LongCat-Flash-Thinking](https://whatcanirunai.vercel.app/models/longcat-flash-thinking/)561.9B params | **392.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [LongCat-Flash-Thinking-2601](https://whatcanirunai.vercel.app/models/longcat-flash-thinking-2601/)561.9B params | **392.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16](https://whatcanirunai.vercel.app/models/nvidia-nemotron-3-ultra-550b-a55b-bf16/)560.5B params | **391.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Beam-1.0-501B-A23B](https://whatcanirunai.vercel.app/models/beam-1.0-501b-a23b/)501.3B params | **350.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen3-Coder-480B-A35B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-coder-480b-a35b-instruct/)480.2B params | **335.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [MiniMax-M1-40k](https://whatcanirunai.vercel.app/models/minimax-m1-40k/)456.1B params | **319.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [MiniMax-M1-80k](https://whatcanirunai.vercel.app/models/minimax-m1-80k/)456.1B params | **319.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [MiniMax-M3](https://whatcanirunai.vercel.app/models/minimax-m3/)427.0B params | **298.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [ERNIE-4.5-VL-424B-A47B-PT](https://whatcanirunai.vercel.app/models/ernie-4.5-vl-424b-a47b-pt/)423.5B params | **296.3** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Intern-S2-397B](https://whatcanirunai.vercel.app/models/intern-s2-397b/)403.4B params | **282.3** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen3.5-397B-A17B](https://whatcanirunai.vercel.app/models/qwen3.5-397b-a17b/)403.4B params | **282.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Llama-4-Maverick-17B-128E-Instruct](https://whatcanirunai.vercel.app/models/llama-4-maverick-17b-128e-instruct/)401.6B params | **281.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Trinity-Large-Thinking](https://whatcanirunai.vercel.app/models/trinity-large-thinking/)398.6B params | **278.9** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Trinity-Large-Preview](https://whatcanirunai.vercel.app/models/trinity-large-preview/)398.6B params | **278.9** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Trinity-Large-TrueBase](https://whatcanirunai.vercel.app/models/trinity-large-truebase/)398.6B params | **278.9** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Trinity-Large-Base](https://whatcanirunai.vercel.app/models/trinity-large-base/)398.6B params | **278.9** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Nex-N2.5-Pro](https://whatcanirunai.vercel.app/models/nex-n2.5-pro/)396.8B params | **277.6** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Nex-N2-Pro](https://whatcanirunai.vercel.app/models/nex-n2-pro/)396.8B params | **277.6** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [NorthCUA-Pro](https://whatcanirunai.vercel.app/models/northcua-pro/)396.8B params | **277.6** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [GLM-4.5](https://whatcanirunai.vercel.app/models/glm-4.5/)358.3B params | **250.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [GLM-4.7](https://whatcanirunai.vercel.app/models/glm-4.7/)358.3B params | **250.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [GLM-4.6](https://whatcanirunai.vercel.app/models/glm-4.6/)356.8B params | **249.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [GLM-5.3-Flash](https://whatcanirunai.vercel.app/models/glm-5.3-flash/)321.3B params | **225.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Motif-3](https://whatcanirunai.vercel.app/models/motif-3/)314.8B params | **220.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [MiMo-V2.5](https://whatcanirunai.vercel.app/models/mimo-v2.5/)310.8B params | **217.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [MiMo-V2.6-Flash-RL](https://whatcanirunai.vercel.app/models/mimo-v2.6-flash-rl/)310.8B params | **217.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [MiMo-V2.6-Flash-MOPD](https://whatcanirunai.vercel.app/models/mimo-v2.6-flash-mopd/)310.8B params | **217.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [MiMo-V2-Flash](https://whatcanirunai.vercel.app/models/mimo-v2-flash/)309.8B params | **217.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [DeepSeek-V4-Flash-Vision-Exp](https://whatcanirunai.vercel.app/models/deepseek-v4-flash-vision-exp/)304.6B params | **213.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [DeepSeek-V4-Flash-0731](https://whatcanirunai.vercel.app/models/deepseek-v4-flash-0731/)304.2B params | **213.1** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [ERNIE-4.5-300B-A47B-PT](https://whatcanirunai.vercel.app/models/ernie-4.5-300b-a47b-pt/)300.5B params | **210.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Hy3](https://whatcanirunai.vercel.app/models/hy3/)298.8B params | **209.3** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Hy3-preview](https://whatcanirunai.vercel.app/models/hy3-preview/)298.8B params | **209.3** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Ling-plus](https://whatcanirunai.vercel.app/models/ling-plus/)292.5B params | **205.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [DeepSeek-V4-Flash](https://whatcanirunai.vercel.app/models/deepseek-v4-flash/)290.9B params | **203.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [MemT-1.0-Flash](https://whatcanirunai.vercel.app/models/memt-1.0-flash/)287.9B params | **201.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [ERNIE-5.5-Flash-Base](https://whatcanirunai.vercel.app/models/ernie-5.5-flash-base/)286.2B params | **200.6** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Inkling-Small](https://whatcanirunai.vercel.app/models/inkling-small/)266.0B params | **186.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Llama-3\_1-Nemotron-Ultra-253B-v1](https://whatcanirunai.vercel.app/models/llama-3-1-nemotron-ultra-253b-v1/)253.4B params | **177.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Solar-Open2-250B](https://whatcanirunai.vercel.app/models/solar-open2-250b/)250.3B params | **175.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Intern-S1](https://whatcanirunai.vercel.app/models/intern-s1/)240.7B params | **168.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [K-EXAONE-236B-A23B](https://whatcanirunai.vercel.app/models/k-exaone-236b-a23b/)237.1B params | **166.3** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [DeepSeek-V2.5](https://whatcanirunai.vercel.app/models/deepseek-v2.5/)235.7B params | **165.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [DeepSeek-Coder-V2-Instruct](https://whatcanirunai.vercel.app/models/deepseek-coder-v2-instruct/)235.7B params | **165.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [DeepSeek-V2.5-1210](https://whatcanirunai.vercel.app/models/deepseek-v2.5-1210/)235.7B params | **165.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [DeepSeek-V2-Chat-0628](https://whatcanirunai.vercel.app/models/deepseek-v2-chat-0628/)235.7B params | **165.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [DeepSeek-Coder-V2-Instruct-0724](https://whatcanirunai.vercel.app/models/deepseek-coder-v2-instruct-0724/)235.7B params | **165.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen3-VL-235B-A22B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-vl-235b-a22b-instruct/)235.7B params | **165.3** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen3-235B-A22B](https://whatcanirunai.vercel.app/models/qwen3-235b-a22b/)235.1B params | **164.9** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen3-235B-A22B-Instruct-2507](https://whatcanirunai.vercel.app/models/qwen3-235b-a22b-instruct-2507/)235.1B params | **164.9** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen3-235B-A22B-Thinking-2507](https://whatcanirunai.vercel.app/models/qwen3-235b-a22b-thinking-2507/)235.1B params | **164.9** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [MiniMax-M2](https://whatcanirunai.vercel.app/models/minimax-m2/)228.7B params | **160.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [MiniMax-M2.5](https://whatcanirunai.vercel.app/models/minimax-m2.5/)228.7B params | **160.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [MiniMax-M2.7](https://whatcanirunai.vercel.app/models/minimax-m2.7/)228.7B params | **160.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [MiniMax-M2.1](https://whatcanirunai.vercel.app/models/minimax-m2.1/)228.7B params | **160.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [command-a-plus-05-2026-bf16](https://whatcanirunai.vercel.app/models/command-a-plus-05-2026-bf16/)218.8B params | **153.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Step-3.7-Flash](https://whatcanirunai.vercel.app/models/step-3.7-flash/)201.4B params | **141.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Step-3.5-Flash](https://whatcanirunai.vercel.app/models/step-3.5-flash/)199.4B params | **140.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Step-3.5-Flash-Base-Midtrain](https://whatcanirunai.vercel.app/models/step-3.5-flash-base-midtrain/)197.8B params | **138.9** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen3.8-Flash-Next](https://whatcanirunai.vercel.app/models/qwen3.8-flash-next/)180.0B params | **126.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Mixtral-8x22B-Instruct-v0.1](https://whatcanirunai.vercel.app/models/mixtral-8x22b-instruct-v0.1/)140.6B params | **99.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Ling-3.0-flash-Sante](https://whatcanirunai.vercel.app/models/ling-3.0-flash-sante/)127.5B params | **89.9** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Ling-3.0-flash](https://whatcanirunai.vercel.app/models/ling-3.0-flash/)127.5B params | **89.9** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Ling-3.0-flash-Fin](https://whatcanirunai.vercel.app/models/ling-3.0-flash-fin/)127.5B params | **89.9** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Ornith-1.5-122B](https://whatcanirunai.vercel.app/models/ornith-1.5-122b/)125.1B params | **88.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen3.5-122B-A10B](https://whatcanirunai.vercel.app/models/qwen3.5-122b-a10b/)125.1B params | **88.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Devstral-2-123B-Instruct-2512](https://whatcanirunai.vercel.app/models/devstral-2-123b-instruct-2512/)125.0B params | **88.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Ling-3.0-flash-VL](https://whatcanirunai.vercel.app/models/ling-3.0-flash-vl/)124.8B params | **88.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [NVIDIA-Nemotron-3-Super-120B-A12B-BF16](https://whatcanirunai.vercel.app/models/nvidia-nemotron-3-super-120b-a12b-bf16/)123.6B params | **87.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Mistral-Small-4-119B-2603](https://whatcanirunai.vercel.app/models/mistral-small-4-119b-2603/)119.4B params | **84.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Youtu-LLM-A7B-Base](https://whatcanirunai.vercel.app/models/youtu-llm-a7b-base/)118.4B params | **83.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Laguna-S-2.1](https://whatcanirunai.vercel.app/models/laguna-s-2.1/)117.6B params | **83.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [gpt-oss-120b](https://whatcanirunai.vercel.app/models/gpt-oss-120b/)116.8B params | **82.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [c4ai-command-a-03-2025](https://whatcanirunai.vercel.app/models/c4ai-command-a-03-2025/)111.1B params | **78.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [GLM-4.5-Air](https://whatcanirunai.vercel.app/models/glm-4.5-air/)110.5B params | **78.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Llama-4-Scout-17B-16E-Instruct](https://whatcanirunai.vercel.app/models/llama-4-scout-17b-16e-instruct/)108.6B params | **76.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Llama-4-Scout-17B-16E](https://whatcanirunai.vercel.app/models/llama-4-scout-17b-16e/)108.6B params | **76.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [GLM-4.5V](https://whatcanirunai.vercel.app/models/glm-4.5v/)107.7B params | **76.1** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [GLM-4.6V](https://whatcanirunai.vercel.app/models/glm-4.6v/)107.7B params | **76.1** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Ling-2.6-flash](https://whatcanirunai.vercel.app/models/ling-2.6-flash/)107.5B params | **75.9** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [sarvam-105b](https://whatcanirunai.vercel.app/models/sarvam-105b/)106.0B params | **74.9** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Ling-flash-2.0](https://whatcanirunai.vercel.app/models/ling-flash-2.0/)102.9B params | **72.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [LLaDA2.1-flash](https://whatcanirunai.vercel.app/models/llada2.1-flash/)102.9B params | **72.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Ring-flash-2.0](https://whatcanirunai.vercel.app/models/ring-flash-2.0/)102.9B params | **72.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [LLaDA2.2-flash](https://whatcanirunai.vercel.app/models/llada2.2-flash/)102.9B params | **72.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Solar-Open-100B](https://whatcanirunai.vercel.app/models/solar-open-100b/)102.7B params | **72.6** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen3-Next-80B-A3B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-next-80b-a3b-instruct/)81.3B params | **57.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen3-Next-80B-A3B-Thinking](https://whatcanirunai.vercel.app/models/qwen3-next-80b-a3b-thinking/)81.3B params | **57.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [AliceAI-Foundation-80B-A3B-Base](https://whatcanirunai.vercel.app/models/aliceai-foundation-80b-a3b-base/)81.3B params | **57.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Hunyuan-A13B-Instruct](https://whatcanirunai.vercel.app/models/hunyuan-a13b-instruct/)80.4B params | **57.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen3-Coder-Next](https://whatcanirunai.vercel.app/models/qwen3-coder-next/)79.7B params | **56.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Kolibri-1](https://whatcanirunai.vercel.app/models/kolibri-1/)78.1B params | **55.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen2.5-VL-72B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-vl-72b-instruct/)73.4B params | **52.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [UI-TARS-72B-DPO](https://whatcanirunai.vercel.app/models/ui-tars-72b-dpo/)73.4B params | **52.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen2.5-72B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-72b-instruct/)72.7B params | **51.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Apertus-70B-Instruct-2509](https://whatcanirunai.vercel.app/models/apertus-70b-instruct-2509/)70.6B params | **50.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Apertus-70B-2509](https://whatcanirunai.vercel.app/models/apertus-70b-2509/)70.6B params | **50.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Llama-3.3-70B-Instruct](https://whatcanirunai.vercel.app/models/llama-3.3-70b-instruct/)70.6B params | **50.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [DeepSeek-R1-Distill-Llama-70B](https://whatcanirunai.vercel.app/models/deepseek-r1-distill-llama-70b/)70.6B params | **50.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Llama-3.1-70B](https://whatcanirunai.vercel.app/models/llama-3.1-70b/)70.6B params | **50.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Hermes-2-Theta-Llama-3-70B](https://whatcanirunai.vercel.app/models/hermes-2-theta-llama-3-70b/)70.6B params | **50.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Meta-Llama-3.1-70B-Instruct](https://whatcanirunai.vercel.app/models/meta-llama-3.1-70b-instruct/)70.6B params | **50.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [LongCat-Flash-Lite](https://whatcanirunai.vercel.app/models/longcat-flash-lite/)69.1B params | **49.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [AI21-Jamba2-Mini](https://whatcanirunai.vercel.app/models/ai21-jamba2-mini/)51.6B params | **37.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Llama-3\_1-Nemotron-51B-Instruct](https://whatcanirunai.vercel.app/models/llama-3-1-nemotron-51b-instruct/)51.5B params | **36.9** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Llama-3\_3-Nemotron-Super-49B-v1\_5](https://whatcanirunai.vercel.app/models/llama-3-3-nemotron-super-49b-v1-5/)49.9B params | **35.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Llama-3\_3-Nemotron-Super-49B-v1](https://whatcanirunai.vercel.app/models/llama-3-3-nemotron-super-49b-v1/)49.9B params | **35.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Phi-3.5-MoE-instruct](https://whatcanirunai.vercel.app/models/phi-3.5-moe-instruct/)41.9B params | **30.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [GRIN-MoE](https://whatcanirunai.vercel.app/models/grin-moe/)41.9B params | **30.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [ALIA-40b](https://whatcanirunai.vercel.app/models/alia-40b/)40.4B params | **29.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [IQuest-Coder-V1-40B-Loop-Instruct](https://whatcanirunai.vercel.app/models/iquest-coder-v1-40b-loop-instruct/)39.8B params | **28.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [IQuest-Coder-V1-40B-Instruct](https://whatcanirunai.vercel.app/models/iquest-coder-v1-40b-instruct/)39.8B params | **28.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Recursive Flint](https://whatcanirunai.vercel.app/models/flint/)39.8B params | **28.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [K2-Horizon-MoVA-36B-A4B](https://whatcanirunai.vercel.app/models/k2-horizon-mova-36b-a4b/)37.4B params | **27.1** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Seed-OSS-36B-Instruct](https://whatcanirunai.vercel.app/models/seed-oss-36b-instruct/)36.2B params | **26.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Seed-OSS-36B-Base-woSyn](https://whatcanirunai.vercel.app/models/seed-oss-36b-base-wosyn/)36.2B params | **26.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Intern-S2-Preview](https://whatcanirunai.vercel.app/models/intern-s2-preview/)36.1B params | **26.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Ornith-1.5-35B-A3B](https://whatcanirunai.vercel.app/models/ornith-1.5-35b-a3b/)36.0B params | **26.1** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Sage-A1.5](https://whatcanirunai.vercel.app/models/sage-a1.5/)36.0B params | **26.1** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen3.6-35B-A3B](https://whatcanirunai.vercel.app/models/qwen3.6-35b-a3b/)36.0B params | **26.1** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen3.5-35B-A3B](https://whatcanirunai.vercel.app/models/qwen3.5-35b-a3b/)36.0B params | **26.1** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Apex-35B-V1.0](https://whatcanirunai.vercel.app/models/apex-35b-v1.0/)36.0B params | **26.1** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [MiniCPM-V-4.7-35B-A3B](https://whatcanirunai.vercel.app/models/minicpm-v-4.7-35b-a3b/)35.2B params | **25.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [MemT-1.0-Nano](https://whatcanirunai.vercel.app/models/memt-1.0-nano/)35.1B params | **25.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Agents-A1](https://whatcanirunai.vercel.app/models/agents-a1/)35.1B params | **25.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Nex-N2.5-mini](https://whatcanirunai.vercel.app/models/nex-n2.5-mini/)35.1B params | **25.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Nex-N2-mini](https://whatcanirunai.vercel.app/models/nex-n2-mini/)35.1B params | **25.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Axion-1.0-35B](https://whatcanirunai.vercel.app/models/axion-1.0-35b/)35.1B params | **25.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [NorthCUA-Mini](https://whatcanirunai.vercel.app/models/northcua-mini/)35.1B params | **25.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Clover-35B-A3B-Preview](https://whatcanirunai.vercel.app/models/clover-35b-a3b-preview/)34.7B params | **25.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen-AgentWorld-35B-A3B](https://whatcanirunai.vercel.app/models/qwen-agentworld-35b-a3b/)34.7B params | **25.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [KAT-Coder-V2.5-Dev](https://whatcanirunai.vercel.app/models/kat-coder-v2.5-dev/)34.7B params | **25.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [EXAONE-4.5-33B](https://whatcanirunai.vercel.app/models/exaone-4.5-33b/)34.4B params | **24.9** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Falcon-H1-34B-Instruct](https://whatcanirunai.vercel.app/models/falcon-h1-34b-instruct/)33.6B params | **24.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen2.5-VL-32B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-vl-32b-instruct/)33.5B params | **24.3** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Laguna-XS.2](https://whatcanirunai.vercel.app/models/laguna-xs.2/)33.4B params | **24.3** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen3-VL-32B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-vl-32b-instruct/)33.4B params | **24.3** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [HyperCLOVAX-SEED-Think-32B](https://whatcanirunai.vercel.app/models/hyperclovax-seed-think-32b/)33.3B params | **24.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [FlexOlmo-7x7B-1T](https://whatcanirunai.vercel.app/models/flexolmo-7x7b-1t/)33.3B params | **24.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [GLM-Z1-Rumination-32B-0414](https://whatcanirunai.vercel.app/models/glm-z1-rumination-32b-0414/)33.1B params | **24.1** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Nanbeige4.3-33B](https://whatcanirunai.vercel.app/models/nanbeige4.3-33b/)33.1B params | **24.1** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16](https://whatcanirunai.vercel.app/models/nemotron-3-nano-omni-30b-a3b-reasoning-bf16/)33.0B params | **24.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen2.5-Coder-32B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-coder-32b-instruct/)32.8B params | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [DeepSeek-R1-Distill-Qwen-32B](https://whatcanirunai.vercel.app/models/deepseek-r1-distill-qwen-32b/)32.8B params | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen2.5-32B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-32b-instruct/)32.8B params | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [QwQ-32B](https://whatcanirunai.vercel.app/models/qwq-32b/)32.8B params | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [QwQ-32B-Preview](https://whatcanirunai.vercel.app/models/qwq-32b-preview/)32.8B params | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen2.5-32B](https://whatcanirunai.vercel.app/models/qwen2.5-32b/)32.8B params | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen2.5-Coder-32B](https://whatcanirunai.vercel.app/models/qwen2.5-coder-32b/)32.8B params | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen3-32B](https://whatcanirunai.vercel.app/models/qwen3-32b/)32.8B params | **23.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [GLM-Z1-32B-0414](https://whatcanirunai.vercel.app/models/glm-z1-32b-0414/)32.6B params | **23.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [GLM-4-32B-0414](https://whatcanirunai.vercel.app/models/glm-4-32b-0414/)32.6B params | **23.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [OLMo-2-0325-32B-Instruct](https://whatcanirunai.vercel.app/models/olmo-2-0325-32b-instruct/)32.2B params | **23.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [OLMo-2-0325-32B](https://whatcanirunai.vercel.app/models/olmo-2-0325-32b/)32.2B params | **23.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Olmo-3-32B-Think](https://whatcanirunai.vercel.app/models/olmo-3-32b-think/)32.2B params | **23.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Olmo-3-1125-32B](https://whatcanirunai.vercel.app/models/olmo-3-1125-32b/)32.2B params | **23.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Olmo-3.1-32B-Instruct](https://whatcanirunai.vercel.app/models/olmo-3.1-32b-instruct/)32.2B params | **23.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Olmo-3.1-32B-Think](https://whatcanirunai.vercel.app/models/olmo-3.1-32b-think/)32.2B params | **23.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Olmo-3.1-32B-Instruct-DPO](https://whatcanirunai.vercel.app/models/olmo-3.1-32b-instruct-dpo/)32.2B params | **23.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [granite-4.0-h-small](https://whatcanirunai.vercel.app/models/granite-4.0-h-small/)32.2B params | **23.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [sarvam-30b](https://whatcanirunai.vercel.app/models/sarvam-30b/)32.2B params | **23.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [EXAONE-4.0-32B](https://whatcanirunai.vercel.app/models/exaone-4.0-32b/)32.0B params | **23.3** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [EXAONE-4.0.1-32B](https://whatcanirunai.vercel.app/models/exaone-4.0.1-32b/)32.0B params | **23.3** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [EXAONE-3.5-32B-Instruct](https://whatcanirunai.vercel.app/models/exaone-3.5-32b-instruct/)32.0B params | **23.3** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [EXAONE-Deep-32B](https://whatcanirunai.vercel.app/models/exaone-deep-32b/)32.0B params | **23.3** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16](https://whatcanirunai.vercel.app/models/nvidia-nemotron-3.5-lightning-30b-a3b-bf16/)31.6B params | **23.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [NVIDIA-Nemotron-3-Nano-30B-A3B-BF16](https://whatcanirunai.vercel.app/models/nvidia-nemotron-3-nano-30b-a3b-bf16/)31.6B params | **23.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Nemotron-Cascade-2-30B-A3B](https://whatcanirunai.vercel.app/models/nemotron-cascade-2-30b-a3b/)31.6B params | **23.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Gemma 4 31B](https://whatcanirunai.vercel.app/models/gemma-4-31b-it/)31.3B params | **22.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [gemma-4-31B](https://whatcanirunai.vercel.app/models/gemma-4-31b/)31.3B params | **22.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [GLM-4.7-Flash](https://whatcanirunai.vercel.app/models/glm-4.7-flash/)31.2B params | **22.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Xing4.0-29B-A4B](https://whatcanirunai.vercel.app/models/xing4.0-29b-a4b/)31.2B params | **22.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Xing4.0-29B-Intent](https://whatcanirunai.vercel.app/models/xing4.0-29b-intent/)31.2B params | **22.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen3-VL-30B-A3B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-vl-30b-a3b-instruct/)31.1B params | **22.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen3-VL-30B-A3B-Thinking](https://whatcanirunai.vercel.app/models/qwen3-vl-30b-a3b-thinking/)31.1B params | **22.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [UI-Venus-1.5-30B-A3B](https://whatcanirunai.vercel.app/models/ui-venus-1.5-30b-a3b/)31.1B params | **22.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [kanana-2-30b-a3b-instruct-2601](https://whatcanirunai.vercel.app/models/kanana-2-30b-a3b-instruct-2601/)30.7B params | **22.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [kanana-2-30b-a3b-instruct](https://whatcanirunai.vercel.app/models/kanana-2-30b-a3b-instruct/)30.7B params | **22.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [kanana-2-30b-a3b-thinking-2601](https://whatcanirunai.vercel.app/models/kanana-2-30b-a3b-thinking-2601/)30.7B params | **22.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen3-30B-A3B](https://whatcanirunai.vercel.app/models/qwen3-30b-a3b/)30.5B params | **22.3** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen3-Coder-30B-A3B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-coder-30b-a3b-instruct/)30.5B params | **22.3** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen3-30B-A3B-Instruct-2507](https://whatcanirunai.vercel.app/models/qwen3-30b-a3b-instruct-2507/)30.5B params | **22.3** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen3-30B-A3B-Thinking-2507](https://whatcanirunai.vercel.app/models/qwen3-30b-a3b-thinking-2507/)30.5B params | **22.3** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Tongyi-DeepResearch-30B-A3B](https://whatcanirunai.vercel.app/models/tongyi-deepresearch-30b-a3b/)30.5B params | **22.3** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Rubicon-Preview](https://whatcanirunai.vercel.app/models/rubicon-preview/)30.5B params | **22.3** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [North-Mini-Code-1.0](https://whatcanirunai.vercel.app/models/north-mini-code-1.0/)30.5B params | **22.3** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Hy-Memory-30B-A3B](https://whatcanirunai.vercel.app/models/hy-memory-30b-a3b/)30.1B params | **22.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Hy-MT2-30B-A3B](https://whatcanirunai.vercel.app/models/hy-mt2-30b-a3b/)30.1B params | **22.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [granite-switch-4.1-30b](https://whatcanirunai.vercel.app/models/granite-switch-4.1-30b/)30.0B params | **21.9** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Muse-Glimmer-30B](https://whatcanirunai.vercel.app/models/muse-glimmer-30b/)29.8B params | **21.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [ERNIE-4.5-VL-28B-A3B-Thinking](https://whatcanirunai.vercel.app/models/ernie-4.5-vl-28b-a3b-thinking/)29.7B params | **21.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [ERNIE-4.5-VL-28B-A3B-PT](https://whatcanirunai.vercel.app/models/ernie-4.5-vl-28b-a3b-pt/)29.4B params | **21.5** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [granite-4.2-30b](https://whatcanirunai.vercel.app/models/granite-4.2-30b/)29.3B params | **21.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [granite-4.1-30b](https://whatcanirunai.vercel.app/models/granite-4.1-30b/)28.9B params | **21.1** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Raon-1 mini preview](https://whatcanirunai.vercel.app/models/raon-1-mini-preview/)28.8B params | **21.1** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen3.8-27B](https://whatcanirunai.vercel.app/models/qwen3.8-27b/)27.8B params | **20.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Tess-4.5-27B](https://whatcanirunai.vercel.app/models/tess-4.5-27b/)27.8B params | **20.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen3.6-27B](https://whatcanirunai.vercel.app/models/qwen3.6-27b/)27.8B params | **20.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen3.5-27B](https://whatcanirunai.vercel.app/models/qwen3.5-27b/)27.8B params | **20.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [gemma-3-27b-it](https://whatcanirunai.vercel.app/models/gemma-3-27b-it/)27.4B params | **20.1** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Arete-27B](https://whatcanirunai.vercel.app/models/arete-27b/)27.4B params | **20.1** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [gemma-2-27b-it](https://whatcanirunai.vercel.app/models/gemma-2-27b-it/)27.2B params | **20.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [gemma-2-27b](https://whatcanirunai.vercel.app/models/gemma-2-27b/)27.2B params | **20.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Qwen3.8-27B-Longbook27-v2](https://whatcanirunai.vercel.app/models/qwen3.8-27b-longbook27-v2/)27.1B params | **19.9** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [medgemma-27b-text-it](https://whatcanirunai.vercel.app/models/medgemma-27b-text-it/)27.0B params | **19.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Hemmingway-1.5](https://whatcanirunai.vercel.app/models/hemmingway-1.5/)26.9B params | **19.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Trinity-Mini](https://whatcanirunai.vercel.app/models/trinity-mini/)26.1B params | **19.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [diffusiongemma-26B-A4B-it](https://whatcanirunai.vercel.app/models/diffusiongemma-26b-a4b-it/)25.8B params | **19.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Gemma 4 26B A4B](https://whatcanirunai.vercel.app/models/gemma-4-26b-a4b-it/)25.8B params | **19.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [gemma-4-26B-A4B](https://whatcanirunai.vercel.app/models/gemma-4-26b-a4b/)25.8B params | **19.0** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Voxtral-Small-24B-2507](https://whatcanirunai.vercel.app/models/voxtral-small-24b-2507/)24.3B params | **17.9** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Mistral-Small-3.2-24B-Instruct-2506](https://whatcanirunai.vercel.app/models/mistral-small-3.2-24b-instruct-2506/)24.0B params | **17.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Mistral-Small-3.1-24B-Instruct-2503](https://whatcanirunai.vercel.app/models/mistral-small-3.1-24b-instruct-2503/)24.0B params | **17.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [LFM2.5-24B-A2B](https://whatcanirunai.vercel.app/models/lfm2.5-24b-a2b/)24.0B params | **17.7** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [LFM2-24B-A2B](https://whatcanirunai.vercel.app/models/lfm2-24b-a2b/)23.8B params | **17.6** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [Mistral-Small-24B-Instruct-2501](https://whatcanirunai.vercel.app/models/mistral-small-24b-instruct-2501/)23.6B params | **17.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [EuroLLM-22B-Instruct-2512](https://whatcanirunai.vercel.app/models/eurollm-22b-instruct-2512/)22.6B params | **16.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [EuroLLM-22B-2512](https://whatcanirunai.vercel.app/models/eurollm-22b-2512/)22.6B params | **16.8** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [solar-pro-preview-instruct](https://whatcanirunai.vercel.app/models/solar-pro-preview-instruct/)22.1B params | **16.4** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [ERNIE-4.5-21B-A3B-PT](https://whatcanirunai.vercel.app/models/ernie-4.5-21b-a3b-pt/)21.9B params | **16.3** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [ERNIE-4.5-21B-A3B-Thinking](https://whatcanirunai.vercel.app/models/ernie-4.5-21b-a3b-thinking/)21.8B params | **16.2** / 16.0 GB | Q4Won’t fitQ8Won’t fit | | [gpt-oss-20b](https://whatcanirunai.vercel.app/models/gpt-oss-20b/)20.9B params | **15.6** / 16.0 GB | Q4TightQ8Won’t fit | | [reka-flash-3](https://whatcanirunai.vercel.app/models/reka-flash-3/)20.9B params | **15.6** / 16.0 GB | Q4TightQ8Won’t fit | | [maple-preview](https://whatcanirunai.vercel.app/models/maple-preview/)20.2B params | **15.1** / 16.0 GB | Q4TightQ8Won’t fit | | [internlm2\_5-20b-chat](https://whatcanirunai.vercel.app/models/internlm2-5-20b-chat/)19.9B params | **14.8** / 16.0 GB | Q4TightQ8Won’t fit | | [Groot-19B-A3B-261023](https://whatcanirunai.vercel.app/models/groot-19b-a3b-261023/)19.4B params | **14.5** / 16.0 GB | Q4TightQ8Won’t fit | | [Ling-Coder-lite](https://whatcanirunai.vercel.app/models/ling-coder-lite/)16.8B params | **12.7** / 16.0 GB | Q4FitsQ8Won’t fit | | [Ring-lite-distill-preview](https://whatcanirunai.vercel.app/models/ring-lite-distill-preview/)16.8B params | **12.7** / 16.0 GB | Q4FitsQ8Won’t fit | | [Ling-lite](https://whatcanirunai.vercel.app/models/ling-lite/)16.8B params | **12.7** / 16.0 GB | Q4FitsQ8Won’t fit | | [Ling-lite-1.5-2507](https://whatcanirunai.vercel.app/models/ling-lite-1.5-2507/)16.8B params | **12.7** / 16.0 GB | Q4FitsQ8Won’t fit | | [Ling-lite-1.5](https://whatcanirunai.vercel.app/models/ling-lite-1.5/)16.8B params | **12.7** / 16.0 GB | Q4FitsQ8Won’t fit | | [Ring-lite](https://whatcanirunai.vercel.app/models/ring-lite/)16.8B params | **12.7** / 16.0 GB | Q4FitsQ8Won’t fit | | [Ring-mini-linear-2.0](https://whatcanirunai.vercel.app/models/ring-mini-linear-2.0/)16.4B params | **12.5** / 16.0 GB | Q4FitsQ8Won’t fit | | [Kimi-VL-A3B-Instruct](https://whatcanirunai.vercel.app/models/kimi-vl-a3b-instruct/)16.4B params | **12.4** / 16.0 GB | Q4FitsQ8Won’t fit | | [Kimi-VL-A3B-Thinking](https://whatcanirunai.vercel.app/models/kimi-vl-a3b-thinking/)16.4B params | **12.4** / 16.0 GB | Q4FitsQ8Won’t fit | | [Kimi-VL-A3B-Thinking-2506](https://whatcanirunai.vercel.app/models/kimi-vl-a3b-thinking-2506/)16.4B params | **12.4** / 16.0 GB | Q4FitsQ8Won’t fit | | [LLaDA2.1-mini](https://whatcanirunai.vercel.app/models/llada2.1-mini/)16.3B params | **12.3** / 16.0 GB | Q4FitsQ8Won’t fit | | [LLaDA2.0-mini](https://whatcanirunai.vercel.app/models/llada2.0-mini/)16.3B params | **12.3** / 16.0 GB | Q4FitsQ8Won’t fit | | [Ling-mini-2.0](https://whatcanirunai.vercel.app/models/ling-mini-2.0/)16.3B params | **12.3** / 16.0 GB | Q4FitsQ8Won’t fit | | [Ring-mini-2.0](https://whatcanirunai.vercel.app/models/ring-mini-2.0/)16.3B params | **12.3** / 16.0 GB | Q4FitsQ8Won’t fit | | [LLaDA2.2-mini](https://whatcanirunai.vercel.app/models/llada2.2-mini/)16.3B params | **12.3** / 16.0 GB | Q4FitsQ8Won’t fit | | [LLaDA2.0-mini-preview](https://whatcanirunai.vercel.app/models/llada2.0-mini-preview/)16.3B params | **12.3** / 16.0 GB | Q4FitsQ8Won’t fit | | [Moonlight-16B-A3B-Instruct](https://whatcanirunai.vercel.app/models/moonlight-16b-a3b-instruct/)16.0B params | **12.1** / 16.0 GB | Q4FitsQ8Won’t fit | | [Moonlight-16B-A3B](https://whatcanirunai.vercel.app/models/moonlight-16b-a3b/)16.0B params | **12.1** / 16.0 GB | Q4FitsQ8Won’t fit | | [Instella-MoE-16B-A3B-Think](https://whatcanirunai.vercel.app/models/instella-moe-16b-a3b-think/)15.9B params | **12.1** / 16.0 GB | Q4FitsQ8Won’t fit | | [DeepSeek-Coder-V2-Lite-Instruct](https://whatcanirunai.vercel.app/models/deepseek-coder-v2-lite-instruct/)15.7B params | **12.0** / 16.0 GB | Q4FitsQ8Won’t fit | | [kanana-1.5-15.7b-a3b-instruct](https://whatcanirunai.vercel.app/models/kanana-1.5-15.7b-a3b-instruct/)15.7B params | **11.9** / 16.0 GB | Q4FitsQ8Won’t fit | | [Phi-4-reasoning-vision-15B](https://whatcanirunai.vercel.app/models/phi-4-reasoning-vision-15b/)15.1B params | **11.5** / 16.0 GB | Q4FitsQ8Won’t fit | | [Apriel-Nemotron-15b-Thinker](https://whatcanirunai.vercel.app/models/apriel-nemotron-15b-thinker/)15.0B params | **11.4** / 16.0 GB | Q4FitsQ8Won’t fit | | [Apriel-1.5-15b-Thinker](https://whatcanirunai.vercel.app/models/apriel-1.5-15b-thinker/)14.9B params | **11.4** / 16.0 GB | Q4FitsQ8Won’t fit | | [Apriel-1.6-15b-Thinker](https://whatcanirunai.vercel.app/models/apriel-1.6-15b-thinker/)14.9B params | **11.4** / 16.0 GB | Q4FitsQ8Won’t fit | | [Carbon-X (DNA)](https://whatcanirunai.vercel.app/models/carbon-x/)14.8B params | **11.3** / 16.0 GB | Q4FitsQ8Won’t fit | | [Qwen2.5-Coder-14B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-coder-14b-instruct/)14.8B params | **11.3** / 16.0 GB | Q4FitsQ8Won’t fit | | [DeepSeek-R1-Distill-Qwen-14B](https://whatcanirunai.vercel.app/models/deepseek-r1-distill-qwen-14b/)14.8B params | **11.3** / 16.0 GB | Q4FitsQ8Won’t fit | | [Qwen2.5-14B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-14b-instruct/)14.8B params | **11.3** / 16.0 GB | Q4FitsQ8Won’t fit | | [Qwen2.5-14B](https://whatcanirunai.vercel.app/models/qwen2.5-14b/)14.8B params | **11.3** / 16.0 GB | Q4FitsQ8Won’t fit | | [Qwen2.5-14B-Instruct-1M](https://whatcanirunai.vercel.app/models/qwen2.5-14b-instruct-1m/)14.8B params | **11.3** / 16.0 GB | Q4FitsQ8Won’t fit | | [Qwen2.5-Coder-14B](https://whatcanirunai.vercel.app/models/qwen2.5-coder-14b/)14.8B params | **11.3** / 16.0 GB | Q4FitsQ8Won’t fit | | [Qwen3-14B](https://whatcanirunai.vercel.app/models/qwen3-14b/)14.8B params | **11.3** / 16.0 GB | Q4FitsQ8Won’t fit | | [JanusCoder-14B](https://whatcanirunai.vercel.app/models/januscoder-14b/)14.8B params | **11.3** / 16.0 GB | Q4FitsQ8Won’t fit | | [HyperCLOVAX-SEED-Think-14B](https://whatcanirunai.vercel.app/models/hyperclovax-seed-think-14b/)14.7B params | **11.3** / 16.0 GB | Q4FitsQ8Won’t fit | | [phi-4](https://whatcanirunai.vercel.app/models/phi-4/)14.7B params | **11.2** / 16.0 GB | Q4FitsQ8Won’t fit | | [Phi-4-reasoning](https://whatcanirunai.vercel.app/models/phi-4-reasoning/)14.7B params | **11.2** / 16.0 GB | Q4FitsQ8Won’t fit | | [Phi-4-reasoning-plus](https://whatcanirunai.vercel.app/models/phi-4-reasoning-plus/)14.7B params | **11.2** / 16.0 GB | Q4FitsQ8Won’t fit | | [OLMo-2-1124-13B-Instruct](https://whatcanirunai.vercel.app/models/olmo-2-1124-13b-instruct/)13.7B params | **10.6** / 16.0 GB | Q4FitsQ8Won’t fit | | [Mistral-Nemo-Instruct-2407](https://whatcanirunai.vercel.app/models/mistral-nemo-instruct-2407/)12.2B params | **9.5** / 16.0 GB | Q4FitsQ8Tight | | [gemma-3-12b-it](https://whatcanirunai.vercel.app/models/gemma-3-12b-it/)12.2B params | **9.5** / 16.0 GB | Q4FitsQ8Tight | | [gemma-3-12b-pt](https://whatcanirunai.vercel.app/models/gemma-3-12b-pt/)12.2B params | **9.5** / 16.0 GB | Q4FitsQ8Tight | | [Mellum2.1-12B-A2.5B-Thinking](https://whatcanirunai.vercel.app/models/mellum2.1-12b-a2.5b-thinking/)12.1B params | **9.5** / 16.0 GB | Q4FitsQ8Tight | | [Mellum2-12B-A2.5B-Thinking](https://whatcanirunai.vercel.app/models/mellum2-12b-a2.5b-thinking/)12.1B params | **9.5** / 16.0 GB | Q4FitsQ8Tight | | [Mellum2-12B-A2.5B-Instruct](https://whatcanirunai.vercel.app/models/mellum2-12b-a2.5b-instruct/)12.1B params | **9.5** / 16.0 GB | Q4FitsQ8Tight | | [Mellum2-12B-A2.5B-Thinking-SFT](https://whatcanirunai.vercel.app/models/mellum2-12b-a2.5b-thinking-sft/)12.1B params | **9.5** / 16.0 GB | Q4FitsQ8Tight | | [Mellum2.1-12B-A2.5B-Thinking-MTP](https://whatcanirunai.vercel.app/models/mellum2.1-12b-a2.5b-thinking-mtp/)12.1B params | **9.5** / 16.0 GB | Q4FitsQ8Tight | | [Gemma 4 12B](https://whatcanirunai.vercel.app/models/gemma-4-12b-it/)12.0B params | **9.3** / 16.0 GB | Q4FitsQ8Tight | | [HyperCLOVAX-SEED-Omni-8B](https://whatcanirunai.vercel.app/models/hyperclovax-seed-omni-8b/)10.7B params | **8.5** / 16.0 GB | Q4FitsQ8Fits | | [Llama-3.2-11B-Vision-Instruct](https://whatcanirunai.vercel.app/models/llama-3.2-11b-vision-instruct/)10.7B params | **8.4** / 16.0 GB | Q4FitsQ8Fits | | [Llama-3.2-11B-Vision](https://whatcanirunai.vercel.app/models/llama-3.2-11b-vision/)10.6B params | **8.4** / 16.0 GB | Q4FitsQ8Fits | | [Falcon3-10B-Instruct](https://whatcanirunai.vercel.app/models/falcon3-10b-instruct/)10.3B params | **8.2** / 16.0 GB | Q4FitsQ8Fits | | [GLM-4.1V-9B-Thinking](https://whatcanirunai.vercel.app/models/glm-4.1v-9b-thinking/)10.3B params | **8.2** / 16.0 GB | Q4FitsQ8Fits | | [GLM-4.6V-Flash](https://whatcanirunai.vercel.app/models/glm-4.6v-flash/)10.3B params | **8.2** / 16.0 GB | Q4FitsQ8Fits | | [GLM-4.1V-9B-Base](https://whatcanirunai.vercel.app/models/glm-4.1v-9b-base/)10.3B params | **8.2** / 16.0 GB | Q4FitsQ8Fits | | [Glyph](https://whatcanirunai.vercel.app/models/glyph/)10.3B params | **8.2** / 16.0 GB | Q4FitsQ8Fits | | [INTELLECT-1-Instruct](https://whatcanirunai.vercel.app/models/intellect-1-instruct/)10.2B params | **8.1** / 16.0 GB | Q4FitsQ8Fits | | [INTELLECT-1](https://whatcanirunai.vercel.app/models/intellect-1/)10.2B params | **8.1** / 16.0 GB | Q4FitsQ8Fits | | [ZAYA1-VL-8B](https://whatcanirunai.vercel.app/models/zaya1-vl-8b/)9.7B params | **7.8** / 16.0 GB | Q4FitsQ8Fits | | [SenseNova-Loop-9B-Preview](https://whatcanirunai.vercel.app/models/sensenova-loop-9b-preview/)9.7B params | **7.7** / 16.0 GB | Q4FitsQ8Fits | | [Ornith-1.5-9B](https://whatcanirunai.vercel.app/models/ornith-1.5-9b/)9.7B params | **7.7** / 16.0 GB | Q4FitsQ8Fits | | [Qwen3.5-9B](https://whatcanirunai.vercel.app/models/qwen3.5-9b/)9.7B params | **7.7** / 16.0 GB | Q4FitsQ8Fits | | [MiniCPM-SALA](https://whatcanirunai.vercel.app/models/minicpm-sala/)9.5B params | **7.6** / 16.0 GB | Q4FitsQ8Fits | | [NorthCUA-Nano](https://whatcanirunai.vercel.app/models/northcua-nano/)9.4B params | **7.6** / 16.0 GB | Q4FitsQ8Fits | | [GLM-4-9B-0414](https://whatcanirunai.vercel.app/models/glm-4-9b-0414/)9.4B params | **7.6** / 16.0 GB | Q4FitsQ8Fits | | [GLM-Z1-9B-0414](https://whatcanirunai.vercel.app/models/glm-z1-9b-0414/)9.4B params | **7.6** / 16.0 GB | Q4FitsQ8Fits | | [codegeex4-all-9b](https://whatcanirunai.vercel.app/models/codegeex4-all-9b/)9.4B params | **7.6** / 16.0 GB | Q4FitsQ8Fits | | [glm-4-9b-chat-hf](https://whatcanirunai.vercel.app/models/glm-4-9b-chat-hf/)9.4B params | **7.6** / 16.0 GB | Q4FitsQ8Fits | | [moondream3-preview](https://whatcanirunai.vercel.app/models/moondream3-preview/)9.3B params | **7.5** / 16.0 GB | Q4FitsQ8Fits | | [gemma-2-9b-it](https://whatcanirunai.vercel.app/models/gemma-2-9b-it/)9.2B params | **7.4** / 16.0 GB | Q4FitsQ8Fits | | [gemma-2-9b](https://whatcanirunai.vercel.app/models/gemma-2-9b/)9.2B params | **7.4** / 16.0 GB | Q4FitsQ8Fits | | [Gemma-SEA-LION-v3-9B-IT](https://whatcanirunai.vercel.app/models/gemma-sea-lion-v3-9b-it/)9.2B params | **7.4** / 16.0 GB | Q4FitsQ8Fits | | [EuroLLM-9B-Instruct-2512](https://whatcanirunai.vercel.app/models/eurollm-9b-instruct-2512/)9.2B params | **7.4** / 16.0 GB | Q4FitsQ8Fits | | [NVIDIA-Nemotron-Nano-9B-v2](https://whatcanirunai.vercel.app/models/nvidia-nemotron-nano-9b-v2/)8.9B params | **7.2** / 16.0 GB | Q4FitsQ8Fits | | [ZAYA1-base](https://whatcanirunai.vercel.app/models/zaya1-base/)8.8B params | **7.2** / 16.0 GB | Q4FitsQ8Fits | | [Yi-Coder-9B-Chat](https://whatcanirunai.vercel.app/models/yi-coder-9b-chat/)8.8B params | **7.2** / 16.0 GB | Q4FitsQ8Fits | | [Yi-Coder-9B](https://whatcanirunai.vercel.app/models/yi-coder-9b/)8.8B params | **7.2** / 16.0 GB | Q4FitsQ8Fits | | [internlm3-8b-instruct](https://whatcanirunai.vercel.app/models/internlm3-8b-instruct/)8.8B params | **7.1** / 16.0 GB | Q4FitsQ8Fits | | [granite-4.1-8b](https://whatcanirunai.vercel.app/models/granite-4.1-8b/)8.8B params | **7.1** / 16.0 GB | Q4FitsQ8Fits | | [granite-4.2-8b](https://whatcanirunai.vercel.app/models/granite-4.2-8b/)8.8B params | **7.1** / 16.0 GB | Q4FitsQ8Fits | | [granite-switch-4.1-8b](https://whatcanirunai.vercel.app/models/granite-switch-4.1-8b/)8.8B params | **7.1** / 16.0 GB | Q4FitsQ8Fits | | [Qwen3-VL-8B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-vl-8b-instruct/)8.8B params | **7.1** / 16.0 GB | Q4FitsQ8Fits | | [Qwen3-VL-8B-Thinking](https://whatcanirunai.vercel.app/models/qwen3-vl-8b-thinking/)8.8B params | **7.1** / 16.0 GB | Q4FitsQ8Fits | | [UI-Venus-1.5-8B](https://whatcanirunai.vercel.app/models/ui-venus-1.5-8b/)8.8B params | **7.1** / 16.0 GB | Q4FitsQ8Fits | | [Llama-3.1-Nemotron-Nano-VL-8B-V1](https://whatcanirunai.vercel.app/models/llama-3.1-nemotron-nano-vl-8b-v1/)8.7B params | **7.1** / 16.0 GB | Q4FitsQ8Fits | | [MiniCPM-V-4\_5](https://whatcanirunai.vercel.app/models/minicpm-v-4-5/)8.7B params | **7.1** / 16.0 GB | Q4FitsQ8Fits | | [aya-vision-8b](https://whatcanirunai.vercel.app/models/aya-vision-8b/)8.6B params | **7.0** / 16.0 GB | Q4FitsQ8Fits | | [Intern-S1-mini](https://whatcanirunai.vercel.app/models/intern-s1-mini/)8.5B params | **7.0** / 16.0 GB | Q4FitsQ8Fits | | [Nemotron-Labs-Diffusion-8B-Base](https://whatcanirunai.vercel.app/models/nemotron-labs-diffusion-8b-base/)8.5B params | **6.9** / 16.0 GB | Q4FitsQ8Fits | | [LFM2.5-8B-A1B](https://whatcanirunai.vercel.app/models/lfm2.5-8b-a1b/)8.5B params | **6.9** / 16.0 GB | Q4FitsQ8Fits | | [Mistral-NeMo-Minitron-8B-Base](https://whatcanirunai.vercel.app/models/mistral-nemo-minitron-8b-base/)8.4B params | **6.9** / 16.0 GB | Q4FitsQ8Fits | | [LFM2-8B-A1B](https://whatcanirunai.vercel.app/models/lfm2-8b-a1b/)8.3B params | **6.8** / 16.0 GB | Q4FitsQ8Fits | | [rnj-1-instruct](https://whatcanirunai.vercel.app/models/rnj-1-instruct/)8.3B params | **6.8** / 16.0 GB | Q4FitsQ8Fits | | [MiMo-VL-7B-RL-2508](https://whatcanirunai.vercel.app/models/mimo-vl-7b-rl-2508/)8.3B params | **6.8** / 16.0 GB | Q4FitsQ8Fits | | [MiMo-VL-7B-RL](https://whatcanirunai.vercel.app/models/mimo-vl-7b-rl/)8.3B params | **6.8** / 16.0 GB | Q4FitsQ8Fits | | [MiMo-Embodied-7B](https://whatcanirunai.vercel.app/models/mimo-embodied-7b/)8.3B params | **6.8** / 16.0 GB | Q4FitsQ8Fits | | [MiMo-VL-7B-SFT](https://whatcanirunai.vercel.app/models/mimo-vl-7b-sft/)8.3B params | **6.8** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2.5-VL-7B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-vl-7b-instruct/)8.3B params | **6.8** / 16.0 GB | Q4FitsQ8Fits | | [UI-TARS-1.5-7B](https://whatcanirunai.vercel.app/models/ui-tars-1.5-7b/)8.3B params | **6.8** / 16.0 GB | Q4FitsQ8Fits | | [Fara-7B](https://whatcanirunai.vercel.app/models/fara-7b/)8.3B params | **6.8** / 16.0 GB | Q4FitsQ8Fits | | [UI-Venus-Ground-7B](https://whatcanirunai.vercel.app/models/ui-venus-ground-7b/)8.3B params | **6.8** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2-VL-7B-Instruct](https://whatcanirunai.vercel.app/models/qwen2-vl-7b-instruct/)8.3B params | **6.8** / 16.0 GB | Q4FitsQ8Fits | | [UI-TARS-7B-DPO](https://whatcanirunai.vercel.app/models/ui-tars-7b-dpo/)8.3B params | **6.8** / 16.0 GB | Q4FitsQ8Fits | | [UI-TARS-7B-SFT](https://whatcanirunai.vercel.app/models/ui-tars-7b-sft/)8.3B params | **6.8** / 16.0 GB | Q4FitsQ8Fits | | [Seed-Coder-8B-Instruct](https://whatcanirunai.vercel.app/models/seed-coder-8b-instruct/)8.3B params | **6.8** / 16.0 GB | Q4FitsQ8Fits | | [Seed-Coder-8B-Reasoning](https://whatcanirunai.vercel.app/models/seed-coder-8b-reasoning/)8.3B params | **6.8** / 16.0 GB | Q4FitsQ8Fits | | [Stable-DiffCoder-8B-Instruct](https://whatcanirunai.vercel.app/models/stable-diffcoder-8b-instruct/)8.3B params | **6.8** / 16.0 GB | Q4FitsQ8Fits | | [Qwen3-8B](https://whatcanirunai.vercel.app/models/qwen3-8b/)8.2B params | **6.7** / 16.0 GB | Q4FitsQ8Fits | | [DeepSeek-R1-0528-Qwen3-8B](https://whatcanirunai.vercel.app/models/deepseek-r1-0528-qwen3-8b/)8.2B params | **6.7** / 16.0 GB | Q4FitsQ8Fits | | [Qwen3-8B-Base](https://whatcanirunai.vercel.app/models/qwen3-8b-base/)8.2B params | **6.7** / 16.0 GB | Q4FitsQ8Fits | | [WeDLM-8B-Instruct](https://whatcanirunai.vercel.app/models/wedlm-8b-instruct/)8.2B params | **6.7** / 16.0 GB | Q4FitsQ8Fits | | [PaCoRe-8B](https://whatcanirunai.vercel.app/models/pacore-8b/)8.2B params | **6.7** / 16.0 GB | Q4FitsQ8Fits | | [MiniCPM4-8B](https://whatcanirunai.vercel.app/models/minicpm4-8b/)8.2B params | **6.7** / 16.0 GB | Q4FitsQ8Fits | | [MiniCPM4.1-8B](https://whatcanirunai.vercel.app/models/minicpm4.1-8b/)8.2B params | **6.7** / 16.0 GB | Q4FitsQ8Fits | | [AgentCPM-Report](https://whatcanirunai.vercel.app/models/agentcpm-report/)8.2B params | **6.7** / 16.0 GB | Q4FitsQ8Fits | | [MiniCPM4-MCP](https://whatcanirunai.vercel.app/models/minicpm4-mcp/)8.2B params | **6.7** / 16.0 GB | Q4FitsQ8Fits | | [granite-3.3-8b-instruct](https://whatcanirunai.vercel.app/models/granite-3.3-8b-instruct/)8.2B params | **6.7** / 16.0 GB | Q4FitsQ8Fits | | [granite-3.1-8b-instruct](https://whatcanirunai.vercel.app/models/granite-3.1-8b-instruct/)8.2B params | **6.7** / 16.0 GB | Q4FitsQ8Fits | | [granite-3.2-8b-instruct](https://whatcanirunai.vercel.app/models/granite-3.2-8b-instruct/)8.2B params | **6.7** / 16.0 GB | Q4FitsQ8Fits | | [granite-3.0-8b-instruct](https://whatcanirunai.vercel.app/models/granite-3.0-8b-instruct/)8.2B params | **6.7** / 16.0 GB | Q4FitsQ8Fits | | [Apertus-8B-Instruct-2509](https://whatcanirunai.vercel.app/models/apertus-8b-instruct-2509/)8.1B params | **6.6** / 16.0 GB | Q4FitsQ8Fits | | [Apertus-8B-2509](https://whatcanirunai.vercel.app/models/apertus-8b-2509/)8.1B params | **6.6** / 16.0 GB | Q4FitsQ8Fits | | [Llama-3.1-Tulu-3-8B](https://whatcanirunai.vercel.app/models/llama-3.1-tulu-3-8b/)8.0B params | **6.6** / 16.0 GB | Q4FitsQ8Fits | | [Llama-3.1-Tulu-3-8B-DPO](https://whatcanirunai.vercel.app/models/llama-3.1-tulu-3-8b-dpo/)8.0B params | **6.6** / 16.0 GB | Q4FitsQ8Fits | | [Llama-3.1-Tulu-3.1-8B](https://whatcanirunai.vercel.app/models/llama-3.1-tulu-3.1-8b/)8.0B params | **6.6** / 16.0 GB | Q4FitsQ8Fits | | [kanana-1.5-8b-instruct-2505](https://whatcanirunai.vercel.app/models/kanana-1.5-8b-instruct-2505/)8.0B params | **6.6** / 16.0 GB | Q4FitsQ8Fits | | [Llama-3.1-8B-Instruct](https://whatcanirunai.vercel.app/models/llama-3.1-8b-instruct/)8.0B params | **6.6** / 16.0 GB | Q4FitsQ8Fits | | [Llama-3.1-8B](https://whatcanirunai.vercel.app/models/llama-3.1-8b/)8.0B params | **6.6** / 16.0 GB | Q4FitsQ8Fits | | [DeepSeek-R1-Distill-Llama-8B](https://whatcanirunai.vercel.app/models/deepseek-r1-distill-llama-8b/)8.0B params | **6.6** / 16.0 GB | Q4FitsQ8Fits | | [Meta-Llama-3.1-8B-Instruct](https://whatcanirunai.vercel.app/models/meta-llama-3.1-8b-instruct/)8.0B params | **6.6** / 16.0 GB | Q4FitsQ8Fits | | [L3-8B-Stheno-v3.2](https://whatcanirunai.vercel.app/models/l3-8b-stheno-v3.2/)8.0B params | **6.6** / 16.0 GB | Q4FitsQ8Fits | | [Llama-3.1-Nemotron-Nano-8B-v1](https://whatcanirunai.vercel.app/models/llama-3.1-nemotron-nano-8b-v1/)8.0B params | **6.6** / 16.0 GB | Q4FitsQ8Fits | | [Meta-Llama-3.1-8B](https://whatcanirunai.vercel.app/models/meta-llama-3.1-8b/)8.0B params | **6.6** / 16.0 GB | Q4FitsQ8Fits | | [LongWriter-llama3.1-8b](https://whatcanirunai.vercel.app/models/longwriter-llama3.1-8b/)8.0B params | **6.6** / 16.0 GB | Q4FitsQ8Fits | | [Hy-MT2-7B](https://whatcanirunai.vercel.app/models/hy-mt2-7b/)8.0B params | **6.6** / 16.0 GB | Q4FitsQ8Fits | | [Nemotron 3.5 Bolt E4B](https://whatcanirunai.vercel.app/models/nemotron-3.5-bolt-e4b/)8.0B params | **6.6** / 16.0 GB | Q4FitsQ8Fits | | [Gemma 4 E4B](https://whatcanirunai.vercel.app/models/gemma-4-e4b-it/)8.0B params | **6.6** / 16.0 GB | Q4FitsQ8Fits | | [Ling-3.0-tiny](https://whatcanirunai.vercel.app/models/ling-3.0-tiny/)7.9B params | **6.5** / 16.0 GB | Q4FitsQ8Fits | | [MiMo-7B-RL](https://whatcanirunai.vercel.app/models/mimo-7b-rl/)7.8B params | **6.5** / 16.0 GB | Q4FitsQ8Fits | | [MiMo-7B-Base](https://whatcanirunai.vercel.app/models/mimo-7b-base/)7.8B params | **6.5** / 16.0 GB | Q4FitsQ8Fits | | [MiMo-7B-RL-0530](https://whatcanirunai.vercel.app/models/mimo-7b-rl-0530/)7.8B params | **6.5** / 16.0 GB | Q4FitsQ8Fits | | [MiMo-7B-SFT](https://whatcanirunai.vercel.app/models/mimo-7b-sft/)7.8B params | **6.5** / 16.0 GB | Q4FitsQ8Fits | | [EXAONE-3.5-7.8B-Instruct](https://whatcanirunai.vercel.app/models/exaone-3.5-7.8b-instruct/)7.8B params | **6.5** / 16.0 GB | Q4FitsQ8Fits | | [EXAONE-Deep-7.8B](https://whatcanirunai.vercel.app/models/exaone-deep-7.8b/)7.8B params | **6.5** / 16.0 GB | Q4FitsQ8Fits | | [salamandra-7b-instruct](https://whatcanirunai.vercel.app/models/salamandra-7b-instruct/)7.8B params | **6.4** / 16.0 GB | Q4FitsQ8Fits | | [salamandra-7b](https://whatcanirunai.vercel.app/models/salamandra-7b/)7.8B params | **6.4** / 16.0 GB | Q4FitsQ8Fits | | [salamandra-7b-instruct-2606](https://whatcanirunai.vercel.app/models/salamandra-7b-instruct-2606/)7.8B params | **6.4** / 16.0 GB | Q4FitsQ8Fits | | [FastVLM-7B](https://whatcanirunai.vercel.app/models/fastvlm-7b/)7.8B params | **6.4** / 16.0 GB | Q4FitsQ8Fits | | [Molmo2-O-7B](https://whatcanirunai.vercel.app/models/molmo2-o-7b/)7.8B params | **6.4** / 16.0 GB | Q4FitsQ8Fits | | [internlm2\_5-7b-chat](https://whatcanirunai.vercel.app/models/internlm2-5-7b-chat/)7.7B params | **6.4** / 16.0 GB | Q4FitsQ8Fits | | [internlm2\_5-7b-chat-1m](https://whatcanirunai.vercel.app/models/internlm2-5-7b-chat-1m/)7.7B params | **6.4** / 16.0 GB | Q4FitsQ8Fits | | [Phi-mini-MoE-instruct](https://whatcanirunai.vercel.app/models/phi-mini-moe-instruct/)7.6B params | **6.3** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2.5-Coder-7B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-coder-7b-instruct/)7.6B params | **6.3** / 16.0 GB | Q4FitsQ8Fits | | [DeepSeek-R1-Distill-Qwen-7B](https://whatcanirunai.vercel.app/models/deepseek-r1-distill-qwen-7b/)7.6B params | **6.3** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2.5-7B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-7b-instruct/)7.6B params | **6.3** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2.5-7B](https://whatcanirunai.vercel.app/models/qwen2.5-7b/)7.6B params | **6.3** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2-7B-Instruct](https://whatcanirunai.vercel.app/models/qwen2-7b-instruct/)7.6B params | **6.3** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2.5-Coder-7B](https://whatcanirunai.vercel.app/models/qwen2.5-coder-7b/)7.6B params | **6.3** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2-7B](https://whatcanirunai.vercel.app/models/qwen2-7b/)7.6B params | **6.3** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2.5-7B-Instruct-1M](https://whatcanirunai.vercel.app/models/qwen2.5-7b-instruct-1m/)7.6B params | **6.3** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2.5-Math-7B](https://whatcanirunai.vercel.app/models/qwen2.5-math-7b/)7.6B params | **6.3** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2.5-Math-7B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-math-7b-instruct/)7.6B params | **6.3** / 16.0 GB | Q4FitsQ8Fits | | [Marco-o1](https://whatcanirunai.vercel.app/models/marco-o1/)7.6B params | **6.3** / 16.0 GB | Q4FitsQ8Fits | | [SeaLLMs-v3-7B-Chat](https://whatcanirunai.vercel.app/models/seallms-v3-7b-chat/)7.6B params | **6.3** / 16.0 GB | Q4FitsQ8Fits | | [Arcee-Spark](https://whatcanirunai.vercel.app/models/arcee-spark/)7.6B params | **6.3** / 16.0 GB | Q4FitsQ8Fits | | [Falcon-H1-7B-Instruct](https://whatcanirunai.vercel.app/models/falcon-h1-7b-instruct/)7.6B params | **6.3** / 16.0 GB | Q4FitsQ8Fits | | [Falcon-H1R-7B](https://whatcanirunai.vercel.app/models/falcon-h1r-7b/)7.6B params | **6.3** / 16.0 GB | Q4FitsQ8Fits | | [starvector-8b-im2svg](https://whatcanirunai.vercel.app/models/starvector-8b-im2svg/)7.5B params | **6.2** / 16.0 GB | Q4FitsQ8Fits | | [Falcon3-7B-Instruct](https://whatcanirunai.vercel.app/models/falcon3-7b-instruct/)7.5B params | **6.2** / 16.0 GB | Q4FitsQ8Fits | | [Olmo-Hybrid-7B](https://whatcanirunai.vercel.app/models/olmo-hybrid-7b/)7.4B params | **6.2** / 16.0 GB | Q4FitsQ8Fits | | [LLaDA-MoE-7B-A1B-Base](https://whatcanirunai.vercel.app/models/llada-moe-7b-a1b-base/)7.4B params | **6.1** / 16.0 GB | Q4FitsQ8Fits | | [Zamba2-7B-Instruct](https://whatcanirunai.vercel.app/models/zamba2-7b-instruct/)7.4B params | **6.1** / 16.0 GB | Q4FitsQ8Fits | | [OLMo-2-1124-7B-Instruct](https://whatcanirunai.vercel.app/models/olmo-2-1124-7b-instruct/)7.3B params | **6.1** / 16.0 GB | Q4FitsQ8Fits | | [Olmo-3-7B-Think](https://whatcanirunai.vercel.app/models/olmo-3-7b-think/)7.3B params | **6.1** / 16.0 GB | Q4FitsQ8Fits | | [Olmo-3-7B-Instruct](https://whatcanirunai.vercel.app/models/olmo-3-7b-instruct/)7.3B params | **6.1** / 16.0 GB | Q4FitsQ8Fits | | [Olmo-3-1025-7B](https://whatcanirunai.vercel.app/models/olmo-3-1025-7b/)7.3B params | **6.1** / 16.0 GB | Q4FitsQ8Fits | | [Olmo-3-7B-Instruct-SFT](https://whatcanirunai.vercel.app/models/olmo-3-7b-instruct-sft/)7.3B params | **6.1** / 16.0 GB | Q4FitsQ8Fits | | [Olmo-3-7B-Think-SFT](https://whatcanirunai.vercel.app/models/olmo-3-7b-think-sft/)7.3B params | **6.1** / 16.0 GB | Q4FitsQ8Fits | | [Olmo-3-7B-Instruct-DPO](https://whatcanirunai.vercel.app/models/olmo-3-7b-instruct-dpo/)7.3B params | **6.1** / 16.0 GB | Q4FitsQ8Fits | | [Olmo-3-7B-RL-Zero-Math](https://whatcanirunai.vercel.app/models/olmo-3-7b-rl-zero-math/)7.3B params | **6.1** / 16.0 GB | Q4FitsQ8Fits | | [Olmo-3.1-7B-RL-Zero-Math](https://whatcanirunai.vercel.app/models/olmo-3.1-7b-rl-zero-math/)7.3B params | **6.1** / 16.0 GB | Q4FitsQ8Fits | | [Olmo-3-7B-Think-DPO](https://whatcanirunai.vercel.app/models/olmo-3-7b-think-dpo/)7.3B params | **6.1** / 16.0 GB | Q4FitsQ8Fits | | [Mistral-7B-Instruct-v0.3](https://whatcanirunai.vercel.app/models/mistral-7b-instruct-v0.3/)7.2B params | **6.1** / 16.0 GB | Q4FitsQ8Fits | | [granite-4.0-h-tiny](https://whatcanirunai.vercel.app/models/granite-4.0-h-tiny/)6.9B params | **5.8** / 16.0 GB | Q4FitsQ8Fits | | [OLMoE-1B-7B-0924-Instruct](https://whatcanirunai.vercel.app/models/olmoe-1b-7b-0924-instruct/)6.9B params | **5.8** / 16.0 GB | Q4FitsQ8Fits | | [OLMoE-1B-7B-0924](https://whatcanirunai.vercel.app/models/olmoe-1b-7b-0924/)6.9B params | **5.8** / 16.0 GB | Q4FitsQ8Fits | | [OLMoE-1B-7B-0125-Instruct](https://whatcanirunai.vercel.app/models/olmoe-1b-7b-0125-instruct/)6.9B params | **5.8** / 16.0 GB | Q4FitsQ8Fits | | [OLMoE-1B-7B-0125](https://whatcanirunai.vercel.app/models/olmoe-1b-7b-0125/)6.9B params | **5.8** / 16.0 GB | Q4FitsQ8Fits | | [OLMo-7B-0724-hf](https://whatcanirunai.vercel.app/models/olmo-7b-0724-hf/)6.9B params | **5.8** / 16.0 GB | Q4FitsQ8Fits | | [granite-4.0-tiny-preview](https://whatcanirunai.vercel.app/models/granite-4.0-tiny-preview/)6.7B params | **5.7** / 16.0 GB | Q4FitsQ8Fits | | [YuE-s1-7B-anneal-en-cot](https://whatcanirunai.vercel.app/models/yue-s1-7b-anneal-en-cot/)6.2B params | **5.3** / 16.0 GB | Q4FitsQ8Fits | | [Trinity-Nano-Preview](https://whatcanirunai.vercel.app/models/trinity-nano-preview/)6.1B params | **5.3** / 16.0 GB | Q4FitsQ8Fits | | [Trinity-Nano-Base](https://whatcanirunai.vercel.app/models/trinity-nano-base/)6.1B params | **5.3** / 16.0 GB | Q4FitsQ8Fits | | [gemma-3n-E2B-it](https://whatcanirunai.vercel.app/models/gemma-3n-e2b-it/)5.4B params | **4.8** / 16.0 GB | Q4FitsQ8Fits | | [Youtu-VL-4B-Instruct](https://whatcanirunai.vercel.app/models/youtu-vl-4b-instruct/)5.3B params | **4.7** / 16.0 GB | Q4FitsQ8Fits | | [Gemma 4 E2B](https://whatcanirunai.vercel.app/models/gemma-4-e2b-it/)5.1B params | **4.6** / 16.0 GB | Q4FitsQ8Fits | | [Molmo2-ER](https://whatcanirunai.vercel.app/models/molmo2-er/)4.9B params | **4.4** / 16.0 GB | Q4FitsQ8Fits | | [Apriel-5B-Instruct](https://whatcanirunai.vercel.app/models/apriel-5b-instruct/)4.8B params | **4.4** / 16.0 GB | Q4FitsQ8Fits | | [WeVisOne-VL-4B](https://whatcanirunai.vercel.app/models/wevisone-vl-4b/)4.8B params | **4.4** / 16.0 GB | Q4FitsQ8Fits | | [Mage-VL](https://whatcanirunai.vercel.app/models/mage-vl/)4.7B params | **4.3** / 16.0 GB | Q4FitsQ8Fits | | [Mage-VL-Cowork](https://whatcanirunai.vercel.app/models/mage-vl-cowork/)4.7B params | **4.3** / 16.0 GB | Q4FitsQ8Fits | | [Qwen3.5-4B](https://whatcanirunai.vercel.app/models/qwen3.5-4b/)4.7B params | **4.2** / 16.0 GB | Q4FitsQ8Fits | | [S5-nano](https://whatcanirunai.vercel.app/models/s5-nano/)4.7B params | **4.2** / 16.0 GB | Q4FitsQ8Fits | | [AFM-4.5B](https://whatcanirunai.vercel.app/models/afm-4.5b/)4.6B params | **4.2** / 16.0 GB | Q4FitsQ8Fits | | [Llama-3.1-Minitron-4B-Width-Base](https://whatcanirunai.vercel.app/models/llama-3.1-minitron-4b-width-base/)4.5B params | **4.1** / 16.0 GB | Q4FitsQ8Fits | | [Qwen3-VL-4B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-vl-4b-instruct/)4.4B params | **4.1** / 16.0 GB | Q4FitsQ8Fits | | [CapRL-Qwen3VL-4B](https://whatcanirunai.vercel.app/models/caprl-qwen3vl-4b/)4.4B params | **4.1** / 16.0 GB | Q4FitsQ8Fits | | [glm-edge-4b-chat](https://whatcanirunai.vercel.app/models/glm-edge-4b-chat/)4.3B params | **4.0** / 16.0 GB | Q4FitsQ8Fits | | [gemma-3-4b-it](https://whatcanirunai.vercel.app/models/gemma-3-4b-it/)4.3B params | **4.0** / 16.0 GB | Q4FitsQ8Fits | | [medgemma-4b-it](https://whatcanirunai.vercel.app/models/medgemma-4b-it/)4.3B params | **4.0** / 16.0 GB | Q4FitsQ8Fits | | [medgemma-1.5-4b-it](https://whatcanirunai.vercel.app/models/medgemma-1.5-4b-it/)4.3B params | **4.0** / 16.0 GB | Q4FitsQ8Fits | | [gemma-3-4b-pt](https://whatcanirunai.vercel.app/models/gemma-3-4b-pt/)4.3B params | **4.0** / 16.0 GB | Q4FitsQ8Fits | | [Nanbeige4.2-3B](https://whatcanirunai.vercel.app/models/nanbeige4.2-3b/)4.2B params | **3.9** / 16.0 GB | Q4FitsQ8Fits | | [Phi-3.5-vision-instruct](https://whatcanirunai.vercel.app/models/phi-3.5-vision-instruct/)4.1B params | **3.9** / 16.0 GB | Q4FitsQ8Fits | | [Spark-X2.6-4B](https://whatcanirunai.vercel.app/models/spark-x2.6-4b/)4.1B params | **3.9** / 16.0 GB | Q4FitsQ8Fits | | [Spark-X2.5-4B](https://whatcanirunai.vercel.app/models/spark-x2.5-4b/)4.1B params | **3.9** / 16.0 GB | Q4FitsQ8Fits | | [POINTS-Reader](https://whatcanirunai.vercel.app/models/points-reader/)4.1B params | **3.9** / 16.0 GB | Q4FitsQ8Fits | | [MiniCPM-V-4](https://whatcanirunai.vercel.app/models/minicpm-v-4/)4.1B params | **3.8** / 16.0 GB | Q4FitsQ8Fits | | [Qwen3-4B](https://whatcanirunai.vercel.app/models/qwen3-4b/)4.0B params | **3.8** / 16.0 GB | Q4FitsQ8Fits | | [Qwen3-4B-Instruct-2507](https://whatcanirunai.vercel.app/models/qwen3-4b-instruct-2507/)4.0B params | **3.8** / 16.0 GB | Q4FitsQ8Fits | | [Qwen3-4B-Thinking-2507](https://whatcanirunai.vercel.app/models/qwen3-4b-thinking-2507/)4.0B params | **3.8** / 16.0 GB | Q4FitsQ8Fits | | [Mellum-4b-base](https://whatcanirunai.vercel.app/models/mellum-4b-base/)4.0B params | **3.8** / 16.0 GB | Q4FitsQ8Fits | | [granite-4.0-3b-vision](https://whatcanirunai.vercel.app/models/granite-4.0-3b-vision/)4.0B params | **3.8** / 16.0 GB | Q4FitsQ8Fits | | [granite-vision-4.1-4b](https://whatcanirunai.vercel.app/models/granite-vision-4.1-4b/)4.0B params | **3.8** / 16.0 GB | Q4FitsQ8Fits | | [Nemotron Labs Dory 1.0 4B](https://whatcanirunai.vercel.app/models/nemotron-labs-dory1.0-4b/)4.0B params | **3.8** / 16.0 GB | Q4FitsQ8Fits | | [NVIDIA-Nemotron-3-Nano-4B-BF16](https://whatcanirunai.vercel.app/models/nvidia-nemotron-3-nano-4b-bf16/)4.0B params | **3.8** / 16.0 GB | Q4FitsQ8Fits | | [Nanbeige4.1-3B](https://whatcanirunai.vercel.app/models/nanbeige4.1-3b/)3.9B params | **3.7** / 16.0 GB | Q4FitsQ8Fits | | [Nanbeige4-3B-Thinking-2511](https://whatcanirunai.vercel.app/models/nanbeige4-3b-thinking-2511/)3.9B params | **3.7** / 16.0 GB | Q4FitsQ8Fits | | [Phi-4-mini-flash-reasoning](https://whatcanirunai.vercel.app/models/phi-4-mini-flash-reasoning/)3.9B params | **3.7** / 16.0 GB | Q4FitsQ8Fits | | [Phi-4-mini-instruct](https://whatcanirunai.vercel.app/models/phi-4-mini-instruct/)3.8B params | **3.7** / 16.0 GB | Q4FitsQ8Fits | | [Phi-4-mini-reasoning](https://whatcanirunai.vercel.app/models/phi-4-mini-reasoning/)3.8B params | **3.7** / 16.0 GB | Q4FitsQ8Fits | | [Nemotron-Labs-Diffusion-3B](https://whatcanirunai.vercel.app/models/nemotron-labs-diffusion-3b/)3.8B params | **3.7** / 16.0 GB | Q4FitsQ8Fits | | [Phi-3.5-mini-instruct](https://whatcanirunai.vercel.app/models/phi-3.5-mini-instruct/)3.8B params | **3.7** / 16.0 GB | Q4FitsQ8Fits | | [MediPhi-Instruct](https://whatcanirunai.vercel.app/models/mediphi-instruct/)3.8B params | **3.7** / 16.0 GB | Q4FitsQ8Fits | | [MediPhi](https://whatcanirunai.vercel.app/models/mediphi/)3.8B params | **3.7** / 16.0 GB | Q4FitsQ8Fits | | [MediPhi-Clinical](https://whatcanirunai.vercel.app/models/mediphi-clinical/)3.8B params | **3.7** / 16.0 GB | Q4FitsQ8Fits | | [MediPhi-PubMed](https://whatcanirunai.vercel.app/models/mediphi-pubmed/)3.8B params | **3.7** / 16.0 GB | Q4FitsQ8Fits | | [HY-Embodied-0.5](https://whatcanirunai.vercel.app/models/hy-embodied-0.5/)3.8B params | **3.6** / 16.0 GB | Q4FitsQ8Fits | | [Phi-tiny-MoE-instruct](https://whatcanirunai.vercel.app/models/phi-tiny-moe-instruct/)3.8B params | **3.6** / 16.0 GB | Q4FitsQ8Fits | | [CapRL-3B](https://whatcanirunai.vercel.app/models/caprl-3b/)3.8B params | **3.6** / 16.0 GB | Q4FitsQ8Fits | | [HyperCLOVAX-SEED-Vision-Instruct-3B](https://whatcanirunai.vercel.app/models/hyperclovax-seed-vision-instruct-3b/)3.7B params | **3.6** / 16.0 GB | Q4FitsQ8Fits | | [kanana-1.5-v-3b-instruct](https://whatcanirunai.vercel.app/models/kanana-1.5-v-3b-instruct/)3.7B params | **3.6** / 16.0 GB | Q4FitsQ8Fits | | [granite-4.2-3b](https://whatcanirunai.vercel.app/models/granite-4.2-3b/)3.7B params | **3.6** / 16.0 GB | Q4FitsQ8Fits | | [kanana-2-3b-instruct](https://whatcanirunai.vercel.app/models/kanana-2-3b-instruct/)3.5B params | **3.4** / 16.0 GB | Q4FitsQ8Fits | | [granite-4.1-3b](https://whatcanirunai.vercel.app/models/granite-4.1-3b/)3.4B params | **3.4** / 16.0 GB | Q4FitsQ8Fits | | [granite-4.0-micro](https://whatcanirunai.vercel.app/models/granite-4.0-micro/)3.4B params | **3.4** / 16.0 GB | Q4FitsQ8Fits | | [granite-3.1-3b-a800m-instruct](https://whatcanirunai.vercel.app/models/granite-3.1-3b-a800m-instruct/)3.3B params | **3.3** / 16.0 GB | Q4FitsQ8Fits | | [Falcon3-3B-Instruct](https://whatcanirunai.vercel.app/models/falcon3-3b-instruct/)3.2B params | **3.3** / 16.0 GB | Q4FitsQ8Fits | | [Llama-3.2-3B-Instruct](https://whatcanirunai.vercel.app/models/llama-3.2-3b-instruct/)3.2B params | **3.2** / 16.0 GB | Q4FitsQ8Fits | | [Llama-3.2-3B](https://whatcanirunai.vercel.app/models/llama-3.2-3b/)3.2B params | **3.2** / 16.0 GB | Q4FitsQ8Fits | | [Hermes-3-Llama-3.2-3B](https://whatcanirunai.vercel.app/models/hermes-3-llama-3.2-3b/)3.2B params | **3.2** / 16.0 GB | Q4FitsQ8Fits | | [DeepHermes-3-Llama-3-3B-Preview](https://whatcanirunai.vercel.app/models/deephermes-3-llama-3-3b-preview/)3.2B params | **3.2** / 16.0 GB | Q4FitsQ8Fits | | [AI21-Jamba-Reasoning-3B](https://whatcanirunai.vercel.app/models/ai21-jamba-reasoning-3b/)3.2B params | **3.2** / 16.0 GB | Q4FitsQ8Fits | | [granite-4.0-h-micro](https://whatcanirunai.vercel.app/models/granite-4.0-h-micro/)3.2B params | **3.2** / 16.0 GB | Q4FitsQ8Fits | | [Falcon-H1-3B-Instruct](https://whatcanirunai.vercel.app/models/falcon-h1-3b-instruct/)3.1B params | **3.2** / 16.0 GB | Q4FitsQ8Fits | | [d1-3B](https://whatcanirunai.vercel.app/models/d1-3b/)3.1B params | **3.2** / 16.0 GB | Q4FitsQ8Fits | | [LFM2.5-VL-3B](https://whatcanirunai.vercel.app/models/lfm2.5-vl-3b/)3.1B params | **3.2** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2.5-3B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-3b-instruct/)3.1B params | **3.2** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2.5-Coder-3B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-coder-3b-instruct/)3.1B params | **3.2** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2.5-3B](https://whatcanirunai.vercel.app/models/qwen2.5-3b/)3.1B params | **3.2** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2.5-Coder-3B](https://whatcanirunai.vercel.app/models/qwen2.5-coder-3b/)3.1B params | **3.2** / 16.0 GB | Q4FitsQ8Fits | | [SmolLM3-3B](https://whatcanirunai.vercel.app/models/smollm3-3b/)3.1B params | **3.1** / 16.0 GB | Q4FitsQ8Fits | | [AI21-Jamba2-3B](https://whatcanirunai.vercel.app/models/ai21-jamba2-3b/)3.0B params | **3.1** / 16.0 GB | Q4FitsQ8Fits | | [granite-swash-3b-a600m](https://whatcanirunai.vercel.app/models/granite-swash-3b-a600m/)3.0B params | **3.1** / 16.0 GB | Q4FitsQ8Fits | | [granite-vision-3.2-2b](https://whatcanirunai.vercel.app/models/granite-vision-3.2-2b/)3.0B params | **3.1** / 16.0 GB | Q4FitsQ8Fits | | [granite-vision-3.1-2b-preview](https://whatcanirunai.vercel.app/models/granite-vision-3.1-2b-preview/)3.0B params | **3.1** / 16.0 GB | Q4FitsQ8Fits | | [granite-vision-3.3-2b-chart2csv-preview](https://whatcanirunai.vercel.app/models/granite-vision-3.3-2b-chart2csv-preview/)3.0B params | **3.1** / 16.0 GB | Q4FitsQ8Fits | | [LFM2.5-2.6B](https://whatcanirunai.vercel.app/models/lfm2.5-2.6b/)2.7B params | **2.9** / 16.0 GB | Q4FitsQ8Fits | | [Zamba2-2.7B](https://whatcanirunai.vercel.app/models/zamba2-2.7b/)2.7B params | **2.9** / 16.0 GB | Q4FitsQ8Fits | | [Zamba2-2.7B-instruct](https://whatcanirunai.vercel.app/models/zamba2-2.7b-instruct/)2.7B params | **2.9** / 16.0 GB | Q4FitsQ8Fits | | [granite-3.0-2b-instruct](https://whatcanirunai.vercel.app/models/granite-3.0-2b-instruct/)2.6B params | **2.8** / 16.0 GB | Q4FitsQ8Fits | | [gemma-2-2b-it](https://whatcanirunai.vercel.app/models/gemma-2-2b-it/)2.6B params | **2.8** / 16.0 GB | Q4FitsQ8Fits | | [gemma-2-2b](https://whatcanirunai.vercel.app/models/gemma-2-2b/)2.6B params | **2.8** / 16.0 GB | Q4FitsQ8Fits | | [EuroMoE-2.6B-A0.6B-Instruct-Preview](https://whatcanirunai.vercel.app/models/euromoe-2.6b-a0.6b-instruct-preview/)2.6B params | **2.8** / 16.0 GB | Q4FitsQ8Fits | | [Motif-2.6B](https://whatcanirunai.vercel.app/models/motif-2.6b/)2.6B params | **2.8** / 16.0 GB | Q4FitsQ8Fits | | [LFM2-2.6B](https://whatcanirunai.vercel.app/models/lfm2-2.6b/)2.6B params | **2.8** / 16.0 GB | Q4FitsQ8Fits | | [LFM2-2.6B-Exp](https://whatcanirunai.vercel.app/models/lfm2-2.6b-exp/)2.6B params | **2.8** / 16.0 GB | Q4FitsQ8Fits | | [LFM2-2.6B-Transcript](https://whatcanirunai.vercel.app/models/lfm2-2.6b-transcript/)2.6B params | **2.8** / 16.0 GB | Q4FitsQ8Fits | | [granite-3.3-2b-instruct](https://whatcanirunai.vercel.app/models/granite-3.3-2b-instruct/)2.5B params | **2.8** / 16.0 GB | Q4FitsQ8Fits | | [granite-3.1-2b-instruct](https://whatcanirunai.vercel.app/models/granite-3.1-2b-instruct/)2.5B params | **2.8** / 16.0 GB | Q4FitsQ8Fits | | [granite-3.2-2b-instruct](https://whatcanirunai.vercel.app/models/granite-3.2-2b-instruct/)2.5B params | **2.8** / 16.0 GB | Q4FitsQ8Fits | | [MiniCPM5-2B](https://whatcanirunai.vercel.app/models/minicpm5-2b/)2.5B params | **2.8** / 16.0 GB | Q4FitsQ8Fits | | [MiniCPM5-2B-SFT](https://whatcanirunai.vercel.app/models/minicpm5-2b-sft/)2.5B params | **2.8** / 16.0 GB | Q4FitsQ8Fits | | [MiniCPM5-2B-Midtrain](https://whatcanirunai.vercel.app/models/minicpm5-2b-midtrain/)2.5B params | **2.8** / 16.0 GB | Q4FitsQ8Fits | | [sarvam-1-v0.5](https://whatcanirunai.vercel.app/models/sarvam-1-v0.5/)2.5B params | **2.7** / 16.0 GB | Q4FitsQ8Fits | | [North-Micro-Vision-Instruct](https://whatcanirunai.vercel.app/models/north-micro-vision-instruct/)2.5B params | **2.7** / 16.0 GB | Q4FitsQ8Fits | | [UI-TARS-2B-SFT](https://whatcanirunai.vercel.app/models/ui-tars-2b-sft/)2.4B params | **2.7** / 16.0 GB | Q4FitsQ8Fits | | [WeVisOne-VL-2B](https://whatcanirunai.vercel.app/models/wevisone-vl-2b/)2.4B params | **2.7** / 16.0 GB | Q4FitsQ8Fits | | [UI-Venus-1.5-2B](https://whatcanirunai.vercel.app/models/ui-venus-1.5-2b/)2.4B params | **2.7** / 16.0 GB | Q4FitsQ8Fits | | [bitnet-b1.58-2B-4T-bf16](https://whatcanirunai.vercel.app/models/bitnet-b1.58-2b-4t-bf16/)2.4B params | **2.7** / 16.0 GB | Q4FitsQ8Fits | | [EXAONE-3.5-2.4B-Instruct](https://whatcanirunai.vercel.app/models/exaone-3.5-2.4b-instruct/)2.4B params | **2.7** / 16.0 GB | Q4FitsQ8Fits | | [EXAONE-Deep-2.4B](https://whatcanirunai.vercel.app/models/exaone-deep-2.4b/)2.4B params | **2.7** / 16.0 GB | Q4FitsQ8Fits | | [kanana-1.5-2.1b-instruct-2505](https://whatcanirunai.vercel.app/models/kanana-1.5-2.1b-instruct-2505/)2.3B params | **2.6** / 16.0 GB | Q4FitsQ8Fits | | [Qwen3.5-2B](https://whatcanirunai.vercel.app/models/qwen3.5-2b/)2.3B params | **2.6** / 16.0 GB | Q4FitsQ8Fits | | [salamandra-2b](https://whatcanirunai.vercel.app/models/salamandra-2b/)2.3B params | **2.6** / 16.0 GB | Q4FitsQ8Fits | | [salamandra-2b-instruct](https://whatcanirunai.vercel.app/models/salamandra-2b-instruct/)2.3B params | **2.6** / 16.0 GB | Q4FitsQ8Fits | | [SmolVLM2-2.2B-Instruct](https://whatcanirunai.vercel.app/models/smolvlm2-2.2b-instruct/)2.2B params | **2.6** / 16.0 GB | Q4FitsQ8Fits | | [SmolVLM-Base](https://whatcanirunai.vercel.app/models/smolvlm-base/)2.2B params | **2.6** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2-VL-2B-Instruct](https://whatcanirunai.vercel.app/models/qwen2-vl-2b-instruct/)2.2B params | **2.5** / 16.0 GB | Q4FitsQ8Fits | | [LFM3-Omni-2B](https://whatcanirunai.vercel.app/models/lfm3-omni-2b/)2.2B params | **2.5** / 16.0 GB | Q4FitsQ8Fits | | [granite-swash-2b](https://whatcanirunai.vercel.app/models/granite-swash-2b/)2.1B params | **2.5** / 16.0 GB | Q4FitsQ8Fits | | [Qwen3-VL-2B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-vl-2b-instruct/)2.1B params | **2.5** / 16.0 GB | Q4FitsQ8Fits | | [kanana-nano-2.1b-instruct](https://whatcanirunai.vercel.app/models/kanana-nano-2.1b-instruct/)2.1B params | **2.5** / 16.0 GB | Q4FitsQ8Fits | | [Hy-MT2-1.8B](https://whatcanirunai.vercel.app/models/hy-mt2-1.8b/)2.0B params | **2.4** / 16.0 GB | Q4FitsQ8Fits | | [Qwen3-1.7B](https://whatcanirunai.vercel.app/models/qwen3-1.7b/)2.0B params | **2.4** / 16.0 GB | Q4FitsQ8Fits | | [Youtu-LLM-2B](https://whatcanirunai.vercel.app/models/youtu-llm-2b/)2.0B params | **2.4** / 16.0 GB | Q4FitsQ8Fits | | [LFM3-VL-2B](https://whatcanirunai.vercel.app/models/lfm3-vl-2b/)1.9B params | **2.3** / 16.0 GB | Q4FitsQ8Fits | | [d1-2B](https://whatcanirunai.vercel.app/models/d1-2b/)1.9B params | **2.3** / 16.0 GB | Q4FitsQ8Fits | | [FastVLM-1.5B](https://whatcanirunai.vercel.app/models/fastvlm-1.5b/)1.9B params | **2.3** / 16.0 GB | Q4FitsQ8Fits | | [internlm2\_5-1\_8b-chat](https://whatcanirunai.vercel.app/models/internlm2-5-1-8b-chat/)1.9B params | **2.3** / 16.0 GB | Q4FitsQ8Fits | | [DeepSeek-R1-Distill-Qwen-1.5B](https://whatcanirunai.vercel.app/models/deepseek-r1-distill-qwen-1.5b/)1.8B params | **2.2** / 16.0 GB | Q4FitsQ8Fits | | [LFM3-1.7B](https://whatcanirunai.vercel.app/models/lfm3-1.7b/)1.7B params | **2.2** / 16.0 GB | Q4FitsQ8Fits | | [Qwen3-1.7B-Base](https://whatcanirunai.vercel.app/models/qwen3-1.7b-base/)1.7B params | **2.2** / 16.0 GB | Q4FitsQ8Fits | | [SmolLM2-1.7B](https://whatcanirunai.vercel.app/models/smollm2-1.7b/)1.7B params | **2.2** / 16.0 GB | Q4FitsQ8Fits | | [SmolLM-1.7B](https://whatcanirunai.vercel.app/models/smollm-1.7b/)1.7B params | **2.2** / 16.0 GB | Q4FitsQ8Fits | | [Spark-X2.6-1.7B](https://whatcanirunai.vercel.app/models/spark-x2.6-1.7b/)1.7B params | **2.2** / 16.0 GB | Q4FitsQ8Fits | | [Falcon3-1B-Instruct](https://whatcanirunai.vercel.app/models/falcon3-1b-instruct/)1.7B params | **2.2** / 16.0 GB | Q4FitsQ8Fits | | [EuroLLM-1.7B-Instruct](https://whatcanirunai.vercel.app/models/eurollm-1.7b-instruct/)1.7B params | **2.2** / 16.0 GB | Q4FitsQ8Fits | | [granite-4.0-1b](https://whatcanirunai.vercel.app/models/granite-4.0-1b/)1.6B params | **2.1** / 16.0 GB | Q4FitsQ8Fits | | [LFM2.5-VL-1.6B](https://whatcanirunai.vercel.app/models/lfm2.5-vl-1.6b/)1.6B params | **2.1** / 16.0 GB | Q4FitsQ8Fits | | [glm-edge-1.5b-chat](https://whatcanirunai.vercel.app/models/glm-edge-1.5b-chat/)1.6B params | **2.1** / 16.0 GB | Q4FitsQ8Fits | | [LFM2-VL-1.6B](https://whatcanirunai.vercel.app/models/lfm2-vl-1.6b/)1.6B params | **2.1** / 16.0 GB | Q4FitsQ8Fits | | [Falcon-H1-1.5B-Deep-Instruct](https://whatcanirunai.vercel.app/models/falcon-h1-1.5b-deep-instruct/)1.6B params | **2.1** / 16.0 GB | Q4FitsQ8Fits | | [Falcon-H1-1.5B-Instruct](https://whatcanirunai.vercel.app/models/falcon-h1-1.5b-instruct/)1.6B params | **2.1** / 16.0 GB | Q4FitsQ8Fits | | [MiniCPM-V-4.7-1B](https://whatcanirunai.vercel.app/models/minicpm-v-4.7-1b/)1.6B params | **2.1** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2.5-1.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-1.5b-instruct/)1.5B params | **2.1** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2.5-1.5B](https://whatcanirunai.vercel.app/models/qwen2.5-1.5b/)1.5B params | **2.1** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2.5-Coder-1.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-coder-1.5b-instruct/)1.5B params | **2.1** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2.5-Coder-1.5B](https://whatcanirunai.vercel.app/models/qwen2.5-coder-1.5b/)1.5B params | **2.1** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2.5-Math-1.5B](https://whatcanirunai.vercel.app/models/qwen2.5-math-1.5b/)1.5B params | **2.1** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2-1.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2-1.5b-instruct/)1.5B params | **2.1** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2.5-Math-1.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-math-1.5b-instruct/)1.5B params | **2.1** / 16.0 GB | Q4FitsQ8Fits | | [ReaderLM-v2](https://whatcanirunai.vercel.app/models/readerlm-v2/)1.5B params | **2.1** / 16.0 GB | Q4FitsQ8Fits | | [reader-lm-1.5b](https://whatcanirunai.vercel.app/models/reader-lm-1.5b/)1.5B params | **2.1** / 16.0 GB | Q4FitsQ8Fits | | [Hymba-1.5B-Instruct](https://whatcanirunai.vercel.app/models/hymba-1.5b-instruct/)1.5B params | **2.1** / 16.0 GB | Q4FitsQ8Fits | | [OLMo-2-0425-1B](https://whatcanirunai.vercel.app/models/olmo-2-0425-1b/)1.5B params | **2.0** / 16.0 GB | Q4FitsQ8Fits | | [OLMo-2-0425-1B-Instruct](https://whatcanirunai.vercel.app/models/olmo-2-0425-1b-instruct/)1.5B params | **2.0** / 16.0 GB | Q4FitsQ8Fits | | [Yi-Coder-1.5B-Chat](https://whatcanirunai.vercel.app/models/yi-coder-1.5b-chat/)1.5B params | **2.0** / 16.0 GB | Q4FitsQ8Fits | | [Bolmo-1B](https://whatcanirunai.vercel.app/models/bolmo-1b/)1.5B params | **2.0** / 16.0 GB | Q4FitsQ8Fits | | [granite-4.0-h-1b](https://whatcanirunai.vercel.app/models/granite-4.0-h-1b/)1.5B params | **2.0** / 16.0 GB | Q4FitsQ8Fits | | [granite-3.1-1b-a400m-instruct](https://whatcanirunai.vercel.app/models/granite-3.1-1b-a400m-instruct/)1.3B params | **1.9** / 16.0 GB | Q4FitsQ8Fits | | [granite-3.0-1b-a400m-instruct](https://whatcanirunai.vercel.app/models/granite-3.0-1b-a400m-instruct/)1.3B params | **1.9** / 16.0 GB | Q4FitsQ8Fits | | [MiniCPM-V-4.6](https://whatcanirunai.vercel.app/models/minicpm-v-4.6/)1.3B params | **1.9** / 16.0 GB | Q4FitsQ8Fits | | [MiniCPM-V-4.6-Thinking](https://whatcanirunai.vercel.app/models/minicpm-v-4.6-thinking/)1.3B params | **1.9** / 16.0 GB | Q4FitsQ8Fits | | [kanana-2-1.3b-instruct](https://whatcanirunai.vercel.app/models/kanana-2-1.3b-instruct/)1.3B params | **1.9** / 16.0 GB | Q4FitsQ8Fits | | [OLMo-1B-0724-hf](https://whatcanirunai.vercel.app/models/olmo-1b-0724-hf/)1.3B params | **1.9** / 16.0 GB | Q4FitsQ8Fits | | [EXAONE-4.0-1.2B](https://whatcanirunai.vercel.app/models/exaone-4.0-1.2b/)1.3B params | **1.9** / 16.0 GB | Q4FitsQ8Fits | | [Llama-3.2-1B-Instruct](https://whatcanirunai.vercel.app/models/llama-3.2-1b-instruct/)1.2B params | **1.9** / 16.0 GB | Q4FitsQ8Fits | | [Llama-3.2-1B](https://whatcanirunai.vercel.app/models/llama-3.2-1b/)1.2B params | **1.9** / 16.0 GB | Q4FitsQ8Fits | | [Llama-3.2-1B](https://whatcanirunai.vercel.app/models/llama-3.2-1b-nousresearch/)1.2B params | **1.9** / 16.0 GB | Q4FitsQ8Fits | | [Zamba2-1.2B-instruct](https://whatcanirunai.vercel.app/models/zamba2-1.2b-instruct/)1.2B params | **1.8** / 16.0 GB | Q4FitsQ8Fits | | [HRM-Text-1B](https://whatcanirunai.vercel.app/models/hrm-text-1b/)1.2B params | **1.8** / 16.0 GB | Q4FitsQ8Fits | | [AMD-OLMo-1B](https://whatcanirunai.vercel.app/models/amd-olmo-1b/)1.2B params | **1.8** / 16.0 GB | Q4FitsQ8Fits | | [LFM2.5-1.2B-Instruct](https://whatcanirunai.vercel.app/models/lfm2.5-1.2b-instruct/)1.2B params | **1.8** / 16.0 GB | Q4FitsQ8Fits | | [LFM2-1.2B](https://whatcanirunai.vercel.app/models/lfm2-1.2b/)1.2B params | **1.8** / 16.0 GB | Q4FitsQ8Fits | | [LFM2.5-1.2B-Thinking](https://whatcanirunai.vercel.app/models/lfm2.5-1.2b-thinking/)1.2B params | **1.8** / 16.0 GB | Q4FitsQ8Fits | | [LFM2.5-1.2B-JP-202606](https://whatcanirunai.vercel.app/models/lfm2.5-1.2b-jp-202606/)1.2B params | **1.8** / 16.0 GB | Q4FitsQ8Fits | | [MiniCPM5-1B](https://whatcanirunai.vercel.app/models/minicpm5-1b/)1.1B params | **1.8** / 16.0 GB | Q4FitsQ8Fits | | [MiniCPM5-1B-SFT](https://whatcanirunai.vercel.app/models/minicpm5-1b-sft/)1.1B params | **1.8** / 16.0 GB | Q4FitsQ8Fits | | [gemma-3-1b-it](https://whatcanirunai.vercel.app/models/gemma-3-1b-it/)1.0B params | **1.7** / 16.0 GB | Q4FitsQ8Fits | | [gemma-3-1b-pt](https://whatcanirunai.vercel.app/models/gemma-3-1b-pt/)1.0B params | **1.7** / 16.0 GB | Q4FitsQ8Fits | | [Qwen3.5-0.8B](https://whatcanirunai.vercel.app/models/qwen3.5-0.8b/)0.9B params | **1.6** / 16.0 GB | Q4FitsQ8Fits | | [Falcon-E-3B-Instruct](https://whatcanirunai.vercel.app/models/falcon-e-3b-instruct/)0.9B params | **1.6** / 16.0 GB | Q4FitsQ8Fits | | [bitnet-b1.58-2B-4T](https://whatcanirunai.vercel.app/models/bitnet-b1.58-2b-4t/)0.8B params | **1.6** / 16.0 GB | Q4FitsQ8Fits | | [FastVLM-0.5B](https://whatcanirunai.vercel.app/models/fastvlm-0.5b/)0.8B params | **1.5** / 16.0 GB | Q4FitsQ8Fits | | [Qwen3-0.6B](https://whatcanirunai.vercel.app/models/qwen3-0.6b/)0.8B params | **1.5** / 16.0 GB | Q4FitsQ8Fits | | [LFM2-700M](https://whatcanirunai.vercel.app/models/lfm2-700m/)0.7B params | **1.5** / 16.0 GB | Q4FitsQ8Fits | | [Falcon-H1-Tiny-R-0.6B](https://whatcanirunai.vercel.app/models/falcon-h1-tiny-r-0.6b/)0.6B params | **1.4** / 16.0 GB | Q4FitsQ8Fits | | [Qwen3-0.6B-Base](https://whatcanirunai.vercel.app/models/qwen3-0.6b-base/)0.6B params | **1.4** / 16.0 GB | Q4FitsQ8Fits | | [d1-omni-600M](https://whatcanirunai.vercel.app/models/d1-omni-600m/)0.6B params | **1.4** / 16.0 GB | Q4FitsQ8Fits | | [HyperCLOVAX-SEED-Text-Instruct-0.5B](https://whatcanirunai.vercel.app/models/hyperclovax-seed-text-instruct-0.5b/)0.6B params | **1.4** / 16.0 GB | Q4FitsQ8Fits | | [Falcon-H1-0.5B-Instruct](https://whatcanirunai.vercel.app/models/falcon-h1-0.5b-instruct/)0.5B params | **1.4** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2.5-0.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-0.5b-instruct/)0.5B params | **1.3** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2.5-0.5B](https://whatcanirunai.vercel.app/models/qwen2.5-0.5b/)0.5B params | **1.3** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2-0.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2-0.5b-instruct/)0.5B params | **1.3** / 16.0 GB | Q4FitsQ8Fits | | [Qwen2.5-Coder-0.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-coder-0.5b-instruct/)0.5B params | **1.3** / 16.0 GB | Q4FitsQ8Fits | | [LFM2-VL-450M](https://whatcanirunai.vercel.app/models/lfm2-vl-450m/)0.5B params | **1.3** / 16.0 GB | Q4FitsQ8Fits | | [LFM2.5-VL-450M](https://whatcanirunai.vercel.app/models/lfm2.5-vl-450m/)0.4B params | **1.3** / 16.0 GB | Q4FitsQ8Fits | | [Apertus-v1.1-0.5B](https://whatcanirunai.vercel.app/models/apertus-v1.1-0.5b/)0.4B params | **1.3** / 16.0 GB | Q4FitsQ8Fits | | [MiniCPM4-0.5B](https://whatcanirunai.vercel.app/models/minicpm4-0.5b/)0.4B params | **1.3** / 16.0 GB | Q4FitsQ8Fits | | [circuit-sparsity](https://whatcanirunai.vercel.app/models/circuit-sparsity/)0.4B params | **1.3** / 16.0 GB | Q4FitsQ8Fits | | [SmolLM2-360M](https://whatcanirunai.vercel.app/models/smollm2-360m/)0.4B params | **1.3** / 16.0 GB | Q4FitsQ8Fits | | [SmolLM-360M](https://whatcanirunai.vercel.app/models/smollm-360m/)0.4B params | **1.3** / 16.0 GB | Q4FitsQ8Fits | | [ERNIE-4.5-0.3B-PT](https://whatcanirunai.vercel.app/models/ernie-4.5-0.3b-pt/)0.4B params | **1.3** / 16.0 GB | Q4FitsQ8Fits | | [LFM2.5-350M](https://whatcanirunai.vercel.app/models/lfm2.5-350m/)0.4B params | **1.2** / 16.0 GB | Q4FitsQ8Fits | | [LFM2-350M](https://whatcanirunai.vercel.app/models/lfm2-350m/)0.4B params | **1.2** / 16.0 GB | Q4FitsQ8Fits | | [granite-4.0-350m](https://whatcanirunai.vercel.app/models/granite-4.0-350m/)0.4B params | **1.2** / 16.0 GB | Q4FitsQ8Fits | | [granite-4.0-h-350m](https://whatcanirunai.vercel.app/models/granite-4.0-h-350m/)0.3B params | **1.2** / 16.0 GB | Q4FitsQ8Fits | ## Quick answers What is the biggest LLM that runs on Radeon RX 6900 XT? Ling-Coder-lite (16.8B parameters, about 12.7 GB at Q4) is the largest model we track that runs fully in its 16 GB of usable memory. How many local LLMs can Radeon RX 6900 XT run? 388 of the 656 open models we track run fully at Q4 on it. How much memory can Radeon RX 6900 XT use for AI models? It has 16 GB of VRAM, and we count 16 GB as usable for model weights and cache. --- Agent guide: https://whatcanirunai.vercel.app/llms.txt · JSON API: https://whatcanirunai.vercel.app/developers/