# Intel Arc A770 16GB vs GeForce RTX 4060 Ti 16GB

> Intel Arc A770 16GB (16 GB) vs GeForce RTX 4060 Ti 16GB (16 GB): which open models each runs locally at Q4, side by side, with prices.

Source: https://whatcanirunai.vercel.app/compare/arc-a770-16gb-vs-rtx-4060-ti-16gb/

# Intel Arc A770 16GB vs GeForce RTX 4060 Ti 16GB for local LLMs

Both have 16 GB usable, so they run exactly the same models; pick on price and speed. For speed, the **Intel Arc A770 16GB** has 1.94× the memory bandwidth (560 vs 288 GB/s), so expect it to generate tokens roughly that much faster on models both can hold. On our dated price snapshots the **Intel Arc A770 16GB** is $150 cheaper. All checks are at Q4\_K\_M with about 4k context. Speed figures are estimates.

### [Intel Arc A770 16GB](https://whatcanirunai.vercel.app/hardware/arc-a770-16gb/)

Memory

16 GB VRAM

Usable

16 GB

Bandwidth

560 GB/s

Run at Q4

388 / 656

Price per usable GB

$22

**$349** list (launch MSRP; discontinued), [source](https://en.wikipedia.org/wiki/Intel%5FArc), 2026-10-28  
Street prices may be higher than list.  
Discontinued; buy used. Price shown is the original launch MSRP.

[Amazon](https://www.amazon.com/s?k=Intel%20Arc%20A770%2016GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Intel%20Arc%20A770%2016GB)

### [GeForce RTX 4060 Ti 16GB](https://whatcanirunai.vercel.app/hardware/rtx-4060-ti-16gb/)

Memory

16 GB VRAM

Usable

16 GB

Bandwidth

288 GB/s

Run at Q4

388 / 656

Price per usable GB

$31

**$499** list price (MSRP), [source](https://en.wikipedia.org/wiki/GeForce%5F40%5Fseries), 2026-10-22  
Street prices may be higher than list.

[Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204060%20Ti%2016GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204060%20Ti%2016GB)

We may earn a commission when you buy through these links, at no extra cost to you.

## What each one can run

They run the same set of tracked models at Q4.

Biggest at Q4: Ling-Coder-lite on the Intel Arc A770 16GB, Ling-Coder-lite on the GeForce RTX 4060 Ti 16GB. Memory decides what fits; it doesn't measure speed, which also depends on memory bandwidth and the runtime.

## Estimated speed

Estimated decode tokens per second at Q4, from each card's memory bandwidth ([how we estimate](https://whatcanirunai.vercel.app/method/#speed)). MoE figures are upper bounds. Real speeds vary with the runtime, drivers and context length, and older cards (Pascal, Volta, Vega) may run below these estimates in some runtimes.

__Estimated tokens per second, Intel Arc A770 16GB vs GeForce RTX 4060 Ti 16GB__
| Model                                                                    | Intel Arc A770 16GB   | GeForce RTX 4060 Ti 16GB |
| ------------------------------------------------------------------------ | --------------------- | ------------------------ |
| [Qwen3-8B](https://whatcanirunai.vercel.app/models/qwen3-8b/)\~6.7 GB at Q4                              | 68–96                 | 35–49                    |
| [Qwen3-14B](https://whatcanirunai.vercel.app/models/qwen3-14b/)\~11.3 GB at Q4                           | 38–53                 | 19–27                    |
| [gpt-oss-20b](https://whatcanirunai.vercel.app/models/gpt-oss-20b/)\~15.6 GB at Q4                       | up to 218 (tight fit) | up to 112 (tight fit)    |
| [Qwen3-30B-A3B](https://whatcanirunai.vercel.app/models/qwen3-30b-a3b/)\~22.3 GB at Q4                   | doesn’t fit           | doesn’t fit              |
| [Qwen3.8-27B](https://whatcanirunai.vercel.app/models/qwen3.8-27b/)\~20.4 GB at Q4                       | doesn’t fit           | doesn’t fit              |
| [Qwen3-32B](https://whatcanirunai.vercel.app/models/qwen3-32b/)\~23.8 GB at Q4                           | doesn’t fit           | doesn’t fit              |
| [Llama-3.3-70B-Instruct](https://whatcanirunai.vercel.app/models/llama-3.3-70b-instruct/)\~50.2 GB at Q4 | doesn’t fit           | doesn’t fit              |
| [gpt-oss-120b](https://whatcanirunai.vercel.app/models/gpt-oss-120b/)\~82.5 GB at Q4                     | doesn’t fit           | doesn’t fit              |

## Model by model

Bar: Q4 memory needed vs. usable memory. The tick marks 90%, our comfort line.FitsTightWon’t fit

| Model                                                                                                              | Intel Arc A770 16GB (16 GB) | GeForce RTX 4060 Ti 16GB (16 GB) |
| ------------------------------------------------------------------------------------------------------------------ | --------------------------- | -------------------------------- |
| [Kimi-K3.1-Pro](https://whatcanirunai.vercel.app/models/kimi-k3.1-pro/)\~1939.3 GB at Q4                                                           | **1939.3** / 16.0 GB        | **1939.3** / 16.0 GB             |
| [Kimi-K3](https://whatcanirunai.vercel.app/models/kimi-k3/)\~1939.1 GB at Q4                                                                       | **1939.1** / 16.0 GB        | **1939.1** / 16.0 GB             |
| [Qwen3.8-2.4T-A95B](https://whatcanirunai.vercel.app/models/qwen3.8-2.4t-a95b/)\~1706.4 GB at Q4                                                   | **1706.4** / 16.0 GB        | **1706.4** / 16.0 GB             |
| [LongCat-2.5](https://whatcanirunai.vercel.app/models/longcat-2.5/)\~1241.8 GB at Q4                                                               | **1241.8** / 16.0 GB        | **1241.8** / 16.0 GB             |
| [LongCat-2.0](https://whatcanirunai.vercel.app/models/longcat-2.0/)\~1238.9 GB at Q4                                                               | **1238.9** / 16.0 GB        | **1238.9** / 16.0 GB             |
| [DeepSeek-V4-Pro-0813](https://whatcanirunai.vercel.app/models/deepseek-v4-pro-0813/)\~1151.7 GB at Q4                                             | **1151.7** / 16.0 GB        | **1151.7** / 16.0 GB             |
| [DeepSeek-V4-Pro](https://whatcanirunai.vercel.app/models/deepseek-v4-pro/)\~1115.7 GB at Q4                                                       | **1115.7** / 16.0 GB        | **1115.7** / 16.0 GB             |
| [Kimi-K2.5](https://whatcanirunai.vercel.app/models/kimi-k2.5/)\~716.9 GB at Q4                                                                    | **716.9** / 16.0 GB         | **716.9** / 16.0 GB              |
| [Kimi-K2.6](https://whatcanirunai.vercel.app/models/kimi-k2.6/)\~716.9 GB at Q4                                                                    | **716.9** / 16.0 GB         | **716.9** / 16.0 GB              |
| [Kimi-K2.7-Code](https://whatcanirunai.vercel.app/models/kimi-k2.7-code/)\~716.9 GB at Q4                                                          | **716.9** / 16.0 GB         | **716.9** / 16.0 GB              |
| [Kimi-K2-Thinking](https://whatcanirunai.vercel.app/models/kimi-k2-thinking/)\~716.6 GB at Q4                                                      | **716.6** / 16.0 GB         | **716.6** / 16.0 GB              |
| [Kimi-K2-Instruct-0905](https://whatcanirunai.vercel.app/models/kimi-k2-instruct-0905/)\~716.6 GB at Q4                                            | **716.6** / 16.0 GB         | **716.6** / 16.0 GB              |
| [Kimi-K2-Instruct](https://whatcanirunai.vercel.app/models/kimi-k2-instruct/)\~716.6 GB at Q4                                                      | **716.6** / 16.0 GB         | **716.6** / 16.0 GB              |
| [MiMo-V2.6-Pro-RL](https://whatcanirunai.vercel.app/models/mimo-v2.6-pro-rl/)\~715.1 GB at Q4                                                      | **715.1** / 16.0 GB         | **715.1** / 16.0 GB              |
| [MiMo-V2.6-Pro-MOPD](https://whatcanirunai.vercel.app/models/mimo-v2.6-pro-mopd/)\~715.1 GB at Q4                                                  | **715.1** / 16.0 GB         | **715.1** / 16.0 GB              |
| [MiMo-V2.5-Pro](https://whatcanirunai.vercel.app/models/mimo-v2.5-pro/)\~714.4 GB at Q4                                                            | **714.4** / 16.0 GB         | **714.4** / 16.0 GB              |
| [Ring-2.5-1T](https://whatcanirunai.vercel.app/models/ring-2.5-1t/)\~706.7 GB at Q4                                                                | **706.7** / 16.0 GB         | **706.7** / 16.0 GB              |
| [Ling-2.5-1T](https://whatcanirunai.vercel.app/models/ling-2.5-1t/)\~706.7 GB at Q4                                                                | **706.7** / 16.0 GB         | **706.7** / 16.0 GB              |
| [Ling-1T](https://whatcanirunai.vercel.app/models/ling-1t/)\~698.0 GB at Q4                                                                        | **698.0** / 16.0 GB         | **698.0** / 16.0 GB              |
| [Ring-1T](https://whatcanirunai.vercel.app/models/ring-1t/)\~698.0 GB at Q4                                                                        | **698.0** / 16.0 GB         | **698.0** / 16.0 GB              |
| [Inkling](https://whatcanirunai.vercel.app/models/inkling/)\~665.0 GB at Q4                                                                        | **665.0** / 16.0 GB         | **665.0** / 16.0 GB              |
| [Intern-S1-Pro](https://whatcanirunai.vercel.app/models/intern-s1-pro/)\~640.4 GB at Q4                                                            | **640.4** / 16.0 GB         | **640.4** / 16.0 GB              |
| [Muse-Spark-Open-816B-A42B](https://whatcanirunai.vercel.app/models/muse-spark-open-816b-a42b/)\~574.1 GB at Q4                                    | **574.1** / 16.0 GB         | **574.1** / 16.0 GB              |
| [Hy4-preview](https://whatcanirunai.vercel.app/models/hy4-preview/)\~544.8 GB at Q4                                                                | **544.8** / 16.0 GB         | **544.8** / 16.0 GB              |
| [GLM-5](https://whatcanirunai.vercel.app/models/glm-5/)\~526.6 GB at Q4                                                                            | **526.6** / 16.0 GB         | **526.6** / 16.0 GB              |
| [GLM-5.1](https://whatcanirunai.vercel.app/models/glm-5.1/)\~526.6 GB at Q4                                                                        | **526.6** / 16.0 GB         | **526.6** / 16.0 GB              |
| [GLM-5.3](https://whatcanirunai.vercel.app/models/glm-5.3/)\~526.2 GB at Q4                                                                        | **526.2** / 16.0 GB         | **526.2** / 16.0 GB              |
| [GLM-5.2](https://whatcanirunai.vercel.app/models/glm-5.2/)\~526.2 GB at Q4                                                                        | **526.2** / 16.0 GB         | **526.2** / 16.0 GB              |
| [GLM-5.3-BF16](https://whatcanirunai.vercel.app/models/glm-5.3-bf16/)\~526.2 GB at Q4                                                              | **526.2** / 16.0 GB         | **526.2** / 16.0 GB              |
| [K-EXAONE-2.0-750B-A37B](https://whatcanirunai.vercel.app/models/k-exaone-2.0-750b-a37b/)\~523.4 GB at Q4                                          | **523.4** / 16.0 GB         | **523.4** / 16.0 GB              |
| [DeepSeek-V3.2-Exp](https://whatcanirunai.vercel.app/models/deepseek-v3.2-exp/)\~478.9 GB at Q4                                                    | **478.9** / 16.0 GB         | **478.9** / 16.0 GB              |
| [DeepSeek-V3.2-Speciale](https://whatcanirunai.vercel.app/models/deepseek-v3.2-speciale/)\~478.9 GB at Q4                                          | **478.9** / 16.0 GB         | **478.9** / 16.0 GB              |
| [DeepSeek-V3.2](https://whatcanirunai.vercel.app/models/deepseek-v3.2/)\~478.8 GB at Q4                                                            | **478.8** / 16.0 GB         | **478.8** / 16.0 GB              |
| [DeepSeek-V3-0324](https://whatcanirunai.vercel.app/models/deepseek-v3-0324/)\~478.2 GB at Q4                                                      | **478.2** / 16.0 GB         | **478.2** / 16.0 GB              |
| [DeepSeek-R1-0528](https://whatcanirunai.vercel.app/models/deepseek-r1-0528/)\~478.2 GB at Q4                                                      | **478.2** / 16.0 GB         | **478.2** / 16.0 GB              |
| [DeepSeek-V3.1-Base](https://whatcanirunai.vercel.app/models/deepseek-v3.1-base/)\~478.2 GB at Q4                                                  | **478.2** / 16.0 GB         | **478.2** / 16.0 GB              |
| [DeepSeek-R1](https://whatcanirunai.vercel.app/models/deepseek-r1/)\~478.2 GB at Q4                                                                | **478.2** / 16.0 GB         | **478.2** / 16.0 GB              |
| [DeepSeek-R1-Zero](https://whatcanirunai.vercel.app/models/deepseek-r1-zero/)\~478.2 GB at Q4                                                      | **478.2** / 16.0 GB         | **478.2** / 16.0 GB              |
| [Step-5-Preview](https://whatcanirunai.vercel.app/models/step-5-preview/)\~422.3 GB at Q4                                                          | **422.3** / 16.0 GB         | **422.3** / 16.0 GB              |
| [Ling-3.1-flash](https://whatcanirunai.vercel.app/models/ling-3.1-flash/)\~399.9 GB at Q4                                                          | **399.9** / 16.0 GB         | **399.9** / 16.0 GB              |
| [Ling-3.1-flash-1019](https://whatcanirunai.vercel.app/models/ling-3.1-flash-1019/)\~399.9 GB at Q4                                                | **399.9** / 16.0 GB         | **399.9** / 16.0 GB              |
| [LongCat-Flash-Chat](https://whatcanirunai.vercel.app/models/longcat-flash-chat/)\~392.7 GB at Q4                                                  | **392.7** / 16.0 GB         | **392.7** / 16.0 GB              |
| [LongCat-Flash-Thinking](https://whatcanirunai.vercel.app/models/longcat-flash-thinking/)\~392.7 GB at Q4                                          | **392.7** / 16.0 GB         | **392.7** / 16.0 GB              |
| [LongCat-Flash-Thinking-2601](https://whatcanirunai.vercel.app/models/longcat-flash-thinking-2601/)\~392.7 GB at Q4                                | **392.7** / 16.0 GB         | **392.7** / 16.0 GB              |
| [NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16](https://whatcanirunai.vercel.app/models/nvidia-nemotron-3-ultra-550b-a55b-bf16/)\~391.8 GB at Q4          | **391.8** / 16.0 GB         | **391.8** / 16.0 GB              |
| [Beam-1.0-501B-A23B](https://whatcanirunai.vercel.app/models/beam-1.0-501b-a23b/)\~350.5 GB at Q4                                                  | **350.5** / 16.0 GB         | **350.5** / 16.0 GB              |
| [Qwen3-Coder-480B-A35B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-coder-480b-a35b-instruct/)\~335.8 GB at Q4                          | **335.8** / 16.0 GB         | **335.8** / 16.0 GB              |
| [MiniMax-M1-40k](https://whatcanirunai.vercel.app/models/minimax-m1-40k/)\~319.0 GB at Q4                                                          | **319.0** / 16.0 GB         | **319.0** / 16.0 GB              |
| [MiniMax-M1-80k](https://whatcanirunai.vercel.app/models/minimax-m1-80k/)\~319.0 GB at Q4                                                          | **319.0** / 16.0 GB         | **319.0** / 16.0 GB              |
| [MiniMax-M3](https://whatcanirunai.vercel.app/models/minimax-m3/)\~298.7 GB at Q4                                                                  | **298.7** / 16.0 GB         | **298.7** / 16.0 GB              |
| [ERNIE-4.5-VL-424B-A47B-PT](https://whatcanirunai.vercel.app/models/ernie-4.5-vl-424b-a47b-pt/)\~296.3 GB at Q4                                    | **296.3** / 16.0 GB         | **296.3** / 16.0 GB              |
| [Intern-S2-397B](https://whatcanirunai.vercel.app/models/intern-s2-397b/)\~282.3 GB at Q4                                                          | **282.3** / 16.0 GB         | **282.3** / 16.0 GB              |
| [Qwen3.5-397B-A17B](https://whatcanirunai.vercel.app/models/qwen3.5-397b-a17b/)\~282.2 GB at Q4                                                    | **282.2** / 16.0 GB         | **282.2** / 16.0 GB              |
| [Llama-4-Maverick-17B-128E-Instruct](https://whatcanirunai.vercel.app/models/llama-4-maverick-17b-128e-instruct/)\~281.0 GB at Q4                  | **281.0** / 16.0 GB         | **281.0** / 16.0 GB              |
| [Trinity-Large-Thinking](https://whatcanirunai.vercel.app/models/trinity-large-thinking/)\~278.9 GB at Q4                                          | **278.9** / 16.0 GB         | **278.9** / 16.0 GB              |
| [Trinity-Large-Preview](https://whatcanirunai.vercel.app/models/trinity-large-preview/)\~278.9 GB at Q4                                            | **278.9** / 16.0 GB         | **278.9** / 16.0 GB              |
| [Trinity-Large-TrueBase](https://whatcanirunai.vercel.app/models/trinity-large-truebase/)\~278.9 GB at Q4                                          | **278.9** / 16.0 GB         | **278.9** / 16.0 GB              |
| [Trinity-Large-Base](https://whatcanirunai.vercel.app/models/trinity-large-base/)\~278.9 GB at Q4                                                  | **278.9** / 16.0 GB         | **278.9** / 16.0 GB              |
| [Nex-N2.5-Pro](https://whatcanirunai.vercel.app/models/nex-n2.5-pro/)\~277.6 GB at Q4                                                              | **277.6** / 16.0 GB         | **277.6** / 16.0 GB              |
| [Nex-N2-Pro](https://whatcanirunai.vercel.app/models/nex-n2-pro/)\~277.6 GB at Q4                                                                  | **277.6** / 16.0 GB         | **277.6** / 16.0 GB              |
| [NorthCUA-Pro](https://whatcanirunai.vercel.app/models/northcua-pro/)\~277.6 GB at Q4                                                              | **277.6** / 16.0 GB         | **277.6** / 16.0 GB              |
| [GLM-4.5](https://whatcanirunai.vercel.app/models/glm-4.5/)\~250.8 GB at Q4                                                                        | **250.8** / 16.0 GB         | **250.8** / 16.0 GB              |
| [GLM-4.7](https://whatcanirunai.vercel.app/models/glm-4.7/)\~250.8 GB at Q4                                                                        | **250.8** / 16.0 GB         | **250.8** / 16.0 GB              |
| [GLM-4.6](https://whatcanirunai.vercel.app/models/glm-4.6/)\~249.7 GB at Q4                                                                        | **249.7** / 16.0 GB         | **249.7** / 16.0 GB              |
| [GLM-5.3-Flash](https://whatcanirunai.vercel.app/models/glm-5.3-flash/)\~225.0 GB at Q4                                                            | **225.0** / 16.0 GB         | **225.0** / 16.0 GB              |
| [Motif-3](https://whatcanirunai.vercel.app/models/motif-3/)\~220.5 GB at Q4                                                                        | **220.5** / 16.0 GB         | **220.5** / 16.0 GB              |
| [MiMo-V2.5](https://whatcanirunai.vercel.app/models/mimo-v2.5/)\~217.7 GB at Q4                                                                    | **217.7** / 16.0 GB         | **217.7** / 16.0 GB              |
| [MiMo-V2.6-Flash-RL](https://whatcanirunai.vercel.app/models/mimo-v2.6-flash-rl/)\~217.7 GB at Q4                                                  | **217.7** / 16.0 GB         | **217.7** / 16.0 GB              |
| [MiMo-V2.6-Flash-MOPD](https://whatcanirunai.vercel.app/models/mimo-v2.6-flash-mopd/)\~217.7 GB at Q4                                              | **217.7** / 16.0 GB         | **217.7** / 16.0 GB              |
| [MiMo-V2-Flash](https://whatcanirunai.vercel.app/models/mimo-v2-flash/)\~217.0 GB at Q4                                                            | **217.0** / 16.0 GB         | **217.0** / 16.0 GB              |
| [DeepSeek-V4-Flash-Vision-Exp](https://whatcanirunai.vercel.app/models/deepseek-v4-flash-vision-exp/)\~213.4 GB at Q4                              | **213.4** / 16.0 GB         | **213.4** / 16.0 GB              |
| [DeepSeek-V4-Flash-0731](https://whatcanirunai.vercel.app/models/deepseek-v4-flash-0731/)\~213.1 GB at Q4                                          | **213.1** / 16.0 GB         | **213.1** / 16.0 GB              |
| [ERNIE-4.5-300B-A47B-PT](https://whatcanirunai.vercel.app/models/ernie-4.5-300b-a47b-pt/)\~210.5 GB at Q4                                          | **210.5** / 16.0 GB         | **210.5** / 16.0 GB              |
| [Hy3](https://whatcanirunai.vercel.app/models/hy3/)\~209.3 GB at Q4                                                                                | **209.3** / 16.0 GB         | **209.3** / 16.0 GB              |
| [Hy3-preview](https://whatcanirunai.vercel.app/models/hy3-preview/)\~209.3 GB at Q4                                                                | **209.3** / 16.0 GB         | **209.3** / 16.0 GB              |
| [Ling-plus](https://whatcanirunai.vercel.app/models/ling-plus/)\~205.0 GB at Q4                                                                    | **205.0** / 16.0 GB         | **205.0** / 16.0 GB              |
| [DeepSeek-V4-Flash](https://whatcanirunai.vercel.app/models/deepseek-v4-flash/)\~203.8 GB at Q4                                                    | **203.8** / 16.0 GB         | **203.8** / 16.0 GB              |
| [MemT-1.0-Flash](https://whatcanirunai.vercel.app/models/memt-1.0-flash/)\~201.8 GB at Q4                                                          | **201.8** / 16.0 GB         | **201.8** / 16.0 GB              |
| [ERNIE-5.5-Flash-Base](https://whatcanirunai.vercel.app/models/ernie-5.5-flash-base/)\~200.6 GB at Q4                                              | **200.6** / 16.0 GB         | **200.6** / 16.0 GB              |
| [Inkling-Small](https://whatcanirunai.vercel.app/models/inkling-small/)\~186.4 GB at Q4                                                            | **186.4** / 16.0 GB         | **186.4** / 16.0 GB              |
| [Llama-3\_1-Nemotron-Ultra-253B-v1](https://whatcanirunai.vercel.app/models/llama-3-1-nemotron-ultra-253b-v1/)\~177.7 GB at Q4                     | **177.7** / 16.0 GB         | **177.7** / 16.0 GB              |
| [Solar-Open2-250B](https://whatcanirunai.vercel.app/models/solar-open2-250b/)\~175.5 GB at Q4                                                      | **175.5** / 16.0 GB         | **175.5** / 16.0 GB              |
| [Intern-S1](https://whatcanirunai.vercel.app/models/intern-s1/)\~168.8 GB at Q4                                                                    | **168.8** / 16.0 GB         | **168.8** / 16.0 GB              |
| [K-EXAONE-236B-A23B](https://whatcanirunai.vercel.app/models/k-exaone-236b-a23b/)\~166.3 GB at Q4                                                  | **166.3** / 16.0 GB         | **166.3** / 16.0 GB              |
| [DeepSeek-V2.5](https://whatcanirunai.vercel.app/models/deepseek-v2.5/)\~165.4 GB at Q4                                                            | **165.4** / 16.0 GB         | **165.4** / 16.0 GB              |
| [DeepSeek-Coder-V2-Instruct](https://whatcanirunai.vercel.app/models/deepseek-coder-v2-instruct/)\~165.4 GB at Q4                                  | **165.4** / 16.0 GB         | **165.4** / 16.0 GB              |
| [DeepSeek-V2.5-1210](https://whatcanirunai.vercel.app/models/deepseek-v2.5-1210/)\~165.4 GB at Q4                                                  | **165.4** / 16.0 GB         | **165.4** / 16.0 GB              |
| [DeepSeek-V2-Chat-0628](https://whatcanirunai.vercel.app/models/deepseek-v2-chat-0628/)\~165.4 GB at Q4                                            | **165.4** / 16.0 GB         | **165.4** / 16.0 GB              |
| [DeepSeek-Coder-V2-Instruct-0724](https://whatcanirunai.vercel.app/models/deepseek-coder-v2-instruct-0724/)\~165.4 GB at Q4                        | **165.4** / 16.0 GB         | **165.4** / 16.0 GB              |
| [Qwen3-VL-235B-A22B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-vl-235b-a22b-instruct/)\~165.3 GB at Q4                                | **165.3** / 16.0 GB         | **165.3** / 16.0 GB              |
| [Qwen3-235B-A22B](https://whatcanirunai.vercel.app/models/qwen3-235b-a22b/)\~164.9 GB at Q4                                                        | **164.9** / 16.0 GB         | **164.9** / 16.0 GB              |
| [Qwen3-235B-A22B-Instruct-2507](https://whatcanirunai.vercel.app/models/qwen3-235b-a22b-instruct-2507/)\~164.9 GB at Q4                            | **164.9** / 16.0 GB         | **164.9** / 16.0 GB              |
| [Qwen3-235B-A22B-Thinking-2507](https://whatcanirunai.vercel.app/models/qwen3-235b-a22b-thinking-2507/)\~164.9 GB at Q4                            | **164.9** / 16.0 GB         | **164.9** / 16.0 GB              |
| [MiniMax-M2](https://whatcanirunai.vercel.app/models/minimax-m2/)\~160.4 GB at Q4                                                                  | **160.4** / 16.0 GB         | **160.4** / 16.0 GB              |
| [MiniMax-M2.5](https://whatcanirunai.vercel.app/models/minimax-m2.5/)\~160.4 GB at Q4                                                              | **160.4** / 16.0 GB         | **160.4** / 16.0 GB              |
| [MiniMax-M2.7](https://whatcanirunai.vercel.app/models/minimax-m2.7/)\~160.4 GB at Q4                                                              | **160.4** / 16.0 GB         | **160.4** / 16.0 GB              |
| [MiniMax-M2.1](https://whatcanirunai.vercel.app/models/minimax-m2.1/)\~160.4 GB at Q4                                                              | **160.4** / 16.0 GB         | **160.4** / 16.0 GB              |
| [command-a-plus-05-2026-bf16](https://whatcanirunai.vercel.app/models/command-a-plus-05-2026-bf16/)\~153.5 GB at Q4                                | **153.5** / 16.0 GB         | **153.5** / 16.0 GB              |
| [Step-3.7-Flash](https://whatcanirunai.vercel.app/models/step-3.7-flash/)\~141.4 GB at Q4                                                          | **141.4** / 16.0 GB         | **141.4** / 16.0 GB              |
| [Step-3.5-Flash](https://whatcanirunai.vercel.app/models/step-3.5-flash/)\~140.0 GB at Q4                                                          | **140.0** / 16.0 GB         | **140.0** / 16.0 GB              |
| [Step-3.5-Flash-Base-Midtrain](https://whatcanirunai.vercel.app/models/step-3.5-flash-base-midtrain/)\~138.9 GB at Q4                              | **138.9** / 16.0 GB         | **138.9** / 16.0 GB              |
| [Qwen3.8-Flash-Next](https://whatcanirunai.vercel.app/models/qwen3.8-flash-next/)\~126.5 GB at Q4                                                  | **126.5** / 16.0 GB         | **126.5** / 16.0 GB              |
| [Mixtral-8x22B-Instruct-v0.1](https://whatcanirunai.vercel.app/models/mixtral-8x22b-instruct-v0.1/)\~99.0 GB at Q4                                 | **99.0** / 16.0 GB          | **99.0** / 16.0 GB               |
| [Ling-3.0-flash-Sante](https://whatcanirunai.vercel.app/models/ling-3.0-flash-sante/)\~89.9 GB at Q4                                               | **89.9** / 16.0 GB          | **89.9** / 16.0 GB               |
| [Ling-3.0-flash](https://whatcanirunai.vercel.app/models/ling-3.0-flash/)\~89.9 GB at Q4                                                           | **89.9** / 16.0 GB          | **89.9** / 16.0 GB               |
| [Ling-3.0-flash-Fin](https://whatcanirunai.vercel.app/models/ling-3.0-flash-fin/)\~89.9 GB at Q4                                                   | **89.9** / 16.0 GB          | **89.9** / 16.0 GB               |
| [Ornith-1.5-122B](https://whatcanirunai.vercel.app/models/ornith-1.5-122b/)\~88.2 GB at Q4                                                         | **88.2** / 16.0 GB          | **88.2** / 16.0 GB               |
| [Qwen3.5-122B-A10B](https://whatcanirunai.vercel.app/models/qwen3.5-122b-a10b/)\~88.2 GB at Q4                                                     | **88.2** / 16.0 GB          | **88.2** / 16.0 GB               |
| [Devstral-2-123B-Instruct-2512](https://whatcanirunai.vercel.app/models/devstral-2-123b-instruct-2512/)\~88.2 GB at Q4                             | **88.2** / 16.0 GB          | **88.2** / 16.0 GB               |
| [Ling-3.0-flash-VL](https://whatcanirunai.vercel.app/models/ling-3.0-flash-vl/)\~88.0 GB at Q4                                                     | **88.0** / 16.0 GB          | **88.0** / 16.0 GB               |
| [NVIDIA-Nemotron-3-Super-120B-A12B-BF16](https://whatcanirunai.vercel.app/models/nvidia-nemotron-3-super-120b-a12b-bf16/)\~87.2 GB at Q4           | **87.2** / 16.0 GB          | **87.2** / 16.0 GB               |
| [Mistral-Small-4-119B-2603](https://whatcanirunai.vercel.app/models/mistral-small-4-119b-2603/)\~84.2 GB at Q4                                     | **84.2** / 16.0 GB          | **84.2** / 16.0 GB               |
| [Youtu-LLM-A7B-Base](https://whatcanirunai.vercel.app/models/youtu-llm-a7b-base/)\~83.5 GB at Q4                                                   | **83.5** / 16.0 GB          | **83.5** / 16.0 GB               |
| [Laguna-S-2.1](https://whatcanirunai.vercel.app/models/laguna-s-2.1/)\~83.0 GB at Q4                                                               | **83.0** / 16.0 GB          | **83.0** / 16.0 GB               |
| [gpt-oss-120b](https://whatcanirunai.vercel.app/models/gpt-oss-120b/)\~82.5 GB at Q4                                                               | **82.5** / 16.0 GB          | **82.5** / 16.0 GB               |
| [c4ai-command-a-03-2025](https://whatcanirunai.vercel.app/models/c4ai-command-a-03-2025/)\~78.4 GB at Q4                                           | **78.4** / 16.0 GB          | **78.4** / 16.0 GB               |
| [GLM-4.5-Air](https://whatcanirunai.vercel.app/models/glm-4.5-air/)\~78.0 GB at Q4                                                                 | **78.0** / 16.0 GB          | **78.0** / 16.0 GB               |
| [Llama-4-Scout-17B-16E-Instruct](https://whatcanirunai.vercel.app/models/llama-4-scout-17b-16e-instruct/)\~76.7 GB at Q4                           | **76.7** / 16.0 GB          | **76.7** / 16.0 GB               |
| [Llama-4-Scout-17B-16E](https://whatcanirunai.vercel.app/models/llama-4-scout-17b-16e/)\~76.7 GB at Q4                                             | **76.7** / 16.0 GB          | **76.7** / 16.0 GB               |
| [GLM-4.5V](https://whatcanirunai.vercel.app/models/glm-4.5v/)\~76.1 GB at Q4                                                                       | **76.1** / 16.0 GB          | **76.1** / 16.0 GB               |
| [GLM-4.6V](https://whatcanirunai.vercel.app/models/glm-4.6v/)\~76.1 GB at Q4                                                                       | **76.1** / 16.0 GB          | **76.1** / 16.0 GB               |
| [Ling-2.6-flash](https://whatcanirunai.vercel.app/models/ling-2.6-flash/)\~75.9 GB at Q4                                                           | **75.9** / 16.0 GB          | **75.9** / 16.0 GB               |
| [sarvam-105b](https://whatcanirunai.vercel.app/models/sarvam-105b/)\~74.9 GB at Q4                                                                 | **74.9** / 16.0 GB          | **74.9** / 16.0 GB               |
| [Ling-flash-2.0](https://whatcanirunai.vercel.app/models/ling-flash-2.0/)\~72.7 GB at Q4                                                           | **72.7** / 16.0 GB          | **72.7** / 16.0 GB               |
| [LLaDA2.1-flash](https://whatcanirunai.vercel.app/models/llada2.1-flash/)\~72.7 GB at Q4                                                           | **72.7** / 16.0 GB          | **72.7** / 16.0 GB               |
| [Ring-flash-2.0](https://whatcanirunai.vercel.app/models/ring-flash-2.0/)\~72.7 GB at Q4                                                           | **72.7** / 16.0 GB          | **72.7** / 16.0 GB               |
| [LLaDA2.2-flash](https://whatcanirunai.vercel.app/models/llada2.2-flash/)\~72.7 GB at Q4                                                           | **72.7** / 16.0 GB          | **72.7** / 16.0 GB               |
| [Solar-Open-100B](https://whatcanirunai.vercel.app/models/solar-open-100b/)\~72.6 GB at Q4                                                         | **72.6** / 16.0 GB          | **72.6** / 16.0 GB               |
| [Qwen3-Next-80B-A3B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-next-80b-a3b-instruct/)\~57.7 GB at Q4                                 | **57.7** / 16.0 GB          | **57.7** / 16.0 GB               |
| [Qwen3-Next-80B-A3B-Thinking](https://whatcanirunai.vercel.app/models/qwen3-next-80b-a3b-thinking/)\~57.7 GB at Q4                                 | **57.7** / 16.0 GB          | **57.7** / 16.0 GB               |
| [AliceAI-Foundation-80B-A3B-Base](https://whatcanirunai.vercel.app/models/aliceai-foundation-80b-a3b-base/)\~57.7 GB at Q4                         | **57.7** / 16.0 GB          | **57.7** / 16.0 GB               |
| [Hunyuan-A13B-Instruct](https://whatcanirunai.vercel.app/models/hunyuan-a13b-instruct/)\~57.0 GB at Q4                                             | **57.0** / 16.0 GB          | **57.0** / 16.0 GB               |
| [Qwen3-Coder-Next](https://whatcanirunai.vercel.app/models/qwen3-coder-next/)\~56.5 GB at Q4                                                       | **56.5** / 16.0 GB          | **56.5** / 16.0 GB               |
| [Kolibri-1](https://whatcanirunai.vercel.app/models/kolibri-1/)\~55.5 GB at Q4                                                                     | **55.5** / 16.0 GB          | **55.5** / 16.0 GB               |
| [Qwen2.5-VL-72B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-vl-72b-instruct/)\~52.2 GB at Q4                                         | **52.2** / 16.0 GB          | **52.2** / 16.0 GB               |
| [UI-TARS-72B-DPO](https://whatcanirunai.vercel.app/models/ui-tars-72b-dpo/)\~52.2 GB at Q4                                                         | **52.2** / 16.0 GB          | **52.2** / 16.0 GB               |
| [Qwen2.5-72B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-72b-instruct/)\~51.7 GB at Q4                                               | **51.7** / 16.0 GB          | **51.7** / 16.0 GB               |
| [Apertus-70B-Instruct-2509](https://whatcanirunai.vercel.app/models/apertus-70b-instruct-2509/)\~50.2 GB at Q4                                     | **50.2** / 16.0 GB          | **50.2** / 16.0 GB               |
| [Apertus-70B-2509](https://whatcanirunai.vercel.app/models/apertus-70b-2509/)\~50.2 GB at Q4                                                       | **50.2** / 16.0 GB          | **50.2** / 16.0 GB               |
| [Llama-3.3-70B-Instruct](https://whatcanirunai.vercel.app/models/llama-3.3-70b-instruct/)\~50.2 GB at Q4                                           | **50.2** / 16.0 GB          | **50.2** / 16.0 GB               |
| [DeepSeek-R1-Distill-Llama-70B](https://whatcanirunai.vercel.app/models/deepseek-r1-distill-llama-70b/)\~50.2 GB at Q4                             | **50.2** / 16.0 GB          | **50.2** / 16.0 GB               |
| [Llama-3.1-70B](https://whatcanirunai.vercel.app/models/llama-3.1-70b/)\~50.2 GB at Q4                                                             | **50.2** / 16.0 GB          | **50.2** / 16.0 GB               |
| [Hermes-2-Theta-Llama-3-70B](https://whatcanirunai.vercel.app/models/hermes-2-theta-llama-3-70b/)\~50.2 GB at Q4                                   | **50.2** / 16.0 GB          | **50.2** / 16.0 GB               |
| [Meta-Llama-3.1-70B-Instruct](https://whatcanirunai.vercel.app/models/meta-llama-3.1-70b-instruct/)\~50.2 GB at Q4                                 | **50.2** / 16.0 GB          | **50.2** / 16.0 GB               |
| [LongCat-Flash-Lite](https://whatcanirunai.vercel.app/models/longcat-flash-lite/)\~49.2 GB at Q4                                                   | **49.2** / 16.0 GB          | **49.2** / 16.0 GB               |
| [AI21-Jamba2-Mini](https://whatcanirunai.vercel.app/models/ai21-jamba2-mini/)\~37.0 GB at Q4                                                       | **37.0** / 16.0 GB          | **37.0** / 16.0 GB               |
| [Llama-3\_1-Nemotron-51B-Instruct](https://whatcanirunai.vercel.app/models/llama-3-1-nemotron-51b-instruct/)\~36.9 GB at Q4                        | **36.9** / 16.0 GB          | **36.9** / 16.0 GB               |
| [Llama-3\_3-Nemotron-Super-49B-v1\_5](https://whatcanirunai.vercel.app/models/llama-3-3-nemotron-super-49b-v1-5/)\~35.8 GB at Q4                   | **35.8** / 16.0 GB          | **35.8** / 16.0 GB               |
| [Llama-3\_3-Nemotron-Super-49B-v1](https://whatcanirunai.vercel.app/models/llama-3-3-nemotron-super-49b-v1/)\~35.8 GB at Q4                        | **35.8** / 16.0 GB          | **35.8** / 16.0 GB               |
| [Phi-3.5-MoE-instruct](https://whatcanirunai.vercel.app/models/phi-3.5-moe-instruct/)\~30.2 GB at Q4                                               | **30.2** / 16.0 GB          | **30.2** / 16.0 GB               |
| [GRIN-MoE](https://whatcanirunai.vercel.app/models/grin-moe/)\~30.2 GB at Q4                                                                       | **30.2** / 16.0 GB          | **30.2** / 16.0 GB               |
| [ALIA-40b](https://whatcanirunai.vercel.app/models/alia-40b/)\~29.2 GB at Q4                                                                       | **29.2** / 16.0 GB          | **29.2** / 16.0 GB               |
| [IQuest-Coder-V1-40B-Loop-Instruct](https://whatcanirunai.vercel.app/models/iquest-coder-v1-40b-loop-instruct/)\~28.7 GB at Q4                     | **28.7** / 16.0 GB          | **28.7** / 16.0 GB               |
| [IQuest-Coder-V1-40B-Instruct](https://whatcanirunai.vercel.app/models/iquest-coder-v1-40b-instruct/)\~28.7 GB at Q4                               | **28.7** / 16.0 GB          | **28.7** / 16.0 GB               |
| [Recursive Flint](https://whatcanirunai.vercel.app/models/flint/)\~28.7 GB at Q4                                                                   | **28.7** / 16.0 GB          | **28.7** / 16.0 GB               |
| [K2-Horizon-MoVA-36B-A4B](https://whatcanirunai.vercel.app/models/k2-horizon-mova-36b-a4b/)\~27.1 GB at Q4                                         | **27.1** / 16.0 GB          | **27.1** / 16.0 GB               |
| [Seed-OSS-36B-Instruct](https://whatcanirunai.vercel.app/models/seed-oss-36b-instruct/)\~26.2 GB at Q4                                             | **26.2** / 16.0 GB          | **26.2** / 16.0 GB               |
| [Seed-OSS-36B-Base-woSyn](https://whatcanirunai.vercel.app/models/seed-oss-36b-base-wosyn/)\~26.2 GB at Q4                                         | **26.2** / 16.0 GB          | **26.2** / 16.0 GB               |
| [Intern-S2-Preview](https://whatcanirunai.vercel.app/models/intern-s2-preview/)\~26.2 GB at Q4                                                     | **26.2** / 16.0 GB          | **26.2** / 16.0 GB               |
| [Ornith-1.5-35B-A3B](https://whatcanirunai.vercel.app/models/ornith-1.5-35b-a3b/)\~26.1 GB at Q4                                                   | **26.1** / 16.0 GB          | **26.1** / 16.0 GB               |
| [Sage-A1.5](https://whatcanirunai.vercel.app/models/sage-a1.5/)\~26.1 GB at Q4                                                                     | **26.1** / 16.0 GB          | **26.1** / 16.0 GB               |
| [Qwen3.6-35B-A3B](https://whatcanirunai.vercel.app/models/qwen3.6-35b-a3b/)\~26.1 GB at Q4                                                         | **26.1** / 16.0 GB          | **26.1** / 16.0 GB               |
| [Qwen3.5-35B-A3B](https://whatcanirunai.vercel.app/models/qwen3.5-35b-a3b/)\~26.1 GB at Q4                                                         | **26.1** / 16.0 GB          | **26.1** / 16.0 GB               |
| [Apex-35B-V1.0](https://whatcanirunai.vercel.app/models/apex-35b-v1.0/)\~26.1 GB at Q4                                                             | **26.1** / 16.0 GB          | **26.1** / 16.0 GB               |
| [MiniCPM-V-4.7-35B-A3B](https://whatcanirunai.vercel.app/models/minicpm-v-4.7-35b-a3b/)\~25.5 GB at Q4                                             | **25.5** / 16.0 GB          | **25.5** / 16.0 GB               |
| [MemT-1.0-Nano](https://whatcanirunai.vercel.app/models/memt-1.0-nano/)\~25.5 GB at Q4                                                             | **25.5** / 16.0 GB          | **25.5** / 16.0 GB               |
| [Agents-A1](https://whatcanirunai.vercel.app/models/agents-a1/)\~25.5 GB at Q4                                                                     | **25.5** / 16.0 GB          | **25.5** / 16.0 GB               |
| [Nex-N2.5-mini](https://whatcanirunai.vercel.app/models/nex-n2.5-mini/)\~25.5 GB at Q4                                                             | **25.5** / 16.0 GB          | **25.5** / 16.0 GB               |
| [Nex-N2-mini](https://whatcanirunai.vercel.app/models/nex-n2-mini/)\~25.5 GB at Q4                                                                 | **25.5** / 16.0 GB          | **25.5** / 16.0 GB               |
| [Axion-1.0-35B](https://whatcanirunai.vercel.app/models/axion-1.0-35b/)\~25.5 GB at Q4                                                             | **25.5** / 16.0 GB          | **25.5** / 16.0 GB               |
| [NorthCUA-Mini](https://whatcanirunai.vercel.app/models/northcua-mini/)\~25.5 GB at Q4                                                             | **25.5** / 16.0 GB          | **25.5** / 16.0 GB               |
| [Clover-35B-A3B-Preview](https://whatcanirunai.vercel.app/models/clover-35b-a3b-preview/)\~25.2 GB at Q4                                           | **25.2** / 16.0 GB          | **25.2** / 16.0 GB               |
| [Qwen-AgentWorld-35B-A3B](https://whatcanirunai.vercel.app/models/qwen-agentworld-35b-a3b/)\~25.2 GB at Q4                                         | **25.2** / 16.0 GB          | **25.2** / 16.0 GB               |
| [KAT-Coder-V2.5-Dev](https://whatcanirunai.vercel.app/models/kat-coder-v2.5-dev/)\~25.2 GB at Q4                                                   | **25.2** / 16.0 GB          | **25.2** / 16.0 GB               |
| [EXAONE-4.5-33B](https://whatcanirunai.vercel.app/models/exaone-4.5-33b/)\~24.9 GB at Q4                                                           | **24.9** / 16.0 GB          | **24.9** / 16.0 GB               |
| [Falcon-H1-34B-Instruct](https://whatcanirunai.vercel.app/models/falcon-h1-34b-instruct/)\~24.5 GB at Q4                                           | **24.5** / 16.0 GB          | **24.5** / 16.0 GB               |
| [Qwen2.5-VL-32B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-vl-32b-instruct/)\~24.3 GB at Q4                                         | **24.3** / 16.0 GB          | **24.3** / 16.0 GB               |
| [Laguna-XS.2](https://whatcanirunai.vercel.app/models/laguna-xs.2/)\~24.3 GB at Q4                                                                 | **24.3** / 16.0 GB          | **24.3** / 16.0 GB               |
| [Qwen3-VL-32B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-vl-32b-instruct/)\~24.3 GB at Q4                                             | **24.3** / 16.0 GB          | **24.3** / 16.0 GB               |
| [HyperCLOVAX-SEED-Think-32B](https://whatcanirunai.vercel.app/models/hyperclovax-seed-think-32b/)\~24.2 GB at Q4                                   | **24.2** / 16.0 GB          | **24.2** / 16.0 GB               |
| [FlexOlmo-7x7B-1T](https://whatcanirunai.vercel.app/models/flexolmo-7x7b-1t/)\~24.2 GB at Q4                                                       | **24.2** / 16.0 GB          | **24.2** / 16.0 GB               |
| [GLM-Z1-Rumination-32B-0414](https://whatcanirunai.vercel.app/models/glm-z1-rumination-32b-0414/)\~24.1 GB at Q4                                   | **24.1** / 16.0 GB          | **24.1** / 16.0 GB               |
| [Nanbeige4.3-33B](https://whatcanirunai.vercel.app/models/nanbeige4.3-33b/)\~24.1 GB at Q4                                                         | **24.1** / 16.0 GB          | **24.1** / 16.0 GB               |
| [Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16](https://whatcanirunai.vercel.app/models/nemotron-3-nano-omni-30b-a3b-reasoning-bf16/)\~24.0 GB at Q4 | **24.0** / 16.0 GB          | **24.0** / 16.0 GB               |
| [Qwen2.5-Coder-32B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-coder-32b-instruct/)\~23.8 GB at Q4                                   | **23.8** / 16.0 GB          | **23.8** / 16.0 GB               |
| [DeepSeek-R1-Distill-Qwen-32B](https://whatcanirunai.vercel.app/models/deepseek-r1-distill-qwen-32b/)\~23.8 GB at Q4                               | **23.8** / 16.0 GB          | **23.8** / 16.0 GB               |
| [Qwen2.5-32B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-32b-instruct/)\~23.8 GB at Q4                                               | **23.8** / 16.0 GB          | **23.8** / 16.0 GB               |
| [QwQ-32B](https://whatcanirunai.vercel.app/models/qwq-32b/)\~23.8 GB at Q4                                                                         | **23.8** / 16.0 GB          | **23.8** / 16.0 GB               |
| [QwQ-32B-Preview](https://whatcanirunai.vercel.app/models/qwq-32b-preview/)\~23.8 GB at Q4                                                         | **23.8** / 16.0 GB          | **23.8** / 16.0 GB               |
| [Qwen2.5-32B](https://whatcanirunai.vercel.app/models/qwen2.5-32b/)\~23.8 GB at Q4                                                                 | **23.8** / 16.0 GB          | **23.8** / 16.0 GB               |
| [Qwen2.5-Coder-32B](https://whatcanirunai.vercel.app/models/qwen2.5-coder-32b/)\~23.8 GB at Q4                                                     | **23.8** / 16.0 GB          | **23.8** / 16.0 GB               |
| [Qwen3-32B](https://whatcanirunai.vercel.app/models/qwen3-32b/)\~23.8 GB at Q4                                                                     | **23.8** / 16.0 GB          | **23.8** / 16.0 GB               |
| [GLM-Z1-32B-0414](https://whatcanirunai.vercel.app/models/glm-z1-32b-0414/)\~23.7 GB at Q4                                                         | **23.7** / 16.0 GB          | **23.7** / 16.0 GB               |
| [GLM-4-32B-0414](https://whatcanirunai.vercel.app/models/glm-4-32b-0414/)\~23.7 GB at Q4                                                           | **23.7** / 16.0 GB          | **23.7** / 16.0 GB               |
| [OLMo-2-0325-32B-Instruct](https://whatcanirunai.vercel.app/models/olmo-2-0325-32b-instruct/)\~23.5 GB at Q4                                       | **23.5** / 16.0 GB          | **23.5** / 16.0 GB               |
| [OLMo-2-0325-32B](https://whatcanirunai.vercel.app/models/olmo-2-0325-32b/)\~23.5 GB at Q4                                                         | **23.5** / 16.0 GB          | **23.5** / 16.0 GB               |
| [Olmo-3-32B-Think](https://whatcanirunai.vercel.app/models/olmo-3-32b-think/)\~23.5 GB at Q4                                                       | **23.5** / 16.0 GB          | **23.5** / 16.0 GB               |
| [Olmo-3-1125-32B](https://whatcanirunai.vercel.app/models/olmo-3-1125-32b/)\~23.5 GB at Q4                                                         | **23.5** / 16.0 GB          | **23.5** / 16.0 GB               |
| [Olmo-3.1-32B-Instruct](https://whatcanirunai.vercel.app/models/olmo-3.1-32b-instruct/)\~23.5 GB at Q4                                             | **23.5** / 16.0 GB          | **23.5** / 16.0 GB               |
| [Olmo-3.1-32B-Think](https://whatcanirunai.vercel.app/models/olmo-3.1-32b-think/)\~23.5 GB at Q4                                                   | **23.5** / 16.0 GB          | **23.5** / 16.0 GB               |
| [Olmo-3.1-32B-Instruct-DPO](https://whatcanirunai.vercel.app/models/olmo-3.1-32b-instruct-dpo/)\~23.5 GB at Q4                                     | **23.5** / 16.0 GB          | **23.5** / 16.0 GB               |
| [granite-4.0-h-small](https://whatcanirunai.vercel.app/models/granite-4.0-h-small/)\~23.5 GB at Q4                                                 | **23.5** / 16.0 GB          | **23.5** / 16.0 GB               |
| [sarvam-30b](https://whatcanirunai.vercel.app/models/sarvam-30b/)\~23.4 GB at Q4                                                                   | **23.4** / 16.0 GB          | **23.4** / 16.0 GB               |
| [EXAONE-4.0-32B](https://whatcanirunai.vercel.app/models/exaone-4.0-32b/)\~23.3 GB at Q4                                                           | **23.3** / 16.0 GB          | **23.3** / 16.0 GB               |
| [EXAONE-4.0.1-32B](https://whatcanirunai.vercel.app/models/exaone-4.0.1-32b/)\~23.3 GB at Q4                                                       | **23.3** / 16.0 GB          | **23.3** / 16.0 GB               |
| [EXAONE-3.5-32B-Instruct](https://whatcanirunai.vercel.app/models/exaone-3.5-32b-instruct/)\~23.3 GB at Q4                                         | **23.3** / 16.0 GB          | **23.3** / 16.0 GB               |
| [EXAONE-Deep-32B](https://whatcanirunai.vercel.app/models/exaone-deep-32b/)\~23.3 GB at Q4                                                         | **23.3** / 16.0 GB          | **23.3** / 16.0 GB               |
| [NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16](https://whatcanirunai.vercel.app/models/nvidia-nemotron-3.5-lightning-30b-a3b-bf16/)\~23.0 GB at Q4   | **23.0** / 16.0 GB          | **23.0** / 16.0 GB               |
| [NVIDIA-Nemotron-3-Nano-30B-A3B-BF16](https://whatcanirunai.vercel.app/models/nvidia-nemotron-3-nano-30b-a3b-bf16/)\~23.0 GB at Q4                 | **23.0** / 16.0 GB          | **23.0** / 16.0 GB               |
| [Nemotron-Cascade-2-30B-A3B](https://whatcanirunai.vercel.app/models/nemotron-cascade-2-30b-a3b/)\~23.0 GB at Q4                                   | **23.0** / 16.0 GB          | **23.0** / 16.0 GB               |
| [Gemma 4 31B](https://whatcanirunai.vercel.app/models/gemma-4-31b-it/)\~22.8 GB at Q4                                                              | **22.8** / 16.0 GB          | **22.8** / 16.0 GB               |
| [gemma-4-31B](https://whatcanirunai.vercel.app/models/gemma-4-31b/)\~22.8 GB at Q4                                                                 | **22.8** / 16.0 GB          | **22.8** / 16.0 GB               |
| [GLM-4.7-Flash](https://whatcanirunai.vercel.app/models/glm-4.7-flash/)\~22.8 GB at Q4                                                             | **22.8** / 16.0 GB          | **22.8** / 16.0 GB               |
| [Xing4.0-29B-A4B](https://whatcanirunai.vercel.app/models/xing4.0-29b-a4b/)\~22.8 GB at Q4                                                         | **22.8** / 16.0 GB          | **22.8** / 16.0 GB               |
| [Xing4.0-29B-Intent](https://whatcanirunai.vercel.app/models/xing4.0-29b-intent/)\~22.8 GB at Q4                                                   | **22.8** / 16.0 GB          | **22.8** / 16.0 GB               |
| [Qwen3-VL-30B-A3B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-vl-30b-a3b-instruct/)\~22.7 GB at Q4                                     | **22.7** / 16.0 GB          | **22.7** / 16.0 GB               |
| [Qwen3-VL-30B-A3B-Thinking](https://whatcanirunai.vercel.app/models/qwen3-vl-30b-a3b-thinking/)\~22.7 GB at Q4                                     | **22.7** / 16.0 GB          | **22.7** / 16.0 GB               |
| [UI-Venus-1.5-30B-A3B](https://whatcanirunai.vercel.app/models/ui-venus-1.5-30b-a3b/)\~22.7 GB at Q4                                               | **22.7** / 16.0 GB          | **22.7** / 16.0 GB               |
| [kanana-2-30b-a3b-instruct-2601](https://whatcanirunai.vercel.app/models/kanana-2-30b-a3b-instruct-2601/)\~22.4 GB at Q4                           | **22.4** / 16.0 GB          | **22.4** / 16.0 GB               |
| [kanana-2-30b-a3b-instruct](https://whatcanirunai.vercel.app/models/kanana-2-30b-a3b-instruct/)\~22.4 GB at Q4                                     | **22.4** / 16.0 GB          | **22.4** / 16.0 GB               |
| [kanana-2-30b-a3b-thinking-2601](https://whatcanirunai.vercel.app/models/kanana-2-30b-a3b-thinking-2601/)\~22.4 GB at Q4                           | **22.4** / 16.0 GB          | **22.4** / 16.0 GB               |
| [Qwen3-30B-A3B](https://whatcanirunai.vercel.app/models/qwen3-30b-a3b/)\~22.3 GB at Q4                                                             | **22.3** / 16.0 GB          | **22.3** / 16.0 GB               |
| [Qwen3-Coder-30B-A3B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-coder-30b-a3b-instruct/)\~22.3 GB at Q4                               | **22.3** / 16.0 GB          | **22.3** / 16.0 GB               |
| [Qwen3-30B-A3B-Instruct-2507](https://whatcanirunai.vercel.app/models/qwen3-30b-a3b-instruct-2507/)\~22.3 GB at Q4                                 | **22.3** / 16.0 GB          | **22.3** / 16.0 GB               |
| [Qwen3-30B-A3B-Thinking-2507](https://whatcanirunai.vercel.app/models/qwen3-30b-a3b-thinking-2507/)\~22.3 GB at Q4                                 | **22.3** / 16.0 GB          | **22.3** / 16.0 GB               |
| [Tongyi-DeepResearch-30B-A3B](https://whatcanirunai.vercel.app/models/tongyi-deepresearch-30b-a3b/)\~22.3 GB at Q4                                 | **22.3** / 16.0 GB          | **22.3** / 16.0 GB               |
| [Rubicon-Preview](https://whatcanirunai.vercel.app/models/rubicon-preview/)\~22.3 GB at Q4                                                         | **22.3** / 16.0 GB          | **22.3** / 16.0 GB               |
| [North-Mini-Code-1.0](https://whatcanirunai.vercel.app/models/north-mini-code-1.0/)\~22.3 GB at Q4                                                 | **22.3** / 16.0 GB          | **22.3** / 16.0 GB               |
| [Hy-Memory-30B-A3B](https://whatcanirunai.vercel.app/models/hy-memory-30b-a3b/)\~22.0 GB at Q4                                                     | **22.0** / 16.0 GB          | **22.0** / 16.0 GB               |
| [Hy-MT2-30B-A3B](https://whatcanirunai.vercel.app/models/hy-mt2-30b-a3b/)\~22.0 GB at Q4                                                           | **22.0** / 16.0 GB          | **22.0** / 16.0 GB               |
| [granite-switch-4.1-30b](https://whatcanirunai.vercel.app/models/granite-switch-4.1-30b/)\~21.9 GB at Q4                                           | **21.9** / 16.0 GB          | **21.9** / 16.0 GB               |
| [Muse-Glimmer-30B](https://whatcanirunai.vercel.app/models/muse-glimmer-30b/)\~21.8 GB at Q4                                                       | **21.8** / 16.0 GB          | **21.8** / 16.0 GB               |
| [ERNIE-4.5-VL-28B-A3B-Thinking](https://whatcanirunai.vercel.app/models/ernie-4.5-vl-28b-a3b-thinking/)\~21.7 GB at Q4                             | **21.7** / 16.0 GB          | **21.7** / 16.0 GB               |
| [ERNIE-4.5-VL-28B-A3B-PT](https://whatcanirunai.vercel.app/models/ernie-4.5-vl-28b-a3b-pt/)\~21.5 GB at Q4                                         | **21.5** / 16.0 GB          | **21.5** / 16.0 GB               |
| [granite-4.2-30b](https://whatcanirunai.vercel.app/models/granite-4.2-30b/)\~21.4 GB at Q4                                                         | **21.4** / 16.0 GB          | **21.4** / 16.0 GB               |
| [granite-4.1-30b](https://whatcanirunai.vercel.app/models/granite-4.1-30b/)\~21.1 GB at Q4                                                         | **21.1** / 16.0 GB          | **21.1** / 16.0 GB               |
| [Raon-1 mini preview](https://whatcanirunai.vercel.app/models/raon-1-mini-preview/)\~21.1 GB at Q4                                                 | **21.1** / 16.0 GB          | **21.1** / 16.0 GB               |
| [Qwen3.8-27B](https://whatcanirunai.vercel.app/models/qwen3.8-27b/)\~20.4 GB at Q4                                                                 | **20.4** / 16.0 GB          | **20.4** / 16.0 GB               |
| [Tess-4.5-27B](https://whatcanirunai.vercel.app/models/tess-4.5-27b/)\~20.4 GB at Q4                                                               | **20.4** / 16.0 GB          | **20.4** / 16.0 GB               |
| [Qwen3.6-27B](https://whatcanirunai.vercel.app/models/qwen3.6-27b/)\~20.4 GB at Q4                                                                 | **20.4** / 16.0 GB          | **20.4** / 16.0 GB               |
| [Qwen3.5-27B](https://whatcanirunai.vercel.app/models/qwen3.5-27b/)\~20.4 GB at Q4                                                                 | **20.4** / 16.0 GB          | **20.4** / 16.0 GB               |
| [gemma-3-27b-it](https://whatcanirunai.vercel.app/models/gemma-3-27b-it/)\~20.1 GB at Q4                                                           | **20.1** / 16.0 GB          | **20.1** / 16.0 GB               |
| [Arete-27B](https://whatcanirunai.vercel.app/models/arete-27b/)\~20.1 GB at Q4                                                                     | **20.1** / 16.0 GB          | **20.1** / 16.0 GB               |
| [gemma-2-27b-it](https://whatcanirunai.vercel.app/models/gemma-2-27b-it/)\~20.0 GB at Q4                                                           | **20.0** / 16.0 GB          | **20.0** / 16.0 GB               |
| [gemma-2-27b](https://whatcanirunai.vercel.app/models/gemma-2-27b/)\~20.0 GB at Q4                                                                 | **20.0** / 16.0 GB          | **20.0** / 16.0 GB               |
| [Qwen3.8-27B-Longbook27-v2](https://whatcanirunai.vercel.app/models/qwen3.8-27b-longbook27-v2/)\~19.9 GB at Q4                                     | **19.9** / 16.0 GB          | **19.9** / 16.0 GB               |
| [medgemma-27b-text-it](https://whatcanirunai.vercel.app/models/medgemma-27b-text-it/)\~19.8 GB at Q4                                               | **19.8** / 16.0 GB          | **19.8** / 16.0 GB               |
| [Hemmingway-1.5](https://whatcanirunai.vercel.app/models/hemmingway-1.5/)\~19.8 GB at Q4                                                           | **19.8** / 16.0 GB          | **19.8** / 16.0 GB               |
| [Trinity-Mini](https://whatcanirunai.vercel.app/models/trinity-mini/)\~19.2 GB at Q4                                                               | **19.2** / 16.0 GB          | **19.2** / 16.0 GB               |
| [diffusiongemma-26B-A4B-it](https://whatcanirunai.vercel.app/models/diffusiongemma-26b-a4b-it/)\~19.0 GB at Q4                                     | **19.0** / 16.0 GB          | **19.0** / 16.0 GB               |
| [Gemma 4 26B A4B](https://whatcanirunai.vercel.app/models/gemma-4-26b-a4b-it/)\~19.0 GB at Q4                                                      | **19.0** / 16.0 GB          | **19.0** / 16.0 GB               |
| [gemma-4-26B-A4B](https://whatcanirunai.vercel.app/models/gemma-4-26b-a4b/)\~19.0 GB at Q4                                                         | **19.0** / 16.0 GB          | **19.0** / 16.0 GB               |
| [Voxtral-Small-24B-2507](https://whatcanirunai.vercel.app/models/voxtral-small-24b-2507/)\~17.9 GB at Q4                                           | **17.9** / 16.0 GB          | **17.9** / 16.0 GB               |
| [Mistral-Small-3.2-24B-Instruct-2506](https://whatcanirunai.vercel.app/models/mistral-small-3.2-24b-instruct-2506/)\~17.7 GB at Q4                 | **17.7** / 16.0 GB          | **17.7** / 16.0 GB               |
| [Mistral-Small-3.1-24B-Instruct-2503](https://whatcanirunai.vercel.app/models/mistral-small-3.1-24b-instruct-2503/)\~17.7 GB at Q4                 | **17.7** / 16.0 GB          | **17.7** / 16.0 GB               |
| [LFM2.5-24B-A2B](https://whatcanirunai.vercel.app/models/lfm2.5-24b-a2b/)\~17.7 GB at Q4                                                           | **17.7** / 16.0 GB          | **17.7** / 16.0 GB               |
| [LFM2-24B-A2B](https://whatcanirunai.vercel.app/models/lfm2-24b-a2b/)\~17.6 GB at Q4                                                               | **17.6** / 16.0 GB          | **17.6** / 16.0 GB               |
| [Mistral-Small-24B-Instruct-2501](https://whatcanirunai.vercel.app/models/mistral-small-24b-instruct-2501/)\~17.4 GB at Q4                         | **17.4** / 16.0 GB          | **17.4** / 16.0 GB               |
| [EuroLLM-22B-Instruct-2512](https://whatcanirunai.vercel.app/models/eurollm-22b-instruct-2512/)\~16.8 GB at Q4                                     | **16.8** / 16.0 GB          | **16.8** / 16.0 GB               |
| [EuroLLM-22B-2512](https://whatcanirunai.vercel.app/models/eurollm-22b-2512/)\~16.8 GB at Q4                                                       | **16.8** / 16.0 GB          | **16.8** / 16.0 GB               |
| [solar-pro-preview-instruct](https://whatcanirunai.vercel.app/models/solar-pro-preview-instruct/)\~16.4 GB at Q4                                   | **16.4** / 16.0 GB          | **16.4** / 16.0 GB               |
| [ERNIE-4.5-21B-A3B-PT](https://whatcanirunai.vercel.app/models/ernie-4.5-21b-a3b-pt/)\~16.3 GB at Q4                                               | **16.3** / 16.0 GB          | **16.3** / 16.0 GB               |
| [ERNIE-4.5-21B-A3B-Thinking](https://whatcanirunai.vercel.app/models/ernie-4.5-21b-a3b-thinking/)\~16.2 GB at Q4                                   | **16.2** / 16.0 GB          | **16.2** / 16.0 GB               |
| [gpt-oss-20b](https://whatcanirunai.vercel.app/models/gpt-oss-20b/)\~15.6 GB at Q4                                                                 | **15.6** / 16.0 GB          | **15.6** / 16.0 GB               |
| [reka-flash-3](https://whatcanirunai.vercel.app/models/reka-flash-3/)\~15.6 GB at Q4                                                               | **15.6** / 16.0 GB          | **15.6** / 16.0 GB               |
| [maple-preview](https://whatcanirunai.vercel.app/models/maple-preview/)\~15.1 GB at Q4                                                             | **15.1** / 16.0 GB          | **15.1** / 16.0 GB               |
| [internlm2\_5-20b-chat](https://whatcanirunai.vercel.app/models/internlm2-5-20b-chat/)\~14.8 GB at Q4                                              | **14.8** / 16.0 GB          | **14.8** / 16.0 GB               |
| [Groot-19B-A3B-261023](https://whatcanirunai.vercel.app/models/groot-19b-a3b-261023/)\~14.5 GB at Q4                                               | **14.5** / 16.0 GB          | **14.5** / 16.0 GB               |
| [Ling-Coder-lite](https://whatcanirunai.vercel.app/models/ling-coder-lite/)\~12.7 GB at Q4                                                         | **12.7** / 16.0 GB          | **12.7** / 16.0 GB               |
| [Ring-lite-distill-preview](https://whatcanirunai.vercel.app/models/ring-lite-distill-preview/)\~12.7 GB at Q4                                     | **12.7** / 16.0 GB          | **12.7** / 16.0 GB               |
| [Ling-lite](https://whatcanirunai.vercel.app/models/ling-lite/)\~12.7 GB at Q4                                                                     | **12.7** / 16.0 GB          | **12.7** / 16.0 GB               |
| [Ling-lite-1.5-2507](https://whatcanirunai.vercel.app/models/ling-lite-1.5-2507/)\~12.7 GB at Q4                                                   | **12.7** / 16.0 GB          | **12.7** / 16.0 GB               |
| [Ling-lite-1.5](https://whatcanirunai.vercel.app/models/ling-lite-1.5/)\~12.7 GB at Q4                                                             | **12.7** / 16.0 GB          | **12.7** / 16.0 GB               |
| [Ring-lite](https://whatcanirunai.vercel.app/models/ring-lite/)\~12.7 GB at Q4                                                                     | **12.7** / 16.0 GB          | **12.7** / 16.0 GB               |
| [Ring-mini-linear-2.0](https://whatcanirunai.vercel.app/models/ring-mini-linear-2.0/)\~12.5 GB at Q4                                               | **12.5** / 16.0 GB          | **12.5** / 16.0 GB               |
| [Kimi-VL-A3B-Instruct](https://whatcanirunai.vercel.app/models/kimi-vl-a3b-instruct/)\~12.4 GB at Q4                                               | **12.4** / 16.0 GB          | **12.4** / 16.0 GB               |
| [Kimi-VL-A3B-Thinking](https://whatcanirunai.vercel.app/models/kimi-vl-a3b-thinking/)\~12.4 GB at Q4                                               | **12.4** / 16.0 GB          | **12.4** / 16.0 GB               |
| [Kimi-VL-A3B-Thinking-2506](https://whatcanirunai.vercel.app/models/kimi-vl-a3b-thinking-2506/)\~12.4 GB at Q4                                     | **12.4** / 16.0 GB          | **12.4** / 16.0 GB               |
| [LLaDA2.1-mini](https://whatcanirunai.vercel.app/models/llada2.1-mini/)\~12.3 GB at Q4                                                             | **12.3** / 16.0 GB          | **12.3** / 16.0 GB               |
| [LLaDA2.0-mini](https://whatcanirunai.vercel.app/models/llada2.0-mini/)\~12.3 GB at Q4                                                             | **12.3** / 16.0 GB          | **12.3** / 16.0 GB               |
| [Ling-mini-2.0](https://whatcanirunai.vercel.app/models/ling-mini-2.0/)\~12.3 GB at Q4                                                             | **12.3** / 16.0 GB          | **12.3** / 16.0 GB               |
| [Ring-mini-2.0](https://whatcanirunai.vercel.app/models/ring-mini-2.0/)\~12.3 GB at Q4                                                             | **12.3** / 16.0 GB          | **12.3** / 16.0 GB               |
| [LLaDA2.2-mini](https://whatcanirunai.vercel.app/models/llada2.2-mini/)\~12.3 GB at Q4                                                             | **12.3** / 16.0 GB          | **12.3** / 16.0 GB               |
| [LLaDA2.0-mini-preview](https://whatcanirunai.vercel.app/models/llada2.0-mini-preview/)\~12.3 GB at Q4                                             | **12.3** / 16.0 GB          | **12.3** / 16.0 GB               |
| [Moonlight-16B-A3B-Instruct](https://whatcanirunai.vercel.app/models/moonlight-16b-a3b-instruct/)\~12.1 GB at Q4                                   | **12.1** / 16.0 GB          | **12.1** / 16.0 GB               |
| [Moonlight-16B-A3B](https://whatcanirunai.vercel.app/models/moonlight-16b-a3b/)\~12.1 GB at Q4                                                     | **12.1** / 16.0 GB          | **12.1** / 16.0 GB               |
| [Instella-MoE-16B-A3B-Think](https://whatcanirunai.vercel.app/models/instella-moe-16b-a3b-think/)\~12.1 GB at Q4                                   | **12.1** / 16.0 GB          | **12.1** / 16.0 GB               |
| [DeepSeek-Coder-V2-Lite-Instruct](https://whatcanirunai.vercel.app/models/deepseek-coder-v2-lite-instruct/)\~12.0 GB at Q4                         | **12.0** / 16.0 GB          | **12.0** / 16.0 GB               |
| [kanana-1.5-15.7b-a3b-instruct](https://whatcanirunai.vercel.app/models/kanana-1.5-15.7b-a3b-instruct/)\~11.9 GB at Q4                             | **11.9** / 16.0 GB          | **11.9** / 16.0 GB               |
| [Phi-4-reasoning-vision-15B](https://whatcanirunai.vercel.app/models/phi-4-reasoning-vision-15b/)\~11.5 GB at Q4                                   | **11.5** / 16.0 GB          | **11.5** / 16.0 GB               |
| [Apriel-Nemotron-15b-Thinker](https://whatcanirunai.vercel.app/models/apriel-nemotron-15b-thinker/)\~11.4 GB at Q4                                 | **11.4** / 16.0 GB          | **11.4** / 16.0 GB               |
| [Apriel-1.5-15b-Thinker](https://whatcanirunai.vercel.app/models/apriel-1.5-15b-thinker/)\~11.4 GB at Q4                                           | **11.4** / 16.0 GB          | **11.4** / 16.0 GB               |
| [Apriel-1.6-15b-Thinker](https://whatcanirunai.vercel.app/models/apriel-1.6-15b-thinker/)\~11.4 GB at Q4                                           | **11.4** / 16.0 GB          | **11.4** / 16.0 GB               |
| [Carbon-X (DNA)](https://whatcanirunai.vercel.app/models/carbon-x/)\~11.3 GB at Q4                                                                 | **11.3** / 16.0 GB          | **11.3** / 16.0 GB               |
| [Qwen2.5-Coder-14B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-coder-14b-instruct/)\~11.3 GB at Q4                                   | **11.3** / 16.0 GB          | **11.3** / 16.0 GB               |
| [DeepSeek-R1-Distill-Qwen-14B](https://whatcanirunai.vercel.app/models/deepseek-r1-distill-qwen-14b/)\~11.3 GB at Q4                               | **11.3** / 16.0 GB          | **11.3** / 16.0 GB               |
| [Qwen2.5-14B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-14b-instruct/)\~11.3 GB at Q4                                               | **11.3** / 16.0 GB          | **11.3** / 16.0 GB               |
| [Qwen2.5-14B](https://whatcanirunai.vercel.app/models/qwen2.5-14b/)\~11.3 GB at Q4                                                                 | **11.3** / 16.0 GB          | **11.3** / 16.0 GB               |
| [Qwen2.5-14B-Instruct-1M](https://whatcanirunai.vercel.app/models/qwen2.5-14b-instruct-1m/)\~11.3 GB at Q4                                         | **11.3** / 16.0 GB          | **11.3** / 16.0 GB               |
| [Qwen2.5-Coder-14B](https://whatcanirunai.vercel.app/models/qwen2.5-coder-14b/)\~11.3 GB at Q4                                                     | **11.3** / 16.0 GB          | **11.3** / 16.0 GB               |
| [Qwen3-14B](https://whatcanirunai.vercel.app/models/qwen3-14b/)\~11.3 GB at Q4                                                                     | **11.3** / 16.0 GB          | **11.3** / 16.0 GB               |
| [JanusCoder-14B](https://whatcanirunai.vercel.app/models/januscoder-14b/)\~11.3 GB at Q4                                                           | **11.3** / 16.0 GB          | **11.3** / 16.0 GB               |
| [HyperCLOVAX-SEED-Think-14B](https://whatcanirunai.vercel.app/models/hyperclovax-seed-think-14b/)\~11.3 GB at Q4                                   | **11.3** / 16.0 GB          | **11.3** / 16.0 GB               |
| [phi-4](https://whatcanirunai.vercel.app/models/phi-4/)\~11.2 GB at Q4                                                                             | **11.2** / 16.0 GB          | **11.2** / 16.0 GB               |
| [Phi-4-reasoning](https://whatcanirunai.vercel.app/models/phi-4-reasoning/)\~11.2 GB at Q4                                                         | **11.2** / 16.0 GB          | **11.2** / 16.0 GB               |
| [Phi-4-reasoning-plus](https://whatcanirunai.vercel.app/models/phi-4-reasoning-plus/)\~11.2 GB at Q4                                               | **11.2** / 16.0 GB          | **11.2** / 16.0 GB               |
| [OLMo-2-1124-13B-Instruct](https://whatcanirunai.vercel.app/models/olmo-2-1124-13b-instruct/)\~10.6 GB at Q4                                       | **10.6** / 16.0 GB          | **10.6** / 16.0 GB               |
| [Mistral-Nemo-Instruct-2407](https://whatcanirunai.vercel.app/models/mistral-nemo-instruct-2407/)\~9.5 GB at Q4                                    | **9.5** / 16.0 GB           | **9.5** / 16.0 GB                |
| [gemma-3-12b-it](https://whatcanirunai.vercel.app/models/gemma-3-12b-it/)\~9.5 GB at Q4                                                            | **9.5** / 16.0 GB           | **9.5** / 16.0 GB                |
| [gemma-3-12b-pt](https://whatcanirunai.vercel.app/models/gemma-3-12b-pt/)\~9.5 GB at Q4                                                            | **9.5** / 16.0 GB           | **9.5** / 16.0 GB                |
| [Mellum2.1-12B-A2.5B-Thinking](https://whatcanirunai.vercel.app/models/mellum2.1-12b-a2.5b-thinking/)\~9.5 GB at Q4                                | **9.5** / 16.0 GB           | **9.5** / 16.0 GB                |
| [Mellum2-12B-A2.5B-Thinking](https://whatcanirunai.vercel.app/models/mellum2-12b-a2.5b-thinking/)\~9.5 GB at Q4                                    | **9.5** / 16.0 GB           | **9.5** / 16.0 GB                |
| [Mellum2-12B-A2.5B-Instruct](https://whatcanirunai.vercel.app/models/mellum2-12b-a2.5b-instruct/)\~9.5 GB at Q4                                    | **9.5** / 16.0 GB           | **9.5** / 16.0 GB                |
| [Mellum2-12B-A2.5B-Thinking-SFT](https://whatcanirunai.vercel.app/models/mellum2-12b-a2.5b-thinking-sft/)\~9.5 GB at Q4                            | **9.5** / 16.0 GB           | **9.5** / 16.0 GB                |
| [Mellum2.1-12B-A2.5B-Thinking-MTP](https://whatcanirunai.vercel.app/models/mellum2.1-12b-a2.5b-thinking-mtp/)\~9.5 GB at Q4                        | **9.5** / 16.0 GB           | **9.5** / 16.0 GB                |
| [Gemma 4 12B](https://whatcanirunai.vercel.app/models/gemma-4-12b-it/)\~9.3 GB at Q4                                                               | **9.3** / 16.0 GB           | **9.3** / 16.0 GB                |
| [HyperCLOVAX-SEED-Omni-8B](https://whatcanirunai.vercel.app/models/hyperclovax-seed-omni-8b/)\~8.5 GB at Q4                                        | **8.5** / 16.0 GB           | **8.5** / 16.0 GB                |
| [Llama-3.2-11B-Vision-Instruct](https://whatcanirunai.vercel.app/models/llama-3.2-11b-vision-instruct/)\~8.4 GB at Q4                              | **8.4** / 16.0 GB           | **8.4** / 16.0 GB                |
| [Llama-3.2-11B-Vision](https://whatcanirunai.vercel.app/models/llama-3.2-11b-vision/)\~8.4 GB at Q4                                                | **8.4** / 16.0 GB           | **8.4** / 16.0 GB                |
| [Falcon3-10B-Instruct](https://whatcanirunai.vercel.app/models/falcon3-10b-instruct/)\~8.2 GB at Q4                                                | **8.2** / 16.0 GB           | **8.2** / 16.0 GB                |
| [GLM-4.1V-9B-Thinking](https://whatcanirunai.vercel.app/models/glm-4.1v-9b-thinking/)\~8.2 GB at Q4                                                | **8.2** / 16.0 GB           | **8.2** / 16.0 GB                |
| [GLM-4.6V-Flash](https://whatcanirunai.vercel.app/models/glm-4.6v-flash/)\~8.2 GB at Q4                                                            | **8.2** / 16.0 GB           | **8.2** / 16.0 GB                |
| [GLM-4.1V-9B-Base](https://whatcanirunai.vercel.app/models/glm-4.1v-9b-base/)\~8.2 GB at Q4                                                        | **8.2** / 16.0 GB           | **8.2** / 16.0 GB                |
| [Glyph](https://whatcanirunai.vercel.app/models/glyph/)\~8.2 GB at Q4                                                                              | **8.2** / 16.0 GB           | **8.2** / 16.0 GB                |
| [INTELLECT-1-Instruct](https://whatcanirunai.vercel.app/models/intellect-1-instruct/)\~8.1 GB at Q4                                                | **8.1** / 16.0 GB           | **8.1** / 16.0 GB                |
| [INTELLECT-1](https://whatcanirunai.vercel.app/models/intellect-1/)\~8.1 GB at Q4                                                                  | **8.1** / 16.0 GB           | **8.1** / 16.0 GB                |
| [ZAYA1-VL-8B](https://whatcanirunai.vercel.app/models/zaya1-vl-8b/)\~7.8 GB at Q4                                                                  | **7.8** / 16.0 GB           | **7.8** / 16.0 GB                |
| [SenseNova-Loop-9B-Preview](https://whatcanirunai.vercel.app/models/sensenova-loop-9b-preview/)\~7.7 GB at Q4                                      | **7.7** / 16.0 GB           | **7.7** / 16.0 GB                |
| [Ornith-1.5-9B](https://whatcanirunai.vercel.app/models/ornith-1.5-9b/)\~7.7 GB at Q4                                                              | **7.7** / 16.0 GB           | **7.7** / 16.0 GB                |
| [Qwen3.5-9B](https://whatcanirunai.vercel.app/models/qwen3.5-9b/)\~7.7 GB at Q4                                                                    | **7.7** / 16.0 GB           | **7.7** / 16.0 GB                |
| [MiniCPM-SALA](https://whatcanirunai.vercel.app/models/minicpm-sala/)\~7.6 GB at Q4                                                                | **7.6** / 16.0 GB           | **7.6** / 16.0 GB                |
| [NorthCUA-Nano](https://whatcanirunai.vercel.app/models/northcua-nano/)\~7.6 GB at Q4                                                              | **7.6** / 16.0 GB           | **7.6** / 16.0 GB                |
| [GLM-4-9B-0414](https://whatcanirunai.vercel.app/models/glm-4-9b-0414/)\~7.6 GB at Q4                                                              | **7.6** / 16.0 GB           | **7.6** / 16.0 GB                |
| [GLM-Z1-9B-0414](https://whatcanirunai.vercel.app/models/glm-z1-9b-0414/)\~7.6 GB at Q4                                                            | **7.6** / 16.0 GB           | **7.6** / 16.0 GB                |
| [codegeex4-all-9b](https://whatcanirunai.vercel.app/models/codegeex4-all-9b/)\~7.6 GB at Q4                                                        | **7.6** / 16.0 GB           | **7.6** / 16.0 GB                |
| [glm-4-9b-chat-hf](https://whatcanirunai.vercel.app/models/glm-4-9b-chat-hf/)\~7.6 GB at Q4                                                        | **7.6** / 16.0 GB           | **7.6** / 16.0 GB                |
| [moondream3-preview](https://whatcanirunai.vercel.app/models/moondream3-preview/)\~7.5 GB at Q4                                                    | **7.5** / 16.0 GB           | **7.5** / 16.0 GB                |
| [gemma-2-9b-it](https://whatcanirunai.vercel.app/models/gemma-2-9b-it/)\~7.4 GB at Q4                                                              | **7.4** / 16.0 GB           | **7.4** / 16.0 GB                |
| [gemma-2-9b](https://whatcanirunai.vercel.app/models/gemma-2-9b/)\~7.4 GB at Q4                                                                    | **7.4** / 16.0 GB           | **7.4** / 16.0 GB                |
| [Gemma-SEA-LION-v3-9B-IT](https://whatcanirunai.vercel.app/models/gemma-sea-lion-v3-9b-it/)\~7.4 GB at Q4                                          | **7.4** / 16.0 GB           | **7.4** / 16.0 GB                |
| [EuroLLM-9B-Instruct-2512](https://whatcanirunai.vercel.app/models/eurollm-9b-instruct-2512/)\~7.4 GB at Q4                                        | **7.4** / 16.0 GB           | **7.4** / 16.0 GB                |
| [NVIDIA-Nemotron-Nano-9B-v2](https://whatcanirunai.vercel.app/models/nvidia-nemotron-nano-9b-v2/)\~7.2 GB at Q4                                    | **7.2** / 16.0 GB           | **7.2** / 16.0 GB                |
| [ZAYA1-base](https://whatcanirunai.vercel.app/models/zaya1-base/)\~7.2 GB at Q4                                                                    | **7.2** / 16.0 GB           | **7.2** / 16.0 GB                |
| [Yi-Coder-9B-Chat](https://whatcanirunai.vercel.app/models/yi-coder-9b-chat/)\~7.2 GB at Q4                                                        | **7.2** / 16.0 GB           | **7.2** / 16.0 GB                |
| [Yi-Coder-9B](https://whatcanirunai.vercel.app/models/yi-coder-9b/)\~7.2 GB at Q4                                                                  | **7.2** / 16.0 GB           | **7.2** / 16.0 GB                |
| [internlm3-8b-instruct](https://whatcanirunai.vercel.app/models/internlm3-8b-instruct/)\~7.1 GB at Q4                                              | **7.1** / 16.0 GB           | **7.1** / 16.0 GB                |
| [granite-4.1-8b](https://whatcanirunai.vercel.app/models/granite-4.1-8b/)\~7.1 GB at Q4                                                            | **7.1** / 16.0 GB           | **7.1** / 16.0 GB                |
| [granite-4.2-8b](https://whatcanirunai.vercel.app/models/granite-4.2-8b/)\~7.1 GB at Q4                                                            | **7.1** / 16.0 GB           | **7.1** / 16.0 GB                |
| [granite-switch-4.1-8b](https://whatcanirunai.vercel.app/models/granite-switch-4.1-8b/)\~7.1 GB at Q4                                              | **7.1** / 16.0 GB           | **7.1** / 16.0 GB                |
| [Qwen3-VL-8B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-vl-8b-instruct/)\~7.1 GB at Q4                                                | **7.1** / 16.0 GB           | **7.1** / 16.0 GB                |
| [Qwen3-VL-8B-Thinking](https://whatcanirunai.vercel.app/models/qwen3-vl-8b-thinking/)\~7.1 GB at Q4                                                | **7.1** / 16.0 GB           | **7.1** / 16.0 GB                |
| [UI-Venus-1.5-8B](https://whatcanirunai.vercel.app/models/ui-venus-1.5-8b/)\~7.1 GB at Q4                                                          | **7.1** / 16.0 GB           | **7.1** / 16.0 GB                |
| [Llama-3.1-Nemotron-Nano-VL-8B-V1](https://whatcanirunai.vercel.app/models/llama-3.1-nemotron-nano-vl-8b-v1/)\~7.1 GB at Q4                        | **7.1** / 16.0 GB           | **7.1** / 16.0 GB                |
| [MiniCPM-V-4\_5](https://whatcanirunai.vercel.app/models/minicpm-v-4-5/)\~7.1 GB at Q4                                                             | **7.1** / 16.0 GB           | **7.1** / 16.0 GB                |
| [aya-vision-8b](https://whatcanirunai.vercel.app/models/aya-vision-8b/)\~7.0 GB at Q4                                                              | **7.0** / 16.0 GB           | **7.0** / 16.0 GB                |
| [Intern-S1-mini](https://whatcanirunai.vercel.app/models/intern-s1-mini/)\~7.0 GB at Q4                                                            | **7.0** / 16.0 GB           | **7.0** / 16.0 GB                |
| [Nemotron-Labs-Diffusion-8B-Base](https://whatcanirunai.vercel.app/models/nemotron-labs-diffusion-8b-base/)\~6.9 GB at Q4                          | **6.9** / 16.0 GB           | **6.9** / 16.0 GB                |
| [LFM2.5-8B-A1B](https://whatcanirunai.vercel.app/models/lfm2.5-8b-a1b/)\~6.9 GB at Q4                                                              | **6.9** / 16.0 GB           | **6.9** / 16.0 GB                |
| [Mistral-NeMo-Minitron-8B-Base](https://whatcanirunai.vercel.app/models/mistral-nemo-minitron-8b-base/)\~6.9 GB at Q4                              | **6.9** / 16.0 GB           | **6.9** / 16.0 GB                |
| [LFM2-8B-A1B](https://whatcanirunai.vercel.app/models/lfm2-8b-a1b/)\~6.8 GB at Q4                                                                  | **6.8** / 16.0 GB           | **6.8** / 16.0 GB                |
| [rnj-1-instruct](https://whatcanirunai.vercel.app/models/rnj-1-instruct/)\~6.8 GB at Q4                                                            | **6.8** / 16.0 GB           | **6.8** / 16.0 GB                |
| [MiMo-VL-7B-RL-2508](https://whatcanirunai.vercel.app/models/mimo-vl-7b-rl-2508/)\~6.8 GB at Q4                                                    | **6.8** / 16.0 GB           | **6.8** / 16.0 GB                |
| [MiMo-VL-7B-RL](https://whatcanirunai.vercel.app/models/mimo-vl-7b-rl/)\~6.8 GB at Q4                                                              | **6.8** / 16.0 GB           | **6.8** / 16.0 GB                |
| [MiMo-Embodied-7B](https://whatcanirunai.vercel.app/models/mimo-embodied-7b/)\~6.8 GB at Q4                                                        | **6.8** / 16.0 GB           | **6.8** / 16.0 GB                |
| [MiMo-VL-7B-SFT](https://whatcanirunai.vercel.app/models/mimo-vl-7b-sft/)\~6.8 GB at Q4                                                            | **6.8** / 16.0 GB           | **6.8** / 16.0 GB                |
| [Qwen2.5-VL-7B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-vl-7b-instruct/)\~6.8 GB at Q4                                            | **6.8** / 16.0 GB           | **6.8** / 16.0 GB                |
| [UI-TARS-1.5-7B](https://whatcanirunai.vercel.app/models/ui-tars-1.5-7b/)\~6.8 GB at Q4                                                            | **6.8** / 16.0 GB           | **6.8** / 16.0 GB                |
| [Fara-7B](https://whatcanirunai.vercel.app/models/fara-7b/)\~6.8 GB at Q4                                                                          | **6.8** / 16.0 GB           | **6.8** / 16.0 GB                |
| [UI-Venus-Ground-7B](https://whatcanirunai.vercel.app/models/ui-venus-ground-7b/)\~6.8 GB at Q4                                                    | **6.8** / 16.0 GB           | **6.8** / 16.0 GB                |
| [Qwen2-VL-7B-Instruct](https://whatcanirunai.vercel.app/models/qwen2-vl-7b-instruct/)\~6.8 GB at Q4                                                | **6.8** / 16.0 GB           | **6.8** / 16.0 GB                |
| [UI-TARS-7B-DPO](https://whatcanirunai.vercel.app/models/ui-tars-7b-dpo/)\~6.8 GB at Q4                                                            | **6.8** / 16.0 GB           | **6.8** / 16.0 GB                |
| [UI-TARS-7B-SFT](https://whatcanirunai.vercel.app/models/ui-tars-7b-sft/)\~6.8 GB at Q4                                                            | **6.8** / 16.0 GB           | **6.8** / 16.0 GB                |
| [Seed-Coder-8B-Instruct](https://whatcanirunai.vercel.app/models/seed-coder-8b-instruct/)\~6.8 GB at Q4                                            | **6.8** / 16.0 GB           | **6.8** / 16.0 GB                |
| [Seed-Coder-8B-Reasoning](https://whatcanirunai.vercel.app/models/seed-coder-8b-reasoning/)\~6.8 GB at Q4                                          | **6.8** / 16.0 GB           | **6.8** / 16.0 GB                |
| [Stable-DiffCoder-8B-Instruct](https://whatcanirunai.vercel.app/models/stable-diffcoder-8b-instruct/)\~6.8 GB at Q4                                | **6.8** / 16.0 GB           | **6.8** / 16.0 GB                |
| [Qwen3-8B](https://whatcanirunai.vercel.app/models/qwen3-8b/)\~6.7 GB at Q4                                                                        | **6.7** / 16.0 GB           | **6.7** / 16.0 GB                |
| [DeepSeek-R1-0528-Qwen3-8B](https://whatcanirunai.vercel.app/models/deepseek-r1-0528-qwen3-8b/)\~6.7 GB at Q4                                      | **6.7** / 16.0 GB           | **6.7** / 16.0 GB                |
| [Qwen3-8B-Base](https://whatcanirunai.vercel.app/models/qwen3-8b-base/)\~6.7 GB at Q4                                                              | **6.7** / 16.0 GB           | **6.7** / 16.0 GB                |
| [WeDLM-8B-Instruct](https://whatcanirunai.vercel.app/models/wedlm-8b-instruct/)\~6.7 GB at Q4                                                      | **6.7** / 16.0 GB           | **6.7** / 16.0 GB                |
| [PaCoRe-8B](https://whatcanirunai.vercel.app/models/pacore-8b/)\~6.7 GB at Q4                                                                      | **6.7** / 16.0 GB           | **6.7** / 16.0 GB                |
| [MiniCPM4-8B](https://whatcanirunai.vercel.app/models/minicpm4-8b/)\~6.7 GB at Q4                                                                  | **6.7** / 16.0 GB           | **6.7** / 16.0 GB                |
| [MiniCPM4.1-8B](https://whatcanirunai.vercel.app/models/minicpm4.1-8b/)\~6.7 GB at Q4                                                              | **6.7** / 16.0 GB           | **6.7** / 16.0 GB                |
| [AgentCPM-Report](https://whatcanirunai.vercel.app/models/agentcpm-report/)\~6.7 GB at Q4                                                          | **6.7** / 16.0 GB           | **6.7** / 16.0 GB                |
| [MiniCPM4-MCP](https://whatcanirunai.vercel.app/models/minicpm4-mcp/)\~6.7 GB at Q4                                                                | **6.7** / 16.0 GB           | **6.7** / 16.0 GB                |
| [granite-3.3-8b-instruct](https://whatcanirunai.vercel.app/models/granite-3.3-8b-instruct/)\~6.7 GB at Q4                                          | **6.7** / 16.0 GB           | **6.7** / 16.0 GB                |
| [granite-3.1-8b-instruct](https://whatcanirunai.vercel.app/models/granite-3.1-8b-instruct/)\~6.7 GB at Q4                                          | **6.7** / 16.0 GB           | **6.7** / 16.0 GB                |
| [granite-3.2-8b-instruct](https://whatcanirunai.vercel.app/models/granite-3.2-8b-instruct/)\~6.7 GB at Q4                                          | **6.7** / 16.0 GB           | **6.7** / 16.0 GB                |
| [granite-3.0-8b-instruct](https://whatcanirunai.vercel.app/models/granite-3.0-8b-instruct/)\~6.7 GB at Q4                                          | **6.7** / 16.0 GB           | **6.7** / 16.0 GB                |
| [Apertus-8B-Instruct-2509](https://whatcanirunai.vercel.app/models/apertus-8b-instruct-2509/)\~6.6 GB at Q4                                        | **6.6** / 16.0 GB           | **6.6** / 16.0 GB                |
| [Apertus-8B-2509](https://whatcanirunai.vercel.app/models/apertus-8b-2509/)\~6.6 GB at Q4                                                          | **6.6** / 16.0 GB           | **6.6** / 16.0 GB                |
| [Llama-3.1-Tulu-3-8B](https://whatcanirunai.vercel.app/models/llama-3.1-tulu-3-8b/)\~6.6 GB at Q4                                                  | **6.6** / 16.0 GB           | **6.6** / 16.0 GB                |
| [Llama-3.1-Tulu-3-8B-DPO](https://whatcanirunai.vercel.app/models/llama-3.1-tulu-3-8b-dpo/)\~6.6 GB at Q4                                          | **6.6** / 16.0 GB           | **6.6** / 16.0 GB                |
| [Llama-3.1-Tulu-3.1-8B](https://whatcanirunai.vercel.app/models/llama-3.1-tulu-3.1-8b/)\~6.6 GB at Q4                                              | **6.6** / 16.0 GB           | **6.6** / 16.0 GB                |
| [kanana-1.5-8b-instruct-2505](https://whatcanirunai.vercel.app/models/kanana-1.5-8b-instruct-2505/)\~6.6 GB at Q4                                  | **6.6** / 16.0 GB           | **6.6** / 16.0 GB                |
| [Llama-3.1-8B-Instruct](https://whatcanirunai.vercel.app/models/llama-3.1-8b-instruct/)\~6.6 GB at Q4                                              | **6.6** / 16.0 GB           | **6.6** / 16.0 GB                |
| [Llama-3.1-8B](https://whatcanirunai.vercel.app/models/llama-3.1-8b/)\~6.6 GB at Q4                                                                | **6.6** / 16.0 GB           | **6.6** / 16.0 GB                |
| [DeepSeek-R1-Distill-Llama-8B](https://whatcanirunai.vercel.app/models/deepseek-r1-distill-llama-8b/)\~6.6 GB at Q4                                | **6.6** / 16.0 GB           | **6.6** / 16.0 GB                |
| [Meta-Llama-3.1-8B-Instruct](https://whatcanirunai.vercel.app/models/meta-llama-3.1-8b-instruct/)\~6.6 GB at Q4                                    | **6.6** / 16.0 GB           | **6.6** / 16.0 GB                |
| [L3-8B-Stheno-v3.2](https://whatcanirunai.vercel.app/models/l3-8b-stheno-v3.2/)\~6.6 GB at Q4                                                      | **6.6** / 16.0 GB           | **6.6** / 16.0 GB                |
| [Llama-3.1-Nemotron-Nano-8B-v1](https://whatcanirunai.vercel.app/models/llama-3.1-nemotron-nano-8b-v1/)\~6.6 GB at Q4                              | **6.6** / 16.0 GB           | **6.6** / 16.0 GB                |
| [Meta-Llama-3.1-8B](https://whatcanirunai.vercel.app/models/meta-llama-3.1-8b/)\~6.6 GB at Q4                                                      | **6.6** / 16.0 GB           | **6.6** / 16.0 GB                |
| [LongWriter-llama3.1-8b](https://whatcanirunai.vercel.app/models/longwriter-llama3.1-8b/)\~6.6 GB at Q4                                            | **6.6** / 16.0 GB           | **6.6** / 16.0 GB                |
| [Hy-MT2-7B](https://whatcanirunai.vercel.app/models/hy-mt2-7b/)\~6.6 GB at Q4                                                                      | **6.6** / 16.0 GB           | **6.6** / 16.0 GB                |
| [Nemotron 3.5 Bolt E4B](https://whatcanirunai.vercel.app/models/nemotron-3.5-bolt-e4b/)\~6.6 GB at Q4                                              | **6.6** / 16.0 GB           | **6.6** / 16.0 GB                |
| [Gemma 4 E4B](https://whatcanirunai.vercel.app/models/gemma-4-e4b-it/)\~6.6 GB at Q4                                                               | **6.6** / 16.0 GB           | **6.6** / 16.0 GB                |
| [Ling-3.0-tiny](https://whatcanirunai.vercel.app/models/ling-3.0-tiny/)\~6.5 GB at Q4                                                              | **6.5** / 16.0 GB           | **6.5** / 16.0 GB                |
| [MiMo-7B-RL](https://whatcanirunai.vercel.app/models/mimo-7b-rl/)\~6.5 GB at Q4                                                                    | **6.5** / 16.0 GB           | **6.5** / 16.0 GB                |
| [MiMo-7B-Base](https://whatcanirunai.vercel.app/models/mimo-7b-base/)\~6.5 GB at Q4                                                                | **6.5** / 16.0 GB           | **6.5** / 16.0 GB                |
| [MiMo-7B-RL-0530](https://whatcanirunai.vercel.app/models/mimo-7b-rl-0530/)\~6.5 GB at Q4                                                          | **6.5** / 16.0 GB           | **6.5** / 16.0 GB                |
| [MiMo-7B-SFT](https://whatcanirunai.vercel.app/models/mimo-7b-sft/)\~6.5 GB at Q4                                                                  | **6.5** / 16.0 GB           | **6.5** / 16.0 GB                |
| [EXAONE-3.5-7.8B-Instruct](https://whatcanirunai.vercel.app/models/exaone-3.5-7.8b-instruct/)\~6.5 GB at Q4                                        | **6.5** / 16.0 GB           | **6.5** / 16.0 GB                |
| [EXAONE-Deep-7.8B](https://whatcanirunai.vercel.app/models/exaone-deep-7.8b/)\~6.5 GB at Q4                                                        | **6.5** / 16.0 GB           | **6.5** / 16.0 GB                |
| [salamandra-7b-instruct](https://whatcanirunai.vercel.app/models/salamandra-7b-instruct/)\~6.4 GB at Q4                                            | **6.4** / 16.0 GB           | **6.4** / 16.0 GB                |
| [salamandra-7b](https://whatcanirunai.vercel.app/models/salamandra-7b/)\~6.4 GB at Q4                                                              | **6.4** / 16.0 GB           | **6.4** / 16.0 GB                |
| [salamandra-7b-instruct-2606](https://whatcanirunai.vercel.app/models/salamandra-7b-instruct-2606/)\~6.4 GB at Q4                                  | **6.4** / 16.0 GB           | **6.4** / 16.0 GB                |
| [FastVLM-7B](https://whatcanirunai.vercel.app/models/fastvlm-7b/)\~6.4 GB at Q4                                                                    | **6.4** / 16.0 GB           | **6.4** / 16.0 GB                |
| [Molmo2-O-7B](https://whatcanirunai.vercel.app/models/molmo2-o-7b/)\~6.4 GB at Q4                                                                  | **6.4** / 16.0 GB           | **6.4** / 16.0 GB                |
| [internlm2\_5-7b-chat](https://whatcanirunai.vercel.app/models/internlm2-5-7b-chat/)\~6.4 GB at Q4                                                 | **6.4** / 16.0 GB           | **6.4** / 16.0 GB                |
| [internlm2\_5-7b-chat-1m](https://whatcanirunai.vercel.app/models/internlm2-5-7b-chat-1m/)\~6.4 GB at Q4                                           | **6.4** / 16.0 GB           | **6.4** / 16.0 GB                |
| [Phi-mini-MoE-instruct](https://whatcanirunai.vercel.app/models/phi-mini-moe-instruct/)\~6.3 GB at Q4                                              | **6.3** / 16.0 GB           | **6.3** / 16.0 GB                |
| [Qwen2.5-Coder-7B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-coder-7b-instruct/)\~6.3 GB at Q4                                      | **6.3** / 16.0 GB           | **6.3** / 16.0 GB                |
| [DeepSeek-R1-Distill-Qwen-7B](https://whatcanirunai.vercel.app/models/deepseek-r1-distill-qwen-7b/)\~6.3 GB at Q4                                  | **6.3** / 16.0 GB           | **6.3** / 16.0 GB                |
| [Qwen2.5-7B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-7b-instruct/)\~6.3 GB at Q4                                                  | **6.3** / 16.0 GB           | **6.3** / 16.0 GB                |
| [Qwen2.5-7B](https://whatcanirunai.vercel.app/models/qwen2.5-7b/)\~6.3 GB at Q4                                                                    | **6.3** / 16.0 GB           | **6.3** / 16.0 GB                |
| [Qwen2-7B-Instruct](https://whatcanirunai.vercel.app/models/qwen2-7b-instruct/)\~6.3 GB at Q4                                                      | **6.3** / 16.0 GB           | **6.3** / 16.0 GB                |
| [Qwen2.5-Coder-7B](https://whatcanirunai.vercel.app/models/qwen2.5-coder-7b/)\~6.3 GB at Q4                                                        | **6.3** / 16.0 GB           | **6.3** / 16.0 GB                |
| [Qwen2-7B](https://whatcanirunai.vercel.app/models/qwen2-7b/)\~6.3 GB at Q4                                                                        | **6.3** / 16.0 GB           | **6.3** / 16.0 GB                |
| [Qwen2.5-7B-Instruct-1M](https://whatcanirunai.vercel.app/models/qwen2.5-7b-instruct-1m/)\~6.3 GB at Q4                                            | **6.3** / 16.0 GB           | **6.3** / 16.0 GB                |
| [Qwen2.5-Math-7B](https://whatcanirunai.vercel.app/models/qwen2.5-math-7b/)\~6.3 GB at Q4                                                          | **6.3** / 16.0 GB           | **6.3** / 16.0 GB                |
| [Qwen2.5-Math-7B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-math-7b-instruct/)\~6.3 GB at Q4                                        | **6.3** / 16.0 GB           | **6.3** / 16.0 GB                |
| [Marco-o1](https://whatcanirunai.vercel.app/models/marco-o1/)\~6.3 GB at Q4                                                                        | **6.3** / 16.0 GB           | **6.3** / 16.0 GB                |
| [SeaLLMs-v3-7B-Chat](https://whatcanirunai.vercel.app/models/seallms-v3-7b-chat/)\~6.3 GB at Q4                                                    | **6.3** / 16.0 GB           | **6.3** / 16.0 GB                |
| [Arcee-Spark](https://whatcanirunai.vercel.app/models/arcee-spark/)\~6.3 GB at Q4                                                                  | **6.3** / 16.0 GB           | **6.3** / 16.0 GB                |
| [Falcon-H1-7B-Instruct](https://whatcanirunai.vercel.app/models/falcon-h1-7b-instruct/)\~6.3 GB at Q4                                              | **6.3** / 16.0 GB           | **6.3** / 16.0 GB                |
| [Falcon-H1R-7B](https://whatcanirunai.vercel.app/models/falcon-h1r-7b/)\~6.3 GB at Q4                                                              | **6.3** / 16.0 GB           | **6.3** / 16.0 GB                |
| [starvector-8b-im2svg](https://whatcanirunai.vercel.app/models/starvector-8b-im2svg/)\~6.2 GB at Q4                                                | **6.2** / 16.0 GB           | **6.2** / 16.0 GB                |
| [Falcon3-7B-Instruct](https://whatcanirunai.vercel.app/models/falcon3-7b-instruct/)\~6.2 GB at Q4                                                  | **6.2** / 16.0 GB           | **6.2** / 16.0 GB                |
| [Olmo-Hybrid-7B](https://whatcanirunai.vercel.app/models/olmo-hybrid-7b/)\~6.2 GB at Q4                                                            | **6.2** / 16.0 GB           | **6.2** / 16.0 GB                |
| [LLaDA-MoE-7B-A1B-Base](https://whatcanirunai.vercel.app/models/llada-moe-7b-a1b-base/)\~6.1 GB at Q4                                              | **6.1** / 16.0 GB           | **6.1** / 16.0 GB                |
| [Zamba2-7B-Instruct](https://whatcanirunai.vercel.app/models/zamba2-7b-instruct/)\~6.1 GB at Q4                                                    | **6.1** / 16.0 GB           | **6.1** / 16.0 GB                |
| [OLMo-2-1124-7B-Instruct](https://whatcanirunai.vercel.app/models/olmo-2-1124-7b-instruct/)\~6.1 GB at Q4                                          | **6.1** / 16.0 GB           | **6.1** / 16.0 GB                |
| [Olmo-3-7B-Think](https://whatcanirunai.vercel.app/models/olmo-3-7b-think/)\~6.1 GB at Q4                                                          | **6.1** / 16.0 GB           | **6.1** / 16.0 GB                |
| [Olmo-3-7B-Instruct](https://whatcanirunai.vercel.app/models/olmo-3-7b-instruct/)\~6.1 GB at Q4                                                    | **6.1** / 16.0 GB           | **6.1** / 16.0 GB                |
| [Olmo-3-1025-7B](https://whatcanirunai.vercel.app/models/olmo-3-1025-7b/)\~6.1 GB at Q4                                                            | **6.1** / 16.0 GB           | **6.1** / 16.0 GB                |
| [Olmo-3-7B-Instruct-SFT](https://whatcanirunai.vercel.app/models/olmo-3-7b-instruct-sft/)\~6.1 GB at Q4                                            | **6.1** / 16.0 GB           | **6.1** / 16.0 GB                |
| [Olmo-3-7B-Think-SFT](https://whatcanirunai.vercel.app/models/olmo-3-7b-think-sft/)\~6.1 GB at Q4                                                  | **6.1** / 16.0 GB           | **6.1** / 16.0 GB                |
| [Olmo-3-7B-Instruct-DPO](https://whatcanirunai.vercel.app/models/olmo-3-7b-instruct-dpo/)\~6.1 GB at Q4                                            | **6.1** / 16.0 GB           | **6.1** / 16.0 GB                |
| [Olmo-3-7B-RL-Zero-Math](https://whatcanirunai.vercel.app/models/olmo-3-7b-rl-zero-math/)\~6.1 GB at Q4                                            | **6.1** / 16.0 GB           | **6.1** / 16.0 GB                |
| [Olmo-3.1-7B-RL-Zero-Math](https://whatcanirunai.vercel.app/models/olmo-3.1-7b-rl-zero-math/)\~6.1 GB at Q4                                        | **6.1** / 16.0 GB           | **6.1** / 16.0 GB                |
| [Olmo-3-7B-Think-DPO](https://whatcanirunai.vercel.app/models/olmo-3-7b-think-dpo/)\~6.1 GB at Q4                                                  | **6.1** / 16.0 GB           | **6.1** / 16.0 GB                |
| [Mistral-7B-Instruct-v0.3](https://whatcanirunai.vercel.app/models/mistral-7b-instruct-v0.3/)\~6.1 GB at Q4                                        | **6.1** / 16.0 GB           | **6.1** / 16.0 GB                |
| [granite-4.0-h-tiny](https://whatcanirunai.vercel.app/models/granite-4.0-h-tiny/)\~5.8 GB at Q4                                                    | **5.8** / 16.0 GB           | **5.8** / 16.0 GB                |
| [OLMoE-1B-7B-0924-Instruct](https://whatcanirunai.vercel.app/models/olmoe-1b-7b-0924-instruct/)\~5.8 GB at Q4                                      | **5.8** / 16.0 GB           | **5.8** / 16.0 GB                |
| [OLMoE-1B-7B-0924](https://whatcanirunai.vercel.app/models/olmoe-1b-7b-0924/)\~5.8 GB at Q4                                                        | **5.8** / 16.0 GB           | **5.8** / 16.0 GB                |
| [OLMoE-1B-7B-0125-Instruct](https://whatcanirunai.vercel.app/models/olmoe-1b-7b-0125-instruct/)\~5.8 GB at Q4                                      | **5.8** / 16.0 GB           | **5.8** / 16.0 GB                |
| [OLMoE-1B-7B-0125](https://whatcanirunai.vercel.app/models/olmoe-1b-7b-0125/)\~5.8 GB at Q4                                                        | **5.8** / 16.0 GB           | **5.8** / 16.0 GB                |
| [OLMo-7B-0724-hf](https://whatcanirunai.vercel.app/models/olmo-7b-0724-hf/)\~5.8 GB at Q4                                                          | **5.8** / 16.0 GB           | **5.8** / 16.0 GB                |
| [granite-4.0-tiny-preview](https://whatcanirunai.vercel.app/models/granite-4.0-tiny-preview/)\~5.7 GB at Q4                                        | **5.7** / 16.0 GB           | **5.7** / 16.0 GB                |
| [YuE-s1-7B-anneal-en-cot](https://whatcanirunai.vercel.app/models/yue-s1-7b-anneal-en-cot/)\~5.3 GB at Q4                                          | **5.3** / 16.0 GB           | **5.3** / 16.0 GB                |
| [Trinity-Nano-Preview](https://whatcanirunai.vercel.app/models/trinity-nano-preview/)\~5.3 GB at Q4                                                | **5.3** / 16.0 GB           | **5.3** / 16.0 GB                |
| [Trinity-Nano-Base](https://whatcanirunai.vercel.app/models/trinity-nano-base/)\~5.3 GB at Q4                                                      | **5.3** / 16.0 GB           | **5.3** / 16.0 GB                |
| [gemma-3n-E2B-it](https://whatcanirunai.vercel.app/models/gemma-3n-e2b-it/)\~4.8 GB at Q4                                                          | **4.8** / 16.0 GB           | **4.8** / 16.0 GB                |
| [Youtu-VL-4B-Instruct](https://whatcanirunai.vercel.app/models/youtu-vl-4b-instruct/)\~4.7 GB at Q4                                                | **4.7** / 16.0 GB           | **4.7** / 16.0 GB                |
| [Gemma 4 E2B](https://whatcanirunai.vercel.app/models/gemma-4-e2b-it/)\~4.6 GB at Q4                                                               | **4.6** / 16.0 GB           | **4.6** / 16.0 GB                |
| [Molmo2-ER](https://whatcanirunai.vercel.app/models/molmo2-er/)\~4.4 GB at Q4                                                                      | **4.4** / 16.0 GB           | **4.4** / 16.0 GB                |
| [Apriel-5B-Instruct](https://whatcanirunai.vercel.app/models/apriel-5b-instruct/)\~4.4 GB at Q4                                                    | **4.4** / 16.0 GB           | **4.4** / 16.0 GB                |
| [WeVisOne-VL-4B](https://whatcanirunai.vercel.app/models/wevisone-vl-4b/)\~4.4 GB at Q4                                                            | **4.4** / 16.0 GB           | **4.4** / 16.0 GB                |
| [Mage-VL](https://whatcanirunai.vercel.app/models/mage-vl/)\~4.3 GB at Q4                                                                          | **4.3** / 16.0 GB           | **4.3** / 16.0 GB                |
| [Mage-VL-Cowork](https://whatcanirunai.vercel.app/models/mage-vl-cowork/)\~4.3 GB at Q4                                                            | **4.3** / 16.0 GB           | **4.3** / 16.0 GB                |
| [Qwen3.5-4B](https://whatcanirunai.vercel.app/models/qwen3.5-4b/)\~4.2 GB at Q4                                                                    | **4.2** / 16.0 GB           | **4.2** / 16.0 GB                |
| [S5-nano](https://whatcanirunai.vercel.app/models/s5-nano/)\~4.2 GB at Q4                                                                          | **4.2** / 16.0 GB           | **4.2** / 16.0 GB                |
| [AFM-4.5B](https://whatcanirunai.vercel.app/models/afm-4.5b/)\~4.2 GB at Q4                                                                        | **4.2** / 16.0 GB           | **4.2** / 16.0 GB                |
| [Llama-3.1-Minitron-4B-Width-Base](https://whatcanirunai.vercel.app/models/llama-3.1-minitron-4b-width-base/)\~4.1 GB at Q4                        | **4.1** / 16.0 GB           | **4.1** / 16.0 GB                |
| [Qwen3-VL-4B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-vl-4b-instruct/)\~4.1 GB at Q4                                                | **4.1** / 16.0 GB           | **4.1** / 16.0 GB                |
| [CapRL-Qwen3VL-4B](https://whatcanirunai.vercel.app/models/caprl-qwen3vl-4b/)\~4.1 GB at Q4                                                        | **4.1** / 16.0 GB           | **4.1** / 16.0 GB                |
| [glm-edge-4b-chat](https://whatcanirunai.vercel.app/models/glm-edge-4b-chat/)\~4.0 GB at Q4                                                        | **4.0** / 16.0 GB           | **4.0** / 16.0 GB                |
| [gemma-3-4b-it](https://whatcanirunai.vercel.app/models/gemma-3-4b-it/)\~4.0 GB at Q4                                                              | **4.0** / 16.0 GB           | **4.0** / 16.0 GB                |
| [medgemma-4b-it](https://whatcanirunai.vercel.app/models/medgemma-4b-it/)\~4.0 GB at Q4                                                            | **4.0** / 16.0 GB           | **4.0** / 16.0 GB                |
| [medgemma-1.5-4b-it](https://whatcanirunai.vercel.app/models/medgemma-1.5-4b-it/)\~4.0 GB at Q4                                                    | **4.0** / 16.0 GB           | **4.0** / 16.0 GB                |
| [gemma-3-4b-pt](https://whatcanirunai.vercel.app/models/gemma-3-4b-pt/)\~4.0 GB at Q4                                                              | **4.0** / 16.0 GB           | **4.0** / 16.0 GB                |
| [Nanbeige4.2-3B](https://whatcanirunai.vercel.app/models/nanbeige4.2-3b/)\~3.9 GB at Q4                                                            | **3.9** / 16.0 GB           | **3.9** / 16.0 GB                |
| [Phi-3.5-vision-instruct](https://whatcanirunai.vercel.app/models/phi-3.5-vision-instruct/)\~3.9 GB at Q4                                          | **3.9** / 16.0 GB           | **3.9** / 16.0 GB                |
| [Spark-X2.6-4B](https://whatcanirunai.vercel.app/models/spark-x2.6-4b/)\~3.9 GB at Q4                                                              | **3.9** / 16.0 GB           | **3.9** / 16.0 GB                |
| [Spark-X2.5-4B](https://whatcanirunai.vercel.app/models/spark-x2.5-4b/)\~3.9 GB at Q4                                                              | **3.9** / 16.0 GB           | **3.9** / 16.0 GB                |
| [POINTS-Reader](https://whatcanirunai.vercel.app/models/points-reader/)\~3.9 GB at Q4                                                              | **3.9** / 16.0 GB           | **3.9** / 16.0 GB                |
| [MiniCPM-V-4](https://whatcanirunai.vercel.app/models/minicpm-v-4/)\~3.8 GB at Q4                                                                  | **3.8** / 16.0 GB           | **3.8** / 16.0 GB                |
| [Qwen3-4B](https://whatcanirunai.vercel.app/models/qwen3-4b/)\~3.8 GB at Q4                                                                        | **3.8** / 16.0 GB           | **3.8** / 16.0 GB                |
| [Qwen3-4B-Instruct-2507](https://whatcanirunai.vercel.app/models/qwen3-4b-instruct-2507/)\~3.8 GB at Q4                                            | **3.8** / 16.0 GB           | **3.8** / 16.0 GB                |
| [Qwen3-4B-Thinking-2507](https://whatcanirunai.vercel.app/models/qwen3-4b-thinking-2507/)\~3.8 GB at Q4                                            | **3.8** / 16.0 GB           | **3.8** / 16.0 GB                |
| [Mellum-4b-base](https://whatcanirunai.vercel.app/models/mellum-4b-base/)\~3.8 GB at Q4                                                            | **3.8** / 16.0 GB           | **3.8** / 16.0 GB                |
| [granite-4.0-3b-vision](https://whatcanirunai.vercel.app/models/granite-4.0-3b-vision/)\~3.8 GB at Q4                                              | **3.8** / 16.0 GB           | **3.8** / 16.0 GB                |
| [granite-vision-4.1-4b](https://whatcanirunai.vercel.app/models/granite-vision-4.1-4b/)\~3.8 GB at Q4                                              | **3.8** / 16.0 GB           | **3.8** / 16.0 GB                |
| [Nemotron Labs Dory 1.0 4B](https://whatcanirunai.vercel.app/models/nemotron-labs-dory1.0-4b/)\~3.8 GB at Q4                                       | **3.8** / 16.0 GB           | **3.8** / 16.0 GB                |
| [NVIDIA-Nemotron-3-Nano-4B-BF16](https://whatcanirunai.vercel.app/models/nvidia-nemotron-3-nano-4b-bf16/)\~3.8 GB at Q4                            | **3.8** / 16.0 GB           | **3.8** / 16.0 GB                |
| [Nanbeige4.1-3B](https://whatcanirunai.vercel.app/models/nanbeige4.1-3b/)\~3.7 GB at Q4                                                            | **3.7** / 16.0 GB           | **3.7** / 16.0 GB                |
| [Nanbeige4-3B-Thinking-2511](https://whatcanirunai.vercel.app/models/nanbeige4-3b-thinking-2511/)\~3.7 GB at Q4                                    | **3.7** / 16.0 GB           | **3.7** / 16.0 GB                |
| [Phi-4-mini-flash-reasoning](https://whatcanirunai.vercel.app/models/phi-4-mini-flash-reasoning/)\~3.7 GB at Q4                                    | **3.7** / 16.0 GB           | **3.7** / 16.0 GB                |
| [Phi-4-mini-instruct](https://whatcanirunai.vercel.app/models/phi-4-mini-instruct/)\~3.7 GB at Q4                                                  | **3.7** / 16.0 GB           | **3.7** / 16.0 GB                |
| [Phi-4-mini-reasoning](https://whatcanirunai.vercel.app/models/phi-4-mini-reasoning/)\~3.7 GB at Q4                                                | **3.7** / 16.0 GB           | **3.7** / 16.0 GB                |
| [Nemotron-Labs-Diffusion-3B](https://whatcanirunai.vercel.app/models/nemotron-labs-diffusion-3b/)\~3.7 GB at Q4                                    | **3.7** / 16.0 GB           | **3.7** / 16.0 GB                |
| [Phi-3.5-mini-instruct](https://whatcanirunai.vercel.app/models/phi-3.5-mini-instruct/)\~3.7 GB at Q4                                              | **3.7** / 16.0 GB           | **3.7** / 16.0 GB                |
| [MediPhi-Instruct](https://whatcanirunai.vercel.app/models/mediphi-instruct/)\~3.7 GB at Q4                                                        | **3.7** / 16.0 GB           | **3.7** / 16.0 GB                |
| [MediPhi](https://whatcanirunai.vercel.app/models/mediphi/)\~3.7 GB at Q4                                                                          | **3.7** / 16.0 GB           | **3.7** / 16.0 GB                |
| [MediPhi-Clinical](https://whatcanirunai.vercel.app/models/mediphi-clinical/)\~3.7 GB at Q4                                                        | **3.7** / 16.0 GB           | **3.7** / 16.0 GB                |
| [MediPhi-PubMed](https://whatcanirunai.vercel.app/models/mediphi-pubmed/)\~3.7 GB at Q4                                                            | **3.7** / 16.0 GB           | **3.7** / 16.0 GB                |
| [HY-Embodied-0.5](https://whatcanirunai.vercel.app/models/hy-embodied-0.5/)\~3.6 GB at Q4                                                          | **3.6** / 16.0 GB           | **3.6** / 16.0 GB                |
| [Phi-tiny-MoE-instruct](https://whatcanirunai.vercel.app/models/phi-tiny-moe-instruct/)\~3.6 GB at Q4                                              | **3.6** / 16.0 GB           | **3.6** / 16.0 GB                |
| [CapRL-3B](https://whatcanirunai.vercel.app/models/caprl-3b/)\~3.6 GB at Q4                                                                        | **3.6** / 16.0 GB           | **3.6** / 16.0 GB                |
| [HyperCLOVAX-SEED-Vision-Instruct-3B](https://whatcanirunai.vercel.app/models/hyperclovax-seed-vision-instruct-3b/)\~3.6 GB at Q4                  | **3.6** / 16.0 GB           | **3.6** / 16.0 GB                |
| [kanana-1.5-v-3b-instruct](https://whatcanirunai.vercel.app/models/kanana-1.5-v-3b-instruct/)\~3.6 GB at Q4                                        | **3.6** / 16.0 GB           | **3.6** / 16.0 GB                |
| [granite-4.2-3b](https://whatcanirunai.vercel.app/models/granite-4.2-3b/)\~3.6 GB at Q4                                                            | **3.6** / 16.0 GB           | **3.6** / 16.0 GB                |
| [kanana-2-3b-instruct](https://whatcanirunai.vercel.app/models/kanana-2-3b-instruct/)\~3.4 GB at Q4                                                | **3.4** / 16.0 GB           | **3.4** / 16.0 GB                |
| [granite-4.1-3b](https://whatcanirunai.vercel.app/models/granite-4.1-3b/)\~3.4 GB at Q4                                                            | **3.4** / 16.0 GB           | **3.4** / 16.0 GB                |
| [granite-4.0-micro](https://whatcanirunai.vercel.app/models/granite-4.0-micro/)\~3.4 GB at Q4                                                      | **3.4** / 16.0 GB           | **3.4** / 16.0 GB                |
| [granite-3.1-3b-a800m-instruct](https://whatcanirunai.vercel.app/models/granite-3.1-3b-a800m-instruct/)\~3.3 GB at Q4                              | **3.3** / 16.0 GB           | **3.3** / 16.0 GB                |
| [Falcon3-3B-Instruct](https://whatcanirunai.vercel.app/models/falcon3-3b-instruct/)\~3.3 GB at Q4                                                  | **3.3** / 16.0 GB           | **3.3** / 16.0 GB                |
| [Llama-3.2-3B-Instruct](https://whatcanirunai.vercel.app/models/llama-3.2-3b-instruct/)\~3.2 GB at Q4                                              | **3.2** / 16.0 GB           | **3.2** / 16.0 GB                |
| [Llama-3.2-3B](https://whatcanirunai.vercel.app/models/llama-3.2-3b/)\~3.2 GB at Q4                                                                | **3.2** / 16.0 GB           | **3.2** / 16.0 GB                |
| [Hermes-3-Llama-3.2-3B](https://whatcanirunai.vercel.app/models/hermes-3-llama-3.2-3b/)\~3.2 GB at Q4                                              | **3.2** / 16.0 GB           | **3.2** / 16.0 GB                |
| [DeepHermes-3-Llama-3-3B-Preview](https://whatcanirunai.vercel.app/models/deephermes-3-llama-3-3b-preview/)\~3.2 GB at Q4                          | **3.2** / 16.0 GB           | **3.2** / 16.0 GB                |
| [AI21-Jamba-Reasoning-3B](https://whatcanirunai.vercel.app/models/ai21-jamba-reasoning-3b/)\~3.2 GB at Q4                                          | **3.2** / 16.0 GB           | **3.2** / 16.0 GB                |
| [granite-4.0-h-micro](https://whatcanirunai.vercel.app/models/granite-4.0-h-micro/)\~3.2 GB at Q4                                                  | **3.2** / 16.0 GB           | **3.2** / 16.0 GB                |
| [Falcon-H1-3B-Instruct](https://whatcanirunai.vercel.app/models/falcon-h1-3b-instruct/)\~3.2 GB at Q4                                              | **3.2** / 16.0 GB           | **3.2** / 16.0 GB                |
| [d1-3B](https://whatcanirunai.vercel.app/models/d1-3b/)\~3.2 GB at Q4                                                                              | **3.2** / 16.0 GB           | **3.2** / 16.0 GB                |
| [LFM2.5-VL-3B](https://whatcanirunai.vercel.app/models/lfm2.5-vl-3b/)\~3.2 GB at Q4                                                                | **3.2** / 16.0 GB           | **3.2** / 16.0 GB                |
| [Qwen2.5-3B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-3b-instruct/)\~3.2 GB at Q4                                                  | **3.2** / 16.0 GB           | **3.2** / 16.0 GB                |
| [Qwen2.5-Coder-3B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-coder-3b-instruct/)\~3.2 GB at Q4                                      | **3.2** / 16.0 GB           | **3.2** / 16.0 GB                |
| [Qwen2.5-3B](https://whatcanirunai.vercel.app/models/qwen2.5-3b/)\~3.2 GB at Q4                                                                    | **3.2** / 16.0 GB           | **3.2** / 16.0 GB                |
| [Qwen2.5-Coder-3B](https://whatcanirunai.vercel.app/models/qwen2.5-coder-3b/)\~3.2 GB at Q4                                                        | **3.2** / 16.0 GB           | **3.2** / 16.0 GB                |
| [SmolLM3-3B](https://whatcanirunai.vercel.app/models/smollm3-3b/)\~3.1 GB at Q4                                                                    | **3.1** / 16.0 GB           | **3.1** / 16.0 GB                |
| [AI21-Jamba2-3B](https://whatcanirunai.vercel.app/models/ai21-jamba2-3b/)\~3.1 GB at Q4                                                            | **3.1** / 16.0 GB           | **3.1** / 16.0 GB                |
| [granite-swash-3b-a600m](https://whatcanirunai.vercel.app/models/granite-swash-3b-a600m/)\~3.1 GB at Q4                                            | **3.1** / 16.0 GB           | **3.1** / 16.0 GB                |
| [granite-vision-3.2-2b](https://whatcanirunai.vercel.app/models/granite-vision-3.2-2b/)\~3.1 GB at Q4                                              | **3.1** / 16.0 GB           | **3.1** / 16.0 GB                |
| [granite-vision-3.1-2b-preview](https://whatcanirunai.vercel.app/models/granite-vision-3.1-2b-preview/)\~3.1 GB at Q4                              | **3.1** / 16.0 GB           | **3.1** / 16.0 GB                |
| [granite-vision-3.3-2b-chart2csv-preview](https://whatcanirunai.vercel.app/models/granite-vision-3.3-2b-chart2csv-preview/)\~3.1 GB at Q4          | **3.1** / 16.0 GB           | **3.1** / 16.0 GB                |
| [LFM2.5-2.6B](https://whatcanirunai.vercel.app/models/lfm2.5-2.6b/)\~2.9 GB at Q4                                                                  | **2.9** / 16.0 GB           | **2.9** / 16.0 GB                |
| [Zamba2-2.7B](https://whatcanirunai.vercel.app/models/zamba2-2.7b/)\~2.9 GB at Q4                                                                  | **2.9** / 16.0 GB           | **2.9** / 16.0 GB                |
| [Zamba2-2.7B-instruct](https://whatcanirunai.vercel.app/models/zamba2-2.7b-instruct/)\~2.9 GB at Q4                                                | **2.9** / 16.0 GB           | **2.9** / 16.0 GB                |
| [granite-3.0-2b-instruct](https://whatcanirunai.vercel.app/models/granite-3.0-2b-instruct/)\~2.8 GB at Q4                                          | **2.8** / 16.0 GB           | **2.8** / 16.0 GB                |
| [gemma-2-2b-it](https://whatcanirunai.vercel.app/models/gemma-2-2b-it/)\~2.8 GB at Q4                                                              | **2.8** / 16.0 GB           | **2.8** / 16.0 GB                |
| [gemma-2-2b](https://whatcanirunai.vercel.app/models/gemma-2-2b/)\~2.8 GB at Q4                                                                    | **2.8** / 16.0 GB           | **2.8** / 16.0 GB                |
| [EuroMoE-2.6B-A0.6B-Instruct-Preview](https://whatcanirunai.vercel.app/models/euromoe-2.6b-a0.6b-instruct-preview/)\~2.8 GB at Q4                  | **2.8** / 16.0 GB           | **2.8** / 16.0 GB                |
| [Motif-2.6B](https://whatcanirunai.vercel.app/models/motif-2.6b/)\~2.8 GB at Q4                                                                    | **2.8** / 16.0 GB           | **2.8** / 16.0 GB                |
| [LFM2-2.6B](https://whatcanirunai.vercel.app/models/lfm2-2.6b/)\~2.8 GB at Q4                                                                      | **2.8** / 16.0 GB           | **2.8** / 16.0 GB                |
| [LFM2-2.6B-Exp](https://whatcanirunai.vercel.app/models/lfm2-2.6b-exp/)\~2.8 GB at Q4                                                              | **2.8** / 16.0 GB           | **2.8** / 16.0 GB                |
| [LFM2-2.6B-Transcript](https://whatcanirunai.vercel.app/models/lfm2-2.6b-transcript/)\~2.8 GB at Q4                                                | **2.8** / 16.0 GB           | **2.8** / 16.0 GB                |
| [granite-3.3-2b-instruct](https://whatcanirunai.vercel.app/models/granite-3.3-2b-instruct/)\~2.8 GB at Q4                                          | **2.8** / 16.0 GB           | **2.8** / 16.0 GB                |
| [granite-3.1-2b-instruct](https://whatcanirunai.vercel.app/models/granite-3.1-2b-instruct/)\~2.8 GB at Q4                                          | **2.8** / 16.0 GB           | **2.8** / 16.0 GB                |
| [granite-3.2-2b-instruct](https://whatcanirunai.vercel.app/models/granite-3.2-2b-instruct/)\~2.8 GB at Q4                                          | **2.8** / 16.0 GB           | **2.8** / 16.0 GB                |
| [MiniCPM5-2B](https://whatcanirunai.vercel.app/models/minicpm5-2b/)\~2.8 GB at Q4                                                                  | **2.8** / 16.0 GB           | **2.8** / 16.0 GB                |
| [MiniCPM5-2B-SFT](https://whatcanirunai.vercel.app/models/minicpm5-2b-sft/)\~2.8 GB at Q4                                                          | **2.8** / 16.0 GB           | **2.8** / 16.0 GB                |
| [MiniCPM5-2B-Midtrain](https://whatcanirunai.vercel.app/models/minicpm5-2b-midtrain/)\~2.8 GB at Q4                                                | **2.8** / 16.0 GB           | **2.8** / 16.0 GB                |
| [sarvam-1-v0.5](https://whatcanirunai.vercel.app/models/sarvam-1-v0.5/)\~2.7 GB at Q4                                                              | **2.7** / 16.0 GB           | **2.7** / 16.0 GB                |
| [North-Micro-Vision-Instruct](https://whatcanirunai.vercel.app/models/north-micro-vision-instruct/)\~2.7 GB at Q4                                  | **2.7** / 16.0 GB           | **2.7** / 16.0 GB                |
| [UI-TARS-2B-SFT](https://whatcanirunai.vercel.app/models/ui-tars-2b-sft/)\~2.7 GB at Q4                                                            | **2.7** / 16.0 GB           | **2.7** / 16.0 GB                |
| [WeVisOne-VL-2B](https://whatcanirunai.vercel.app/models/wevisone-vl-2b/)\~2.7 GB at Q4                                                            | **2.7** / 16.0 GB           | **2.7** / 16.0 GB                |
| [UI-Venus-1.5-2B](https://whatcanirunai.vercel.app/models/ui-venus-1.5-2b/)\~2.7 GB at Q4                                                          | **2.7** / 16.0 GB           | **2.7** / 16.0 GB                |
| [bitnet-b1.58-2B-4T-bf16](https://whatcanirunai.vercel.app/models/bitnet-b1.58-2b-4t-bf16/)\~2.7 GB at Q4                                          | **2.7** / 16.0 GB           | **2.7** / 16.0 GB                |
| [EXAONE-3.5-2.4B-Instruct](https://whatcanirunai.vercel.app/models/exaone-3.5-2.4b-instruct/)\~2.7 GB at Q4                                        | **2.7** / 16.0 GB           | **2.7** / 16.0 GB                |
| [EXAONE-Deep-2.4B](https://whatcanirunai.vercel.app/models/exaone-deep-2.4b/)\~2.7 GB at Q4                                                        | **2.7** / 16.0 GB           | **2.7** / 16.0 GB                |
| [kanana-1.5-2.1b-instruct-2505](https://whatcanirunai.vercel.app/models/kanana-1.5-2.1b-instruct-2505/)\~2.6 GB at Q4                              | **2.6** / 16.0 GB           | **2.6** / 16.0 GB                |
| [Qwen3.5-2B](https://whatcanirunai.vercel.app/models/qwen3.5-2b/)\~2.6 GB at Q4                                                                    | **2.6** / 16.0 GB           | **2.6** / 16.0 GB                |
| [salamandra-2b](https://whatcanirunai.vercel.app/models/salamandra-2b/)\~2.6 GB at Q4                                                              | **2.6** / 16.0 GB           | **2.6** / 16.0 GB                |
| [salamandra-2b-instruct](https://whatcanirunai.vercel.app/models/salamandra-2b-instruct/)\~2.6 GB at Q4                                            | **2.6** / 16.0 GB           | **2.6** / 16.0 GB                |
| [SmolVLM2-2.2B-Instruct](https://whatcanirunai.vercel.app/models/smolvlm2-2.2b-instruct/)\~2.6 GB at Q4                                            | **2.6** / 16.0 GB           | **2.6** / 16.0 GB                |
| [SmolVLM-Base](https://whatcanirunai.vercel.app/models/smolvlm-base/)\~2.6 GB at Q4                                                                | **2.6** / 16.0 GB           | **2.6** / 16.0 GB                |
| [Qwen2-VL-2B-Instruct](https://whatcanirunai.vercel.app/models/qwen2-vl-2b-instruct/)\~2.5 GB at Q4                                                | **2.5** / 16.0 GB           | **2.5** / 16.0 GB                |
| [LFM3-Omni-2B](https://whatcanirunai.vercel.app/models/lfm3-omni-2b/)\~2.5 GB at Q4                                                                | **2.5** / 16.0 GB           | **2.5** / 16.0 GB                |
| [granite-swash-2b](https://whatcanirunai.vercel.app/models/granite-swash-2b/)\~2.5 GB at Q4                                                        | **2.5** / 16.0 GB           | **2.5** / 16.0 GB                |
| [Qwen3-VL-2B-Instruct](https://whatcanirunai.vercel.app/models/qwen3-vl-2b-instruct/)\~2.5 GB at Q4                                                | **2.5** / 16.0 GB           | **2.5** / 16.0 GB                |
| [kanana-nano-2.1b-instruct](https://whatcanirunai.vercel.app/models/kanana-nano-2.1b-instruct/)\~2.5 GB at Q4                                      | **2.5** / 16.0 GB           | **2.5** / 16.0 GB                |
| [Hy-MT2-1.8B](https://whatcanirunai.vercel.app/models/hy-mt2-1.8b/)\~2.4 GB at Q4                                                                  | **2.4** / 16.0 GB           | **2.4** / 16.0 GB                |
| [Qwen3-1.7B](https://whatcanirunai.vercel.app/models/qwen3-1.7b/)\~2.4 GB at Q4                                                                    | **2.4** / 16.0 GB           | **2.4** / 16.0 GB                |
| [Youtu-LLM-2B](https://whatcanirunai.vercel.app/models/youtu-llm-2b/)\~2.4 GB at Q4                                                                | **2.4** / 16.0 GB           | **2.4** / 16.0 GB                |
| [LFM3-VL-2B](https://whatcanirunai.vercel.app/models/lfm3-vl-2b/)\~2.3 GB at Q4                                                                    | **2.3** / 16.0 GB           | **2.3** / 16.0 GB                |
| [d1-2B](https://whatcanirunai.vercel.app/models/d1-2b/)\~2.3 GB at Q4                                                                              | **2.3** / 16.0 GB           | **2.3** / 16.0 GB                |
| [FastVLM-1.5B](https://whatcanirunai.vercel.app/models/fastvlm-1.5b/)\~2.3 GB at Q4                                                                | **2.3** / 16.0 GB           | **2.3** / 16.0 GB                |
| [internlm2\_5-1\_8b-chat](https://whatcanirunai.vercel.app/models/internlm2-5-1-8b-chat/)\~2.3 GB at Q4                                            | **2.3** / 16.0 GB           | **2.3** / 16.0 GB                |
| [DeepSeek-R1-Distill-Qwen-1.5B](https://whatcanirunai.vercel.app/models/deepseek-r1-distill-qwen-1.5b/)\~2.2 GB at Q4                              | **2.2** / 16.0 GB           | **2.2** / 16.0 GB                |
| [LFM3-1.7B](https://whatcanirunai.vercel.app/models/lfm3-1.7b/)\~2.2 GB at Q4                                                                      | **2.2** / 16.0 GB           | **2.2** / 16.0 GB                |
| [Qwen3-1.7B-Base](https://whatcanirunai.vercel.app/models/qwen3-1.7b-base/)\~2.2 GB at Q4                                                          | **2.2** / 16.0 GB           | **2.2** / 16.0 GB                |
| [SmolLM2-1.7B](https://whatcanirunai.vercel.app/models/smollm2-1.7b/)\~2.2 GB at Q4                                                                | **2.2** / 16.0 GB           | **2.2** / 16.0 GB                |
| [SmolLM-1.7B](https://whatcanirunai.vercel.app/models/smollm-1.7b/)\~2.2 GB at Q4                                                                  | **2.2** / 16.0 GB           | **2.2** / 16.0 GB                |
| [Spark-X2.6-1.7B](https://whatcanirunai.vercel.app/models/spark-x2.6-1.7b/)\~2.2 GB at Q4                                                          | **2.2** / 16.0 GB           | **2.2** / 16.0 GB                |
| [Falcon3-1B-Instruct](https://whatcanirunai.vercel.app/models/falcon3-1b-instruct/)\~2.2 GB at Q4                                                  | **2.2** / 16.0 GB           | **2.2** / 16.0 GB                |
| [EuroLLM-1.7B-Instruct](https://whatcanirunai.vercel.app/models/eurollm-1.7b-instruct/)\~2.2 GB at Q4                                              | **2.2** / 16.0 GB           | **2.2** / 16.0 GB                |
| [granite-4.0-1b](https://whatcanirunai.vercel.app/models/granite-4.0-1b/)\~2.1 GB at Q4                                                            | **2.1** / 16.0 GB           | **2.1** / 16.0 GB                |
| [LFM2.5-VL-1.6B](https://whatcanirunai.vercel.app/models/lfm2.5-vl-1.6b/)\~2.1 GB at Q4                                                            | **2.1** / 16.0 GB           | **2.1** / 16.0 GB                |
| [glm-edge-1.5b-chat](https://whatcanirunai.vercel.app/models/glm-edge-1.5b-chat/)\~2.1 GB at Q4                                                    | **2.1** / 16.0 GB           | **2.1** / 16.0 GB                |
| [LFM2-VL-1.6B](https://whatcanirunai.vercel.app/models/lfm2-vl-1.6b/)\~2.1 GB at Q4                                                                | **2.1** / 16.0 GB           | **2.1** / 16.0 GB                |
| [Falcon-H1-1.5B-Deep-Instruct](https://whatcanirunai.vercel.app/models/falcon-h1-1.5b-deep-instruct/)\~2.1 GB at Q4                                | **2.1** / 16.0 GB           | **2.1** / 16.0 GB                |
| [Falcon-H1-1.5B-Instruct](https://whatcanirunai.vercel.app/models/falcon-h1-1.5b-instruct/)\~2.1 GB at Q4                                          | **2.1** / 16.0 GB           | **2.1** / 16.0 GB                |
| [MiniCPM-V-4.7-1B](https://whatcanirunai.vercel.app/models/minicpm-v-4.7-1b/)\~2.1 GB at Q4                                                        | **2.1** / 16.0 GB           | **2.1** / 16.0 GB                |
| [Qwen2.5-1.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-1.5b-instruct/)\~2.1 GB at Q4                                              | **2.1** / 16.0 GB           | **2.1** / 16.0 GB                |
| [Qwen2.5-1.5B](https://whatcanirunai.vercel.app/models/qwen2.5-1.5b/)\~2.1 GB at Q4                                                                | **2.1** / 16.0 GB           | **2.1** / 16.0 GB                |
| [Qwen2.5-Coder-1.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-coder-1.5b-instruct/)\~2.1 GB at Q4                                  | **2.1** / 16.0 GB           | **2.1** / 16.0 GB                |
| [Qwen2.5-Coder-1.5B](https://whatcanirunai.vercel.app/models/qwen2.5-coder-1.5b/)\~2.1 GB at Q4                                                    | **2.1** / 16.0 GB           | **2.1** / 16.0 GB                |
| [Qwen2.5-Math-1.5B](https://whatcanirunai.vercel.app/models/qwen2.5-math-1.5b/)\~2.1 GB at Q4                                                      | **2.1** / 16.0 GB           | **2.1** / 16.0 GB                |
| [Qwen2-1.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2-1.5b-instruct/)\~2.1 GB at Q4                                                  | **2.1** / 16.0 GB           | **2.1** / 16.0 GB                |
| [Qwen2.5-Math-1.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-math-1.5b-instruct/)\~2.1 GB at Q4                                    | **2.1** / 16.0 GB           | **2.1** / 16.0 GB                |
| [ReaderLM-v2](https://whatcanirunai.vercel.app/models/readerlm-v2/)\~2.1 GB at Q4                                                                  | **2.1** / 16.0 GB           | **2.1** / 16.0 GB                |
| [reader-lm-1.5b](https://whatcanirunai.vercel.app/models/reader-lm-1.5b/)\~2.1 GB at Q4                                                            | **2.1** / 16.0 GB           | **2.1** / 16.0 GB                |
| [Hymba-1.5B-Instruct](https://whatcanirunai.vercel.app/models/hymba-1.5b-instruct/)\~2.1 GB at Q4                                                  | **2.1** / 16.0 GB           | **2.1** / 16.0 GB                |
| [OLMo-2-0425-1B](https://whatcanirunai.vercel.app/models/olmo-2-0425-1b/)\~2.0 GB at Q4                                                            | **2.0** / 16.0 GB           | **2.0** / 16.0 GB                |
| [OLMo-2-0425-1B-Instruct](https://whatcanirunai.vercel.app/models/olmo-2-0425-1b-instruct/)\~2.0 GB at Q4                                          | **2.0** / 16.0 GB           | **2.0** / 16.0 GB                |
| [Yi-Coder-1.5B-Chat](https://whatcanirunai.vercel.app/models/yi-coder-1.5b-chat/)\~2.0 GB at Q4                                                    | **2.0** / 16.0 GB           | **2.0** / 16.0 GB                |
| [Bolmo-1B](https://whatcanirunai.vercel.app/models/bolmo-1b/)\~2.0 GB at Q4                                                                        | **2.0** / 16.0 GB           | **2.0** / 16.0 GB                |
| [granite-4.0-h-1b](https://whatcanirunai.vercel.app/models/granite-4.0-h-1b/)\~2.0 GB at Q4                                                        | **2.0** / 16.0 GB           | **2.0** / 16.0 GB                |
| [granite-3.1-1b-a400m-instruct](https://whatcanirunai.vercel.app/models/granite-3.1-1b-a400m-instruct/)\~1.9 GB at Q4                              | **1.9** / 16.0 GB           | **1.9** / 16.0 GB                |
| [granite-3.0-1b-a400m-instruct](https://whatcanirunai.vercel.app/models/granite-3.0-1b-a400m-instruct/)\~1.9 GB at Q4                              | **1.9** / 16.0 GB           | **1.9** / 16.0 GB                |
| [MiniCPM-V-4.6](https://whatcanirunai.vercel.app/models/minicpm-v-4.6/)\~1.9 GB at Q4                                                              | **1.9** / 16.0 GB           | **1.9** / 16.0 GB                |
| [MiniCPM-V-4.6-Thinking](https://whatcanirunai.vercel.app/models/minicpm-v-4.6-thinking/)\~1.9 GB at Q4                                            | **1.9** / 16.0 GB           | **1.9** / 16.0 GB                |
| [kanana-2-1.3b-instruct](https://whatcanirunai.vercel.app/models/kanana-2-1.3b-instruct/)\~1.9 GB at Q4                                            | **1.9** / 16.0 GB           | **1.9** / 16.0 GB                |
| [OLMo-1B-0724-hf](https://whatcanirunai.vercel.app/models/olmo-1b-0724-hf/)\~1.9 GB at Q4                                                          | **1.9** / 16.0 GB           | **1.9** / 16.0 GB                |
| [EXAONE-4.0-1.2B](https://whatcanirunai.vercel.app/models/exaone-4.0-1.2b/)\~1.9 GB at Q4                                                          | **1.9** / 16.0 GB           | **1.9** / 16.0 GB                |
| [Llama-3.2-1B-Instruct](https://whatcanirunai.vercel.app/models/llama-3.2-1b-instruct/)\~1.9 GB at Q4                                              | **1.9** / 16.0 GB           | **1.9** / 16.0 GB                |
| [Llama-3.2-1B](https://whatcanirunai.vercel.app/models/llama-3.2-1b/)\~1.9 GB at Q4                                                                | **1.9** / 16.0 GB           | **1.9** / 16.0 GB                |
| [Llama-3.2-1B](https://whatcanirunai.vercel.app/models/llama-3.2-1b-nousresearch/)\~1.9 GB at Q4                                                   | **1.9** / 16.0 GB           | **1.9** / 16.0 GB                |
| [Zamba2-1.2B-instruct](https://whatcanirunai.vercel.app/models/zamba2-1.2b-instruct/)\~1.8 GB at Q4                                                | **1.8** / 16.0 GB           | **1.8** / 16.0 GB                |
| [HRM-Text-1B](https://whatcanirunai.vercel.app/models/hrm-text-1b/)\~1.8 GB at Q4                                                                  | **1.8** / 16.0 GB           | **1.8** / 16.0 GB                |
| [AMD-OLMo-1B](https://whatcanirunai.vercel.app/models/amd-olmo-1b/)\~1.8 GB at Q4                                                                  | **1.8** / 16.0 GB           | **1.8** / 16.0 GB                |
| [LFM2.5-1.2B-Instruct](https://whatcanirunai.vercel.app/models/lfm2.5-1.2b-instruct/)\~1.8 GB at Q4                                                | **1.8** / 16.0 GB           | **1.8** / 16.0 GB                |
| [LFM2-1.2B](https://whatcanirunai.vercel.app/models/lfm2-1.2b/)\~1.8 GB at Q4                                                                      | **1.8** / 16.0 GB           | **1.8** / 16.0 GB                |
| [LFM2.5-1.2B-Thinking](https://whatcanirunai.vercel.app/models/lfm2.5-1.2b-thinking/)\~1.8 GB at Q4                                                | **1.8** / 16.0 GB           | **1.8** / 16.0 GB                |
| [LFM2.5-1.2B-JP-202606](https://whatcanirunai.vercel.app/models/lfm2.5-1.2b-jp-202606/)\~1.8 GB at Q4                                              | **1.8** / 16.0 GB           | **1.8** / 16.0 GB                |
| [MiniCPM5-1B](https://whatcanirunai.vercel.app/models/minicpm5-1b/)\~1.8 GB at Q4                                                                  | **1.8** / 16.0 GB           | **1.8** / 16.0 GB                |
| [MiniCPM5-1B-SFT](https://whatcanirunai.vercel.app/models/minicpm5-1b-sft/)\~1.8 GB at Q4                                                          | **1.8** / 16.0 GB           | **1.8** / 16.0 GB                |
| [gemma-3-1b-it](https://whatcanirunai.vercel.app/models/gemma-3-1b-it/)\~1.7 GB at Q4                                                              | **1.7** / 16.0 GB           | **1.7** / 16.0 GB                |
| [gemma-3-1b-pt](https://whatcanirunai.vercel.app/models/gemma-3-1b-pt/)\~1.7 GB at Q4                                                              | **1.7** / 16.0 GB           | **1.7** / 16.0 GB                |
| [Qwen3.5-0.8B](https://whatcanirunai.vercel.app/models/qwen3.5-0.8b/)\~1.6 GB at Q4                                                                | **1.6** / 16.0 GB           | **1.6** / 16.0 GB                |
| [Falcon-E-3B-Instruct](https://whatcanirunai.vercel.app/models/falcon-e-3b-instruct/)\~1.6 GB at Q4                                                | **1.6** / 16.0 GB           | **1.6** / 16.0 GB                |
| [bitnet-b1.58-2B-4T](https://whatcanirunai.vercel.app/models/bitnet-b1.58-2b-4t/)\~1.6 GB at Q4                                                    | **1.6** / 16.0 GB           | **1.6** / 16.0 GB                |
| [FastVLM-0.5B](https://whatcanirunai.vercel.app/models/fastvlm-0.5b/)\~1.5 GB at Q4                                                                | **1.5** / 16.0 GB           | **1.5** / 16.0 GB                |
| [Qwen3-0.6B](https://whatcanirunai.vercel.app/models/qwen3-0.6b/)\~1.5 GB at Q4                                                                    | **1.5** / 16.0 GB           | **1.5** / 16.0 GB                |
| [LFM2-700M](https://whatcanirunai.vercel.app/models/lfm2-700m/)\~1.5 GB at Q4                                                                      | **1.5** / 16.0 GB           | **1.5** / 16.0 GB                |
| [Falcon-H1-Tiny-R-0.6B](https://whatcanirunai.vercel.app/models/falcon-h1-tiny-r-0.6b/)\~1.4 GB at Q4                                              | **1.4** / 16.0 GB           | **1.4** / 16.0 GB                |
| [Qwen3-0.6B-Base](https://whatcanirunai.vercel.app/models/qwen3-0.6b-base/)\~1.4 GB at Q4                                                          | **1.4** / 16.0 GB           | **1.4** / 16.0 GB                |
| [d1-omni-600M](https://whatcanirunai.vercel.app/models/d1-omni-600m/)\~1.4 GB at Q4                                                                | **1.4** / 16.0 GB           | **1.4** / 16.0 GB                |
| [HyperCLOVAX-SEED-Text-Instruct-0.5B](https://whatcanirunai.vercel.app/models/hyperclovax-seed-text-instruct-0.5b/)\~1.4 GB at Q4                  | **1.4** / 16.0 GB           | **1.4** / 16.0 GB                |
| [Falcon-H1-0.5B-Instruct](https://whatcanirunai.vercel.app/models/falcon-h1-0.5b-instruct/)\~1.4 GB at Q4                                          | **1.4** / 16.0 GB           | **1.4** / 16.0 GB                |
| [Qwen2.5-0.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-0.5b-instruct/)\~1.3 GB at Q4                                              | **1.3** / 16.0 GB           | **1.3** / 16.0 GB                |
| [Qwen2.5-0.5B](https://whatcanirunai.vercel.app/models/qwen2.5-0.5b/)\~1.3 GB at Q4                                                                | **1.3** / 16.0 GB           | **1.3** / 16.0 GB                |
| [Qwen2-0.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2-0.5b-instruct/)\~1.3 GB at Q4                                                  | **1.3** / 16.0 GB           | **1.3** / 16.0 GB                |
| [Qwen2.5-Coder-0.5B-Instruct](https://whatcanirunai.vercel.app/models/qwen2.5-coder-0.5b-instruct/)\~1.3 GB at Q4                                  | **1.3** / 16.0 GB           | **1.3** / 16.0 GB                |
| [LFM2-VL-450M](https://whatcanirunai.vercel.app/models/lfm2-vl-450m/)\~1.3 GB at Q4                                                                | **1.3** / 16.0 GB           | **1.3** / 16.0 GB                |
| [LFM2.5-VL-450M](https://whatcanirunai.vercel.app/models/lfm2.5-vl-450m/)\~1.3 GB at Q4                                                            | **1.3** / 16.0 GB           | **1.3** / 16.0 GB                |
| [Apertus-v1.1-0.5B](https://whatcanirunai.vercel.app/models/apertus-v1.1-0.5b/)\~1.3 GB at Q4                                                      | **1.3** / 16.0 GB           | **1.3** / 16.0 GB                |
| [MiniCPM4-0.5B](https://whatcanirunai.vercel.app/models/minicpm4-0.5b/)\~1.3 GB at Q4                                                              | **1.3** / 16.0 GB           | **1.3** / 16.0 GB                |
| [circuit-sparsity](https://whatcanirunai.vercel.app/models/circuit-sparsity/)\~1.3 GB at Q4                                                        | **1.3** / 16.0 GB           | **1.3** / 16.0 GB                |
| [SmolLM2-360M](https://whatcanirunai.vercel.app/models/smollm2-360m/)\~1.3 GB at Q4                                                                | **1.3** / 16.0 GB           | **1.3** / 16.0 GB                |
| [SmolLM-360M](https://whatcanirunai.vercel.app/models/smollm-360m/)\~1.3 GB at Q4                                                                  | **1.3** / 16.0 GB           | **1.3** / 16.0 GB                |
| [ERNIE-4.5-0.3B-PT](https://whatcanirunai.vercel.app/models/ernie-4.5-0.3b-pt/)\~1.3 GB at Q4                                                      | **1.3** / 16.0 GB           | **1.3** / 16.0 GB                |
| [LFM2.5-350M](https://whatcanirunai.vercel.app/models/lfm2.5-350m/)\~1.2 GB at Q4                                                                  | **1.2** / 16.0 GB           | **1.2** / 16.0 GB                |
| [LFM2-350M](https://whatcanirunai.vercel.app/models/lfm2-350m/)\~1.2 GB at Q4                                                                      | **1.2** / 16.0 GB           | **1.2** / 16.0 GB                |
| [granite-4.0-350m](https://whatcanirunai.vercel.app/models/granite-4.0-350m/)\~1.2 GB at Q4                                                        | **1.2** / 16.0 GB           | **1.2** / 16.0 GB                |
| [granite-4.0-h-350m](https://whatcanirunai.vercel.app/models/granite-4.0-h-350m/)\~1.2 GB at Q4                                                    | **1.2** / 16.0 GB           | **1.2** / 16.0 GB                |

## Quick answers

Which is better for local LLMs, Intel Arc A770 16GB or GeForce RTX 4060 Ti 16GB?

They have the same usable memory (16 GB), so they run the same models at Q4\. Pick on price and speed.

How many models does each run at Q4?

The Intel Arc A770 16GB runs 388 of the 656 open models we track, and the GeForce RTX 4060 Ti 16GB runs 388.

Which is faster for local LLMs, Intel Arc A770 16GB or GeForce RTX 4060 Ti 16GB?

The Intel Arc A770 16GB has more memory bandwidth (560 vs 288 GB/s), so it should generate tokens roughly 1.94× faster on models both can hold. That is an estimate from bandwidth, not a measured benchmark.

Which is cheaper, Intel Arc A770 16GB or GeForce RTX 4060 Ti 16GB?

On our dated list-price snapshots, the Intel Arc A770 16GB is $150 cheaper. Prices are snapshots, not live street prices.

## Related comparisons

* [GeForce RTX 3060 12GB vs GeForce RTX 4060 Ti 16GB](https://whatcanirunai.vercel.app/compare/rtx-3060-12gb-vs-rtx-4060-ti-16gb/)12 vs 16 GB
* [Radeon RX 7600 XT vs GeForce RTX 4060 Ti 16GB](https://whatcanirunai.vercel.app/compare/rx-7600-xt-vs-rtx-4060-ti-16gb/)16 vs 16 GB
* [GeForce RTX 5060 Ti 16GB vs GeForce RTX 4060 Ti 16GB](https://whatcanirunai.vercel.app/compare/rtx-5060-ti-16gb-vs-rtx-4060-ti-16gb/)16 vs 16 GB

[All comparisons](https://whatcanirunai.vercel.app/compare/)

---
Agent guide: https://whatcanirunai.vercel.app/llms.txt · JSON API: https://whatcanirunai.vercel.app/developers/
