# Best GPU for running local LLMs: guides | What Can I Run AI?

> Which GPU or Mac to buy for Llama, Qwen3, gpt-oss, DeepSeek R1, Gemma 3 and Gemma 4, Mistral, GLM, Phi, Nemotron, long-memory and coding models.

Source: https://whatcanirunai.vercel.app/best-gpu-for/

# Best GPU for running local LLMs

Pick a model family. Each guide shows the cheapest GPU and the cheapest Mac or mini-PC that run every model in it.

## Guides

* [Best GPU for running Llama locally](https://whatcanirunai.vercel.app/best-gpu-for/llama/)3 models
* [Best GPU for running Qwen3 locally](https://whatcanirunai.vercel.app/best-gpu-for/qwen3/)4 models
* [Best GPU for running gpt-oss locally](https://whatcanirunai.vercel.app/best-gpu-for/gpt-oss/)2 models
* [Best GPU for running DeepSeek R1 locally](https://whatcanirunai.vercel.app/best-gpu-for/deepseek-r1/)4 models
* [Best GPU for running Gemma 3 locally](https://whatcanirunai.vercel.app/best-gpu-for/gemma-3/)3 models
* [Best GPU for running Gemma 4 locally](https://whatcanirunai.vercel.app/best-gpu-for/gemma-4/)5 models
* [Best GPU for running Qwen3.8 locally](https://whatcanirunai.vercel.app/best-gpu-for/qwen3.8/)3 models
* [Best GPU for running Ornith 1.5 locally](https://whatcanirunai.vercel.app/best-gpu-for/ornith-1.5/)3 models
* [Best GPU for running Nemotron locally](https://whatcanirunai.vercel.app/best-gpu-for/nemotron/)3 models
* [Best GPU for running Liquid AI LFM locally](https://whatcanirunai.vercel.app/best-gpu-for/liquid-lfm/)2 models
* [Best GPU for running Mistral locally](https://whatcanirunai.vercel.app/best-gpu-for/mistral/)4 models
* [Best GPU for running GLM locally](https://whatcanirunai.vercel.app/best-gpu-for/glm/)4 models
* [Best GPU for running Phi locally](https://whatcanirunai.vercel.app/best-gpu-for/phi/)4 models
* [Best GPU for running long-memory models locally](https://whatcanirunai.vercel.app/best-gpu-for/memory-models/)3 models
* [Best GPU for running local coding models locally](https://whatcanirunai.vercel.app/best-gpu-for/coding-models/)8 models

## By memory size

* [Best LLMs for 4 GB VRAM](https://whatcanirunai.vercel.app/best-llm-for/4gb-vram/)4 GB
* [Best LLMs for 6 GB VRAM](https://whatcanirunai.vercel.app/best-llm-for/6gb-vram/)6 GB
* [Best LLMs for 8 GB VRAM](https://whatcanirunai.vercel.app/best-llm-for/8gb-vram/)8 GB
* [Best LLMs for 10 GB VRAM](https://whatcanirunai.vercel.app/best-llm-for/10gb-vram/)10 GB
* [Best LLMs for 12 GB VRAM](https://whatcanirunai.vercel.app/best-llm-for/12gb-vram/)12 GB
* [Best LLMs for 16 GB VRAM](https://whatcanirunai.vercel.app/best-llm-for/16gb-vram/)16 GB
* [Best LLMs for 20 GB VRAM](https://whatcanirunai.vercel.app/best-llm-for/20gb-vram/)20 GB
* [Best LLMs for 24 GB VRAM](https://whatcanirunai.vercel.app/best-llm-for/24gb-vram/)24 GB
* [Best LLMs for 32 GB VRAM](https://whatcanirunai.vercel.app/best-llm-for/32gb-vram/)32 GB
* [Best LLMs for 48 GB VRAM](https://whatcanirunai.vercel.app/best-llm-for/48gb-vram/)48 GB
* [Best LLMs for 64 GB VRAM](https://whatcanirunai.vercel.app/best-llm-for/64gb-vram/)64 GB
* [Best LLMs for 96 GB VRAM](https://whatcanirunai.vercel.app/best-llm-for/96gb-vram/)96 GB
* [Best LLMs for 128 GB VRAM](https://whatcanirunai.vercel.app/best-llm-for/128gb-vram/)128 GB

## By budget

* [Best GPU for local AI under $300](https://whatcanirunai.vercel.app/best-gpu-under/300/)8 devices
* [Best GPU for local AI under $500](https://whatcanirunai.vercel.app/best-gpu-under/500/)25 devices
* [Best GPU for local AI under $800](https://whatcanirunai.vercel.app/best-gpu-under/800/)44 devices
* [Best GPU for local AI under $1,000](https://whatcanirunai.vercel.app/best-gpu-under/1000/)53 devices
* [Best GPU for local AI under $1,500](https://whatcanirunai.vercel.app/best-gpu-under/1500/)59 devices
* [Best GPU for local AI under $2,000](https://whatcanirunai.vercel.app/best-gpu-under/2000/)63 devices
* [Best GPU for local AI under $3,500](https://whatcanirunai.vercel.app/best-gpu-under/3500/)68 devices

## By model size

[How much VRAM do you need?](https://whatcanirunai.vercel.app/how-much-vram/) · [Ollama VRAM requirements by tag](https://whatcanirunai.vercel.app/ollama-vram-requirements/) · [GGUF VRAM requirements by quant](https://whatcanirunai.vercel.app/gguf-vram-requirements/) · [1B–2B](https://whatcanirunai.vercel.app/how-much-vram/1b/) · [2B–3B](https://whatcanirunai.vercel.app/how-much-vram/3b/) · [4B–6B](https://whatcanirunai.vercel.app/how-much-vram/4b/) · [7B–8B](https://whatcanirunai.vercel.app/how-much-vram/8b/) · [12B–14B](https://whatcanirunai.vercel.app/how-much-vram/14b/) · [16B–21B](https://whatcanirunai.vercel.app/how-much-vram/20b/) · [24B–27B](https://whatcanirunai.vercel.app/how-much-vram/27b/) · [30B–32B](https://whatcanirunai.vercel.app/how-much-vram/32b/) · [40B–50B](https://whatcanirunai.vercel.app/how-much-vram/49b/) · [70B](https://whatcanirunai.vercel.app/how-much-vram/70b/) · [120B](https://whatcanirunai.vercel.app/how-much-vram/120b/) · [200B–300B](https://whatcanirunai.vercel.app/how-much-vram/235b/) · [300B–480B](https://whatcanirunai.vercel.app/how-much-vram/400b/) · [500B–800B](https://whatcanirunai.vercel.app/how-much-vram/671b/) · [1T+](https://whatcanirunai.vercel.app/how-much-vram/1t/)

## Overall picks

[Best GPU for running local LLMs](https://whatcanirunai.vercel.app/best-gpu-for-local-llm/) · [Best Mac for running local LLMs](https://whatcanirunai.vercel.app/best-mac-for-local-llm/) · [Best mini PC for local LLMs](https://whatcanirunai.vercel.app/best-mini-pc-for-local-llm/) · [Best used GPU for local LLMs](https://whatcanirunai.vercel.app/best-used-gpu-for-local-llm/) · [Best AMD GPU for local LLMs](https://whatcanirunai.vercel.app/best-amd-gpu-for-local-llm/) · [Best Intel GPU for local LLMs](https://whatcanirunai.vercel.app/best-intel-gpu-for-local-llm/) · [NVIDIA vs AMD vs Mac](https://whatcanirunai.vercel.app/nvidia-vs-amd-vs-mac/) · [Tokens per second by GPU and Mac](https://whatcanirunai.vercel.app/tokens-per-second/) · [Multi-GPU for local LLMs](https://whatcanirunai.vercel.app/multi-gpu-for-local-llm/) · [Q4 vs Q8 vs FP16](https://whatcanirunai.vercel.app/quantization/) · [Context length and VRAM](https://whatcanirunai.vercel.app/context-length/) · [MoE vs dense models](https://whatcanirunai.vercel.app/moe-vs-dense/) · [GPU power consumption](https://whatcanirunai.vercel.app/gpu-power-consumption/)

## Head-to-head

[GPU vs GPU comparisons for local LLMs](https://whatcanirunai.vercel.app/compare/) · [Model vs model (VRAM and speed)](https://whatcanirunai.vercel.app/compare/#model-vs-model)

---
Agent guide: https://whatcanirunai.vercel.app/llms.txt · JSON API: https://whatcanirunai.vercel.app/developers/