# Best AMD GPU for local LLMs: RX 7900 XTX, 9070 XT, ROCm support (2026) > AMD GPUs for running LLMs locally: 20 Radeon, Instinct and Ryzen AI Max devices by VRAM, bandwidth, ROCm support and est. tok/s, vs the cheapest NVIDIA card with the same VRAM. Source: https://whatcanirunai.vercel.app/best-amd-gpu-for-local-llm/ # Best AMD GPU for local LLMs Radeon cards give a lot of VRAM per dollar. Here are the 20 AMD devices we track (19 Radeon and Instinct cards plus the Ryzen AI Max+ 395 mini PC), with AMD's official ROCm support status, estimated tokens per second and the cheapest NVIDIA card with the same VRAM. AMD devices tracked 20 On AMD's ROCm list 9 VRAM range (cards) 8–32 GB Short answer: the **RX 7900 XTX** (24 GB) is the best AMD card for local LLMs, the **RX 9070 XT** is the fastest current 16 GB option, and the **RX 9060 XT 16GB** is the cheapest way into 16 GB with ROCm support. For models bigger than 24 GB, the Ryzen AI Max+ 395 trades speed for memory. **About ROCm:** status comes from [AMD's ROCm Linux system requirements](https://rocm.docs.amd.com/projects/install-on-linux/en/latest/reference/system-requirements.html) (checked 2026-10-29). "Not listed" means AMD doesn't officially support it in ROCm; llama.cpp's Vulkan backend usually still runs those cards. Prices are list prices (MSRP) or launch MSRPs for discontinued cards, never street prices. ## Our picks Best overall: 24 GB ### [Radeon RX 7900 XTX](https://whatcanirunai.vercel.app/hardware/rx-7900-xtx/) VRAM 24 GB Bandwidth 960 GB/s Run at Q4 423 / 656 ROCm status: Supported. Qwen3.8-27B at Q4: est. 34–48 tok/s. Biggest at Q4: [ERNIE-4.5-VL-28B-A3B-PT](https://whatcanirunai.vercel.app/models/ernie-4.5-vl-28b-a3b-pt/). $999 (list price (MSRP), [source](https://en.wikipedia.org/wiki/Radeon%5FRX%5F7000%5Fseries)) Cheapest GeForce with 24+ GB: GeForce RTX 3090, $1,499 list. [Amazon](https://www.amazon.com/s?k=Radeon%20RX%207900%20XTX&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%207900%20XTX) Best current 16 GB card ### [Radeon RX 9070 XT](https://whatcanirunai.vercel.app/hardware/rx-9070-xt/) VRAM 16 GB Bandwidth 640 GB/s Run at Q4 388 / 656 ROCm status: Supported. Qwen3-14B at Q4: est. 43–61 tok/s. Biggest at Q4: [Ling-Coder-lite](https://whatcanirunai.vercel.app/models/ling-coder-lite/). $599 (list price (MSRP), [source](https://en.wikipedia.org/wiki/List%5Fof%5FAMD%5Fgraphics%5Fprocessing%5Funits)) Cheapest GeForce with 16+ GB: GeForce RTX 5060 Ti 16GB, $429 list. [Amazon](https://www.amazon.com/s?k=Radeon%20RX%209070%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%209070%20XT) Cheapest 16 GB with ROCm support ### [Radeon RX 9060 XT 16GB](https://whatcanirunai.vercel.app/hardware/rx-9060-xt-16gb/) VRAM 16 GB Bandwidth 320 GB/s Run at Q4 388 / 656 ROCm status: Supported. Qwen3-14B at Q4: est. 21–30 tok/s. Biggest at Q4: [Ling-Coder-lite](https://whatcanirunai.vercel.app/models/ling-coder-lite/). $349 (list price (MSRP), [source](https://en.wikipedia.org/wiki/List%5Fof%5FAMD%5Fgraphics%5Fprocessing%5Funits)) Cheapest GeForce with 16+ GB: GeForce RTX 5060 Ti 16GB, $429 list. [Amazon](https://www.amazon.com/s?k=Radeon%20RX%209060%20XT%2016GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%209060%20XT%2016GB) 20 GB for 20B-class models ### [Radeon RX 7900 XT](https://whatcanirunai.vercel.app/hardware/rx-7900-xt/) VRAM 20 GB Bandwidth 800 GB/s Run at Q4 404 / 656 ROCm status: Supported. gpt-oss-20b at Q4: est. up to 312 tok/s. Biggest at Q4: [Voxtral-Small-24B-2507](https://whatcanirunai.vercel.app/models/voxtral-small-24b-2507/). $899 (list price (MSRP), [source](https://en.wikipedia.org/wiki/Radeon%5FRX%5F7000%5Fseries)) Cheapest GeForce with 20+ GB: NVIDIA RTX 4000 Ada 20GB, $1,250 list. [Amazon](https://www.amazon.com/s?k=Radeon%20RX%207900%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%207900%20XT) Most memory: Ryzen AI Max+ 395 ### [Framework Desktop (Ryzen AI Max+ 395) 128GB](https://whatcanirunai.vercel.app/hardware/framework-desktop-128/) Usable memory 96 GB Bandwidth 256 GB/s Run at Q4 545 / 656 ROCm status: Not on the GPU table. Qwen3-32B at Q4: est. 6–10 tok/s. Biggest at Q4: [Mistral-Small-4-119B-2603](https://whatcanirunai.vercel.app/models/mistral-small-4-119b-2603/). $3,449 (Framework list price, DIY Edition 128GB (pre-order, ships within 5 business days), [source](https://frame.work/products/desktop-diy-amd-aimax300/comparison)) [Amazon](https://www.amazon.com/s?k=Framework%20Desktop%20%28Ryzen%20AI%20Max%2B%20395%29%20128GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Framework%20Desktop%20%28Ryzen%20AI%20Max%2B%20395%29%20128GB) 32 GB on the used market, with work ### [AMD Radeon Instinct MI50 32GB](https://whatcanirunai.vercel.app/hardware/instinct-mi50-32gb/) VRAM 32 GB Bandwidth 1024 GB/s Run at Q4 504 / 656 ROCm status: Not supported (gfx906). Qwen3-32B at Q4: est. 31–44 tok/s. Biggest at Q4: [IQuest-Coder-V1-40B-Loop-Instruct](https://whatcanirunai.vercel.app/models/iquest-coder-v1-40b-loop-instruct/). No list price: sold through OEMs. [Amazon](https://www.amazon.com/s?k=AMD%20Radeon%20Instinct%20MI50%2032GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=AMD%20Radeon%20Instinct%20MI50%2032GB) We may earn a commission when you buy through these links, at no extra cost to you. ## Every AMD GPU we track Sorted by memory, then bandwidth. Board power is AMD's reference spec ([how we calculate fit](https://whatcanirunai.vercel.app/method/)). __AMD GPUs and mini PCs ranked by memory with bandwidth, board power, ROCm status, price and the biggest model each runs at Q4__ | Device | Memory | Bandwidth | Board power | ROCm | Price | Biggest model at Q4 | Models that fit | | ----------------------------------------------------------------------------------------------------- | ------ | --------- | ----------- | ---------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | ---------------------------------------------------------------------------------------------- | --------------- | | [Framework Desktop (Ryzen AI Max+ 395) 128GB](https://whatcanirunai.vercel.app/hardware/framework-desktop-128/)Unified memory mini PC | 96 GB | 256 GB/s | — | Not on the GPU table | $3,449Framework list price, DIY Edition 128GB (pre-order, ships within 5 business days), [source](https://frame.work/products/desktop-diy-amd-aimax300/comparison), 2026-11-05 | [Mistral-Small-4-119B-2603](https://whatcanirunai.vercel.app/models/mistral-small-4-119b-2603/)\~84.2 GB at Q4 | 545 / 656 | | [AMD Radeon Instinct MI50 32GB](https://whatcanirunai.vercel.app/hardware/instinct-mi50-32gb/)Graphics card · discontinued | 32 GB | 1024 GB/s | 300 W | Not supported (gfx906) | No list price (sold through OEMs) | [IQuest-Coder-V1-40B-Loop-Instruct](https://whatcanirunai.vercel.app/models/iquest-coder-v1-40b-loop-instruct/)\~28.7 GB at Q4 | 504 / 656 | | [AMD Radeon Instinct MI60 32GB](https://whatcanirunai.vercel.app/hardware/instinct-mi60/)Graphics card · discontinued | 32 GB | 1024 GB/s | 300 W | Not supported (gfx906) | No list price (sold through OEMs) | [IQuest-Coder-V1-40B-Loop-Instruct](https://whatcanirunai.vercel.app/models/iquest-coder-v1-40b-loop-instruct/)\~28.7 GB at Q4 | 504 / 656 | | [Radeon RX 7900 XTX](https://whatcanirunai.vercel.app/hardware/rx-7900-xtx/)Graphics card | 24 GB | 960 GB/s | 355 W | Supported | $999list price (MSRP), [source](https://en.wikipedia.org/wiki/Radeon%5FRX%5F7000%5Fseries), 2026-10-22 | [ERNIE-4.5-VL-28B-A3B-PT](https://whatcanirunai.vercel.app/models/ernie-4.5-vl-28b-a3b-pt/)\~21.5 GB at Q4 | 423 / 656 | | [Radeon RX 7900 XT](https://whatcanirunai.vercel.app/hardware/rx-7900-xt/)Graphics card | 20 GB | 800 GB/s | 315 W | Supported | $899list price (MSRP), [source](https://en.wikipedia.org/wiki/Radeon%5FRX%5F7000%5Fseries), 2026-10-22 | [Voxtral-Small-24B-2507](https://whatcanirunai.vercel.app/models/voxtral-small-24b-2507/)\~17.9 GB at Q4 | 404 / 656 | | [Radeon RX 9070](https://whatcanirunai.vercel.app/hardware/rx-9070/)Graphics card | 16 GB | 640 GB/s | 220 W | Supported | $549list price (MSRP), [source](https://en.wikipedia.org/wiki/List%5Fof%5FAMD%5Fgraphics%5Fprocessing%5Funits), 2026-10-28 | [Ling-Coder-lite](https://whatcanirunai.vercel.app/models/ling-coder-lite/)\~12.7 GB at Q4 | 388 / 656 | | [Radeon RX 9070 XT](https://whatcanirunai.vercel.app/hardware/rx-9070-xt/)Graphics card | 16 GB | 640 GB/s | 304 W | Supported | $599list price (MSRP), [source](https://en.wikipedia.org/wiki/List%5Fof%5FAMD%5Fgraphics%5Fprocessing%5Funits), 2026-10-28 | [Ling-Coder-lite](https://whatcanirunai.vercel.app/models/ling-coder-lite/)\~12.7 GB at Q4 | 388 / 656 | | [Radeon RX 7800 XT](https://whatcanirunai.vercel.app/hardware/rx-7800-xt/)Graphics card | 16 GB | 624 GB/s | 263 W | Supported | $499list price (MSRP), [source](https://en.wikipedia.org/wiki/Radeon%5FRX%5F7000%5Fseries), 2026-10-22 | [Ling-Coder-lite](https://whatcanirunai.vercel.app/models/ling-coder-lite/)\~12.7 GB at Q4 | 388 / 656 | | [Radeon RX 6950 XT](https://whatcanirunai.vercel.app/hardware/rx-6950-xt/)Graphics card · discontinued | 16 GB | 576 GB/s | 335 W | Not listed | $1,099launch MSRP, discontinued, [source](https://en.wikipedia.org/wiki/List%5Fof%5FAMD%5Fgraphics%5Fprocessing%5Funits), 2026-10-28 | [Ling-Coder-lite](https://whatcanirunai.vercel.app/models/ling-coder-lite/)\~12.7 GB at Q4 | 388 / 656 | | [Radeon RX 7900 GRE](https://whatcanirunai.vercel.app/hardware/rx-7900-gre/)Graphics card | 16 GB | 576 GB/s | 260 W | Supported | $549list price (MSRP), [source](https://en.wikipedia.org/wiki/List%5Fof%5FAMD%5Fgraphics%5Fprocessing%5Funits), 2026-10-28 | [Ling-Coder-lite](https://whatcanirunai.vercel.app/models/ling-coder-lite/)\~12.7 GB at Q4 | 388 / 656 | | [Radeon RX 6800](https://whatcanirunai.vercel.app/hardware/rx-6800/)Graphics card · discontinued | 16 GB | 512 GB/s | 250 W | Not listed | $579launch MSRP, discontinued, [source](https://en.wikipedia.org/wiki/List%5Fof%5FAMD%5Fgraphics%5Fprocessing%5Funits), 2026-10-28 | [Ling-Coder-lite](https://whatcanirunai.vercel.app/models/ling-coder-lite/)\~12.7 GB at Q4 | 388 / 656 | | [Radeon RX 6800 XT](https://whatcanirunai.vercel.app/hardware/rx-6800-xt/)Graphics card · discontinued | 16 GB | 512 GB/s | 300 W | Not listed | $649launch MSRP, discontinued, [source](https://en.wikipedia.org/wiki/List%5Fof%5FAMD%5Fgraphics%5Fprocessing%5Funits), 2026-10-28 | [Ling-Coder-lite](https://whatcanirunai.vercel.app/models/ling-coder-lite/)\~12.7 GB at Q4 | 388 / 656 | | [Radeon RX 6900 XT](https://whatcanirunai.vercel.app/hardware/rx-6900-xt/)Graphics card · discontinued | 16 GB | 512 GB/s | 300 W | Not listed | $999launch MSRP, discontinued, [source](https://en.wikipedia.org/wiki/List%5Fof%5FAMD%5Fgraphics%5Fprocessing%5Funits), 2026-10-28 | [Ling-Coder-lite](https://whatcanirunai.vercel.app/models/ling-coder-lite/)\~12.7 GB at Q4 | 388 / 656 | | [Radeon RX 9060 XT 16GB](https://whatcanirunai.vercel.app/hardware/rx-9060-xt-16gb/)Graphics card | 16 GB | 320 GB/s | 160 W | Supported | $349list price (MSRP), [source](https://en.wikipedia.org/wiki/List%5Fof%5FAMD%5Fgraphics%5Fprocessing%5Funits), 2026-10-28 | [Ling-Coder-lite](https://whatcanirunai.vercel.app/models/ling-coder-lite/)\~12.7 GB at Q4 | 388 / 656 | | [Radeon RX 7600 XT](https://whatcanirunai.vercel.app/hardware/rx-7600-xt/)Graphics card | 16 GB | 288 GB/s | 190 W | Not listed | $329list price (MSRP), [source](https://en.wikipedia.org/wiki/Radeon%5FRX%5F7000%5Fseries), 2026-10-22 | [Ling-Coder-lite](https://whatcanirunai.vercel.app/models/ling-coder-lite/)\~12.7 GB at Q4 | 388 / 656 | | [Radeon RX 6750 XT](https://whatcanirunai.vercel.app/hardware/rx-6750-xt/)Graphics card · discontinued | 12 GB | 432 GB/s | 250 W | Not listed | $549launch MSRP, discontinued, [source](https://en.wikipedia.org/wiki/List%5Fof%5FAMD%5Fgraphics%5Fprocessing%5Funits), 2026-10-28 | [OLMo-2-1124-13B-Instruct](https://whatcanirunai.vercel.app/models/olmo-2-1124-13b-instruct/)\~10.6 GB at Q4 | 350 / 656 | | [Radeon RX 7700 XT](https://whatcanirunai.vercel.app/hardware/rx-7700-xt/)Graphics card | 12 GB | 432 GB/s | 245 W | Supported | $449list price (MSRP), [source](https://en.wikipedia.org/wiki/List%5Fof%5FAMD%5Fgraphics%5Fprocessing%5Funits), 2026-10-28 | [OLMo-2-1124-13B-Instruct](https://whatcanirunai.vercel.app/models/olmo-2-1124-13b-instruct/)\~10.6 GB at Q4 | 350 / 656 | | [Radeon RX 6700 XT](https://whatcanirunai.vercel.app/hardware/rx-6700-xt/)Graphics card · discontinued | 12 GB | 384 GB/s | 230 W | Not listed | $479launch MSRP, discontinued, [source](https://en.wikipedia.org/wiki/List%5Fof%5FAMD%5Fgraphics%5Fprocessing%5Funits), 2026-10-28 | [OLMo-2-1124-13B-Instruct](https://whatcanirunai.vercel.app/models/olmo-2-1124-13b-instruct/)\~10.6 GB at Q4 | 350 / 656 | | [Radeon RX 9060 XT 8GB](https://whatcanirunai.vercel.app/hardware/rx-9060-xt-8gb/)Graphics card | 8 GB | 320 GB/s | 150 W | Supported | $299list price (MSRP), [source](https://en.wikipedia.org/wiki/List%5Fof%5FAMD%5Fgraphics%5Fprocessing%5Funits), 2026-10-28 | [NVIDIA-Nemotron-Nano-9B-v2](https://whatcanirunai.vercel.app/models/nvidia-nemotron-nano-9b-v2/)\~7.2 GB at Q4 | 315 / 656 | | [Radeon RX 7600](https://whatcanirunai.vercel.app/hardware/rx-7600/)Graphics card | 8 GB | 288 GB/s | 165 W | Not listed | $269list price (MSRP), [source](https://en.wikipedia.org/wiki/List%5Fof%5FAMD%5Fgraphics%5Fprocessing%5Funits), 2026-10-28 | [NVIDIA-Nemotron-Nano-9B-v2](https://whatcanirunai.vercel.app/models/nvidia-nemotron-nano-9b-v2/)\~7.2 GB at Q4 | 315 / 656 | ## Which popular models run, and how fast Devices with 12 GB or more. Estimated decode speed at Q4 in tokens per second ([how we estimate speed](https://whatcanirunai.vercel.app/method/#speed)); MoE models show an upper bound only. Real AMD speeds depend on the backend (ROCm or Vulkan) and driver version. __Estimated fit and decode speed at Q4 for popular models on each AMD device__ | AMD device | [Qwen3-8B](https://whatcanirunai.vercel.app/models/qwen3-8b/)\~6.7 GB | [Qwen3-14B](https://whatcanirunai.vercel.app/models/qwen3-14b/)\~11.3 GB | [gpt-oss-20b](https://whatcanirunai.vercel.app/models/gpt-oss-20b/)\~15.6 GB | [Qwen3.8-27B](https://whatcanirunai.vercel.app/models/qwen3.8-27b/)\~20.4 GB | [Qwen3-30B-A3B](https://whatcanirunai.vercel.app/models/qwen3-30b-a3b/)\~22.3 GB | [Qwen3-32B](https://whatcanirunai.vercel.app/models/qwen3-32b/)\~23.8 GB | | ----------------------------------------------------------------------------------------------- | ------------------------------------- | ---------------------------------------- | -------------------------------------------- | -------------------------------------------- | ------------------------------------------------ | ---------------------------------------- | | [Framework Desktop (Ryzen AI Max+ 395) 128GB](https://whatcanirunai.vercel.app/hardware/framework-desktop-128/)96 GB · 256 GB/s | Fits23–41 tok/s | Fits13–23 tok/s | Fitsup to 94 tok/s | Fits7–12 tok/s | Fitsup to 113 tok/s | Fits6–10 tok/s | | [AMD Radeon Instinct MI50 32GB](https://whatcanirunai.vercel.app/hardware/instinct-mi50-32gb/)32 GB · 1024 GB/s | Fits124–175 tok/s | Fits69–97 tok/s | Fitsup to 399 tok/s | Fits36–52 tok/s | Fitsup to 479 tok/s | Fits31–44 tok/s | | [AMD Radeon Instinct MI60 32GB](https://whatcanirunai.vercel.app/hardware/instinct-mi60/)32 GB · 1024 GB/s | Fits124–175 tok/s | Fits69–97 tok/s | Fitsup to 399 tok/s | Fits36–52 tok/s | Fitsup to 479 tok/s | Fits31–44 tok/s | | [Radeon RX 7900 XTX](https://whatcanirunai.vercel.app/hardware/rx-7900-xtx/)24 GB · 960 GB/s | Fits116–164 tok/s | Fits64–91 tok/s | Fitsup to 374 tok/s | Fits34–48 tok/s | Tightup to 449 tok/s | Tight29–41 tok/s | | [Radeon RX 7900 XT](https://whatcanirunai.vercel.app/hardware/rx-7900-xt/)20 GB · 800 GB/s | Fits97–137 tok/s | Fits54–76 tok/s | Fitsup to 312 tok/s | Won’t fit | Won’t fit | Won’t fit | | [Radeon RX 9070](https://whatcanirunai.vercel.app/hardware/rx-9070/)16 GB · 640 GB/s | Fits77–110 tok/s | Fits43–61 tok/s | Tightup to 249 tok/s | Won’t fit | Won’t fit | Won’t fit | | [Radeon RX 9070 XT](https://whatcanirunai.vercel.app/hardware/rx-9070-xt/)16 GB · 640 GB/s | Fits77–110 tok/s | Fits43–61 tok/s | Tightup to 249 tok/s | Won’t fit | Won’t fit | Won’t fit | | [Radeon RX 7800 XT](https://whatcanirunai.vercel.app/hardware/rx-7800-xt/)16 GB · 624 GB/s | Fits75–107 tok/s | Fits42–59 tok/s | Tightup to 243 tok/s | Won’t fit | Won’t fit | Won’t fit | | [Radeon RX 6950 XT](https://whatcanirunai.vercel.app/hardware/rx-6950-xt/)16 GB · 576 GB/s | Fits70–99 tok/s | Fits39–55 tok/s | Tightup to 224 tok/s | Won’t fit | Won’t fit | Won’t fit | | [Radeon RX 7900 GRE](https://whatcanirunai.vercel.app/hardware/rx-7900-gre/)16 GB · 576 GB/s | Fits70–99 tok/s | Fits39–55 tok/s | Tightup to 224 tok/s | Won’t fit | Won’t fit | Won’t fit | | [Radeon RX 6800](https://whatcanirunai.vercel.app/hardware/rx-6800/)16 GB · 512 GB/s | Fits62–88 tok/s | Fits34–49 tok/s | Tightup to 199 tok/s | Won’t fit | Won’t fit | Won’t fit | | [Radeon RX 6800 XT](https://whatcanirunai.vercel.app/hardware/rx-6800-xt/)16 GB · 512 GB/s | Fits62–88 tok/s | Fits34–49 tok/s | Tightup to 199 tok/s | Won’t fit | Won’t fit | Won’t fit | | [Radeon RX 6900 XT](https://whatcanirunai.vercel.app/hardware/rx-6900-xt/)16 GB · 512 GB/s | Fits62–88 tok/s | Fits34–49 tok/s | Tightup to 199 tok/s | Won’t fit | Won’t fit | Won’t fit | | [Radeon RX 9060 XT 16GB](https://whatcanirunai.vercel.app/hardware/rx-9060-xt-16gb/)16 GB · 320 GB/s | Fits39–55 tok/s | Fits21–30 tok/s | Tightup to 125 tok/s | Won’t fit | Won’t fit | Won’t fit | | [Radeon RX 7600 XT](https://whatcanirunai.vercel.app/hardware/rx-7600-xt/)16 GB · 288 GB/s | Fits35–49 tok/s | Fits19–27 tok/s | Tightup to 112 tok/s | Won’t fit | Won’t fit | Won’t fit | | [Radeon RX 6750 XT](https://whatcanirunai.vercel.app/hardware/rx-6750-xt/)12 GB · 432 GB/s | Fits52–74 tok/s | Tight29–41 tok/s | Won’t fit | Won’t fit | Won’t fit | Won’t fit | | [Radeon RX 7700 XT](https://whatcanirunai.vercel.app/hardware/rx-7700-xt/)12 GB · 432 GB/s | Fits52–74 tok/s | Tight29–41 tok/s | Won’t fit | Won’t fit | Won’t fit | Won’t fit | | [Radeon RX 6700 XT](https://whatcanirunai.vercel.app/hardware/rx-6700-xt/)12 GB · 384 GB/s | Fits46–66 tok/s | Tight26–36 tok/s | Won’t fit | Won’t fit | Won’t fit | Won’t fit | ## AMD vs NVIDIA at the same VRAM For each memory size: the cheapest current Radeon on AMD's ROCm list versus the cheapest current GeForce we track, both at list price (MSRP). __Cheapest current AMD and NVIDIA GPU at each VRAM size, at list price__ | VRAM | Cheapest AMD (ROCm supported) | Cheapest NVIDIA | Difference | | ------ | -------------------------------------------------------------------------------- | ----------------------------------------------------------------------------------- | ------------------ | | 8+ GB | [Radeon RX 9060 XT 8GB](https://whatcanirunai.vercel.app/hardware/rx-9060-xt-8gb/)8 GB · 320 GB/s · $299 list | [GeForce RTX 3050 8GB](https://whatcanirunai.vercel.app/hardware/rtx-3050-8gb/)8 GB · 224 GB/s · $249 list | NVIDIA $50 cheaper | | 12+ GB | [Radeon RX 9060 XT 16GB](https://whatcanirunai.vercel.app/hardware/rx-9060-xt-16gb/)16 GB · 320 GB/s · $349 list | [GeForce RTX 3060 12GB](https://whatcanirunai.vercel.app/hardware/rtx-3060-12gb/)12 GB · 360 GB/s · $329 list | NVIDIA $20 cheaper | | 16+ GB | [Radeon RX 9060 XT 16GB](https://whatcanirunai.vercel.app/hardware/rx-9060-xt-16gb/)16 GB · 320 GB/s · $349 list | [GeForce RTX 5060 Ti 16GB](https://whatcanirunai.vercel.app/hardware/rtx-5060-ti-16gb/)16 GB · 448 GB/s · $429 list | AMD $80 cheaper | | 20+ GB | [Radeon RX 7900 XT](https://whatcanirunai.vercel.app/hardware/rx-7900-xt/)20 GB · 800 GB/s · $899 list | [NVIDIA RTX 4000 Ada 20GB](https://whatcanirunai.vercel.app/hardware/rtx-4000-ada/)20 GB · 360 GB/s · $1,250 list | AMD $351 cheaper | | 24+ GB | [Radeon RX 7900 XTX](https://whatcanirunai.vercel.app/hardware/rx-7900-xtx/)24 GB · 960 GB/s · $999 list | [GeForce RTX 3090](https://whatcanirunai.vercel.app/hardware/rtx-3090/)24 GB · 936 GB/s · $1,499 list | AMD $500 cheaper | ## Before you buy AMD * **Check the ROCm table** if you want vLLM, PyTorch or other ROCm tools. For LM Studio, Ollama and llama.cpp, Vulkan covers most Radeon cards. * **Linux gets support first.** ROCm on Windows is more limited; check AMD's docs for your card. * **Used cards:** RX 6800 / 6900 XT (16 GB) and Instinct MI50 (32 GB) are common used picks; see the [best used GPU](https://whatcanirunai.vercel.app/best-used-gpu-for-local-llm/) guide for their catches. * **Power and fit:** check board power and case size in the [planner](https://whatcanirunai.vercel.app/planner/). Head-to-head: [RTX 3090 vs RX 7900 XTX](https://whatcanirunai.vercel.app/compare/rtx-3090-vs-rx-7900-xtx/) · [RTX 5070 Ti vs RX 9070 XT](https://whatcanirunai.vercel.app/compare/rtx-5070-ti-vs-rx-9070-xt/). Have a card we don't list? Try the [VRAM calculator](https://whatcanirunai.vercel.app/vram-calculator/). ## Quick answers What is the best AMD GPU for local LLMs? The Radeon RX 7900 XTX: 24 GB of VRAM and 960 GB/s for $999 list, enough for 27B–32B-class models at Q4 (Qwen3.8-27B at an estimated 34–48 tok/s), and it is on AMD's official ROCm support list. The cheapest current GeForce with 24 GB or more is the GeForce RTX 3090 at $1,499 list. Do AMD GPUs work for running LLMs? Yes. llama.cpp (and tools built on it like LM Studio and Ollama) runs on AMD through ROCm/HIP or its Vulkan backend, and vLLM supports ROCm. The thing to check is ROCm support: AMD's current Linux table officially supports the RX 9000 series and the RX 7700 XT and up. Cards not on the list, like the RX 7600 and the RX 6000 series, often still work with Vulkan. Many CUDA-only tools and some newer kernels reach NVIDIA first. Which AMD GPUs support ROCm? From AMD's Linux system-requirements table (checked October 29, 2026): RX 9070 XT, RX 9070 GRE, RX 9070, RX 9060 XT, RX 9060 XT LP, RX 9060, RX 7900 XTX, RX 7900 XT, RX 7900 GRE, RX 7800 XT, RX 7700 XT and RX 7700, plus Radeon PRO cards. The Instinct MI50 and Radeon VII (gfx906) are marked unsupported. Anything not in the table is not officially supported. Is the RX 9070 XT good for local LLMs? It has 16 GB and 640 GB/s for $599 list, which runs 14B-class models comfortably (Qwen3-14B at an estimated 43–61 tok/s at Q4). If you only care about fitting models, the Radeon RX 9060 XT 16GB has the same 16 GB for $349 but only 320 GB/s, so it decodes about half as fast. AMD or NVIDIA for local AI? At 16 GB, the cheapest ROCm-supported Radeon we track is the Radeon RX 9060 XT 16GB at $349 list versus the GeForce RTX 5060 Ti 16GB at $429\. AMD usually gives more VRAM per dollar; NVIDIA gives the widest software support (CUDA, FlashAttention, most fine-tuning tools). For chat and coding with llama.cpp-based apps, AMD works well. For training or bleeding-edge inference tools, NVIDIA is the safer pick. See [NVIDIA vs AMD vs Mac](https://whatcanirunai.vercel.app/nvidia-vs-amd-vs-mac/). What about the Ryzen AI Max+ 395 (Framework Desktop)? It shares up to 128 GB of system memory with its built-in GPU; we count 96 GB as usable, so it fits far bigger models than any Radeon card (biggest we track at Q4: Mistral-Small-4-119B-2603). The trade-off is 256 GB/s of bandwidth, so big dense models are slow; MoE models are the sweet spot. See the [best mini PC](https://whatcanirunai.vercel.app/best-mini-pc-for-local-llm/) guide. [Buying guides](https://whatcanirunai.vercel.app/best-gpu-for/) · [Best GPU (all brands)](https://whatcanirunai.vercel.app/best-gpu-for-local-llm/) · [Best used GPU](https://whatcanirunai.vercel.app/best-used-gpu-for-local-llm/) · [Best Intel GPU](https://whatcanirunai.vercel.app/best-intel-gpu-for-local-llm/) · [NVIDIA vs AMD vs Mac](https://whatcanirunai.vercel.app/nvidia-vs-amd-vs-mac/) · [Best GPU by budget](https://whatcanirunai.vercel.app/best-gpu-under/) · [Tokens per second](https://whatcanirunai.vercel.app/tokens-per-second/) --- Agent guide: https://whatcanirunai.vercel.app/llms.txt · JSON API: https://whatcanirunai.vercel.app/developers/