What Can I Run AI?

Best GPU for running gpt-oss locally

Which GPU or Mac you need for OpenAI’s open-weight gpt-oss models, from the cheapest card that runs the small one to what it takes for gpt-oss-120b. All checks are at Q4_K_M, about 4k context.

Cheapest way in: Radeon RX 7900 XT runs gpt-oss-20b for $899. For gpt-oss-120b, the cheapest fit we track is Framework Desktop (Ryzen AI Max+ 395) 128GB at $3449.

Cheapest hardware per model

ModelCheapest GPU that fitsCheapest Mac or mini-PC that fits
gpt-oss-20b~15.6 GB at Q4Radeon RX 7900 XT$899 listMac mini M6 24GB$1299 Apple list price, M6 12C CPU/12C GPU, 24GB/512GB
gpt-oss-120b~82.5 GB at Q4NVIDIA RTX Pro 6000 Blackwell 96GB$8565 listFramework Desktop (Ryzen AI Max+ 395) 128GB$3449 Framework list price, DIY Edition 128GB

"Fits" means the model needs 90% or less of usable memory at Q4 (how we calculate). Prices are dated snapshots, mostly launch MSRP, so street prices can differ a lot; see each device page for its source.

Every priced machine, cheapest first

Q4 verdict for each gpt-oss model.FitsTightWon’t fit
HardwarePricegpt-oss-20bgpt-oss-120bCheck price
Intel Arc B57010 GB usable$219Won’t fitWon’t fitAmazoneBay
GeForce RTX 3050 8GB8 GB usable$249Won’t fitWon’t fitAmazoneBay
Intel Arc B58012 GB usable$249Won’t fitWon’t fitAmazoneBay
Radeon RX 76008 GB usable$269Won’t fitWon’t fitAmazoneBay
Intel Arc A7508 GB usable$289Won’t fitWon’t fitAmazoneBay
GeForce RTX 40608 GB usable$299Won’t fitWon’t fitAmazoneBay
GeForce RTX 50608 GB usable$299Won’t fitWon’t fitAmazoneBay
Radeon RX 9060 XT 8GB8 GB usable$299Won’t fitWon’t fitAmazoneBay
GeForce RTX 3060 12GB12 GB usable$329Won’t fitWon’t fitAmazoneBay
Radeon RX 7600 XT16 GB usable$329TightWon’t fitAmazoneBay
GeForce RTX 2060 6GB6 GB usable$349Won’t fitWon’t fitAmazoneBay
Radeon RX 9060 XT 16GB16 GB usable$349TightWon’t fitAmazoneBay
Intel Arc A770 16GB16 GB usable$349TightWon’t fitAmazoneBay
GeForce RTX 5060 Ti 8GB8 GB usable$379Won’t fitWon’t fitAmazoneBay
GeForce RTX 3060 Ti8 GB usable$399Won’t fitWon’t fitAmazoneBay
GeForce RTX 2060 Super8 GB usable$399Won’t fitWon’t fitAmazoneBay
GeForce RTX 4060 Ti 8GB8 GB usable$399Won’t fitWon’t fitAmazoneBay
GeForce RTX 5060 Ti 16GB16 GB usable$429TightWon’t fitAmazoneBay
Radeon RX 7700 XT12 GB usable$449Won’t fitWon’t fitAmazoneBay
Radeon RX 6700 XT12 GB usable$479Won’t fitWon’t fitAmazoneBay
GeForce RTX 30708 GB usable$499Won’t fitWon’t fitAmazoneBay
GeForce RTX 4060 Ti 16GB16 GB usable$499TightWon’t fitAmazoneBay
Radeon RX 7800 XT16 GB usable$499TightWon’t fitAmazoneBay
GeForce RTX 20708 GB usable$499Won’t fitWon’t fitAmazoneBay
GeForce RTX 2070 Super8 GB usable$499Won’t fitWon’t fitAmazoneBay
GeForce RTX 507012 GB usable$549Won’t fitWon’t fitAmazoneBay
Radeon RX 6750 XT12 GB usable$549Won’t fitWon’t fitAmazoneBay
Radeon RX 7900 GRE16 GB usable$549TightWon’t fitAmazoneBay
Radeon RX 907016 GB usable$549TightWon’t fitAmazoneBay
Radeon RX 680016 GB usable$579TightWon’t fitAmazoneBay
GeForce RTX 407012 GB usable$599Won’t fitWon’t fitAmazoneBay
GeForce RTX 4070 Super12 GB usable$599Won’t fitWon’t fitAmazoneBay
GeForce RTX 3070 Ti8 GB usable$599Won’t fitWon’t fitAmazoneBay
Radeon RX 9070 XT16 GB usable$599TightWon’t fitAmazoneBay
Radeon RX 6800 XT16 GB usable$649TightWon’t fitAmazoneBay
NVIDIA RTX 2000 Ada 16GB16 GB usable$649TightWon’t fitAmazoneBay
GeForce RTX 3080 10GB10 GB usable$699Won’t fitWon’t fitAmazoneBay
GeForce RTX 20808 GB usable$699Won’t fitWon’t fitAmazoneBay
GeForce RTX 2080 Super8 GB usable$699Won’t fitWon’t fitAmazoneBay
GeForce RTX 5070 Ti16 GB usable$749TightWon’t fitAmazoneBay
Mac mini M4 16GB12 GB usable$789Won’t fitWon’t fitAmazoneBay
GeForce RTX 4070 Ti Super16 GB usable$799TightWon’t fitAmazoneBay
GeForce RTX 3080 12GB12 GB usable$799Won’t fitWon’t fitAmazoneBay
GeForce RTX 4070 Ti12 GB usable$799Won’t fitWon’t fitAmazoneBay
Radeon RX 7900 XT20 GB usable$899FitsWon’t fitAmazoneBay
Mac mini M6 16GB12 GB usable$899Won’t fitWon’t fitAmazoneBay
Intel Arc Pro B70 32GB32 GB usable$949FitsWon’t fitAmazoneBay
GeForce RTX 4080 Super16 GB usable$999TightWon’t fitAmazoneBay
GeForce RTX 508016 GB usable$999TightWon’t fitAmazoneBay
Radeon RX 7900 XTX24 GB usable$999FitsWon’t fitAmazoneBay
GeForce RTX 2080 Ti11 GB usable$999Won’t fitWon’t fitAmazoneBay
Radeon RX 6900 XT16 GB usable$999TightWon’t fitAmazoneBay
NVIDIA RTX A400016 GB usable$1000TightWon’t fitAmazoneBay
Radeon RX 6950 XT16 GB usable$1099TightWon’t fitAmazoneBay
GeForce RTX 3080 Ti12 GB usable$1199Won’t fitWon’t fitAmazoneBay
GeForce RTX 408016 GB usable$1199TightWon’t fitAmazoneBay
NVIDIA RTX 4000 Ada 20GB20 GB usable$1250FitsWon’t fitAmazoneBay
Mac mini M6 24GB18 GB usable$1299FitsWon’t fitAmazoneBay
GeForce RTX 309024 GB usable$1499FitsWon’t fitAmazoneBay
GeForce RTX 409024 GB usable$1599FitsWon’t fitAmazoneBay
Mac mini M6 32GB24 GB usable$1799FitsWon’t fitAmazoneBay
GeForce RTX 3090 Ti24 GB usable$1999FitsWon’t fitAmazoneBay
GeForce RTX 509032 GB usable$1999FitsWon’t fitAmazoneBay
NVIDIA RTX A500024 GB usable$2250FitsWon’t fitAmazoneBay
MacBook Pro M6 32GB24 GB usable$2399FitsWon’t fitAmazoneBay
NVIDIA Titan RTX24 GB usable$2499FitsWon’t fitAmazoneBay
Mac mini M5 Pro 64GB48 GB usable$3199FitsWon’t fitAmazoneBay
Framework Desktop (Ryzen AI Max+ 395) 128GB96 GB usable$3449FitsFitsAmazoneBay
NVIDIA RTX A600048 GB usable$4649FitsWon’t fitAmazoneBay
MacBook Pro M4 Max 128GB96 GB usable$4999FitsFitsAmazoneBay
NVIDIA DGX Spark 64GB48 GB usable$4999FitsWon’t fitAmazoneBay
MacBook Pro M5 Max 128GB96 GB usable$6699FitsFitsAmazoneBay
NVIDIA RTX 6000 Ada 48GB48 GB usable$6799FitsWon’t fitAmazoneBay
NVIDIA DGX Spark 128GB96 GB usable$6950FitsFitsAmazoneBay
NVIDIA RTX Pro 6000 Blackwell 96GB96 GB usable$8565FitsFitsAmazoneBay
Mac Studio M5 Ultra 256GB192 GB usable$9499FitsFitsAmazoneBay
Mac Studio M5 Ultra 512GB384 GB usable$22299FitsFitsAmazoneBay

We may earn a commission when you buy through these links, at no extra cost to you.

Quick answers

What is the cheapest GPU for running gpt-oss locally?
Of the devices we track, the Radeon RX 7900 XT ($899) is the cheapest that runs gpt-oss-20b at Q4.
What hardware do I need for gpt-oss-120b?
The cheapest fit we track is the Framework Desktop (Ryzen AI Max+ 395) 128GB at $3449. gpt-oss-120b needs about 82.5 GB at Q4.
How much VRAM does gpt-oss need?
gpt-oss-20b needs about 15.6 GB at Q4; gpt-oss-120b needs about 82.5 GB. These are estimates at Q4_K_M with about 4k context.

Other guides

New models, and what they need to run

One short email a week: fresh open models with their VRAM numbers, plus hardware worth watching.