# Can I run gpt-oss-120b locally? | What Can I Run AI? > gpt-oss-120b needs about 82.5 GB VRAM at Q4. Cheapest GPU we track that holds it: NVIDIA RTX Pro 6000 Blackwell 96GB. See which GPUs and Macs can run it. Source: https://whatcanirunai.vercel.app/models/gpt-oss-120b/ # Can I run gpt-oss-120b? gpt-oss-120b needs about 82.5 GB of memory at Q4\_K\_M, and the cheapest GPU we track that holds it is the NVIDIA RTX Pro 6000 Blackwell 96GB (96 GB, $8565 list price). 7 of the 82 devices we track run it fully at Q4\. These are estimates, not measured benchmarks. 116.8B parameters, by openai. License: apache-2.0\. [Model card](https://huggingface.co/openai/gpt-oss-120b) (params from HF API, retrieved 2026-10-19) · [How much VRAM for 120B models](https://whatcanirunai.vercel.app/how-much-vram/120b/) · [Best GPU for gpt-oss](https://whatcanirunai.vercel.app/best-gpu-for/gpt-oss/) · [Tokens per second by device](https://whatcanirunai.vercel.app/tokens-per-second/#gpt-oss-120b) · [Ollama VRAM (gpt-oss:120b)](https://whatcanirunai.vercel.app/ollama-vram-requirements/) · [GGUF sizes Q3–Q8 (llama.cpp)](https://whatcanirunai.vercel.app/gguf-vram-requirements/#gpt-oss-120b) · [Q4 vs Q8 vs FP16](https://whatcanirunai.vercel.app/quantization/) · [MoE: 5.1B active per token](https://whatcanirunai.vercel.app/moe-vs-dense/) Q4\_K\_M needs 82.5 GB 70.8 GB weights Q8\_0 needs 143.8 GB 124.1 GB weights FP16 needs 269.7 GB 233.7 GB weights **7 of 82** tracked GPUs and Macs run it fully at Q4. ## Memory by context length Longer chats and documents need more memory for the KV cache. Only 18 of its 36 layers keep a cache that grows with context (18 use a 128-token sliding window), so it stays lean at long contexts. Sizes assume an FP16 KV cache; a Q8 cache roughly halves the cache part. __Memory needed for gpt-oss-120b by context length__ | Context | KV cache (FP16) | Total at Q4\_K\_M | Total at Q8\_0 | | ----------- | --------------- | ----------------- | -------------- | | 4k tokens | 0.2 GB | 82.5 GB | 143.8 GB | | 8k tokens | 0.3 GB | 82.6 GB | 143.9 GB | | 16k tokens | 0.6 GB | 82.9 GB | 144.2 GB | | 32k tokens | 1.2 GB | 83.5 GB | 144.8 GB | | 64k tokens | 2.4 GB | 84.7 GB | 146.0 GB | | 128k tokens | 4.8 GB | 87.1 GB | 148.4 GB | From the model's [config.json](https://huggingface.co/openai/gpt-oss-120b/blob/main/config.json) (18 full-attention layers × 8 KV heads × 64 head size, retrieved 2026-10-25). Check the model card for its maximum supported context. Try other sizes in the [VRAM calculator](https://whatcanirunai.vercel.app/vram-calculator/?ctx=32768) or compare models in our [context length guide](https://whatcanirunai.vercel.app/context-length/). Compare: [gpt-oss-120b vs Llama-3.3-70B-Instruct](https://whatcanirunai.vercel.app/compare/gpt-oss-120b-vs-llama-3.3-70b-instruct/) ## Can I run gpt-oss-120b on a specific GPU or Mac? Direct yes-or-no checks for popular hardware, with the quant that fits and an estimated tokens/sec range. * [Can I run gpt-oss-120b on an RTX 4090?](https://whatcanirunai.vercel.app/can-i-run/gpt-oss-120b/rtx-4090/)Q4Won’t fit * [Can I run gpt-oss-120b on an RTX 5090?](https://whatcanirunai.vercel.app/can-i-run/gpt-oss-120b/rtx-5090/)Q4Won’t fit * [Can I run gpt-oss-120b on an RTX 3090?](https://whatcanirunai.vercel.app/can-i-run/gpt-oss-120b/rtx-3090/)Q4Won’t fit * [Can I run gpt-oss-120b on dual RTX 3090s?](https://whatcanirunai.vercel.app/can-i-run/gpt-oss-120b/dual-rtx-3090/)Q4Won’t fit * [Can I run gpt-oss-120b on a Mac mini 64GB?](https://whatcanirunai.vercel.app/can-i-run/gpt-oss-120b/mac-mini-m5-pro-64/)Q4Won’t fit * [Can I run gpt-oss-120b on a Mac Studio 256GB?](https://whatcanirunai.vercel.app/can-i-run/gpt-oss-120b/mac-studio-m5-ultra-256/)Q8Fits * [Can I run gpt-oss-120b on a Mac Studio 512GB?](https://whatcanirunai.vercel.app/can-i-run/gpt-oss-120b/mac-studio-m5-ultra-512/)FP16Fits * [Can I run gpt-oss-120b on an RX 7900 XTX?](https://whatcanirunai.vercel.app/can-i-run/gpt-oss-120b/rx-7900-xtx/)Q4Won’t fit ## Which hardware runs it Bar: Q4 memory needed vs. usable memory. The tick marks 90%, our comfort line.FitsTightWon’t fit | Hardware | Q4 need vs. usable | Q4 / Q8 / FP16 | Check price | | ------------------------------------------------------------------------------------------- | ------------------- | ----------------------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | [GeForce RTX 3050 8GB](https://whatcanirunai.vercel.app/hardware/rtx-3050-8gb/)8 GB usable | **82.5** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203050%208GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203050%208GB) | | [GeForce RTX 3060 12GB](https://whatcanirunai.vercel.app/hardware/rtx-3060-12gb/)12 GB usable | **82.5** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203060%2012GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203060%2012GB) | | [GeForce RTX 3060 Ti](https://whatcanirunai.vercel.app/hardware/rtx-3060-ti/)8 GB usable | **82.5** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203060%20Ti&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203060%20Ti) | | [GeForce RTX 3070](https://whatcanirunai.vercel.app/hardware/rtx-3070/)8 GB usable | **82.5** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203070&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203070) | | [GeForce RTX 3080 10GB](https://whatcanirunai.vercel.app/hardware/rtx-3080-10gb/)10 GB usable | **82.5** / 10.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203080%2010GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203080%2010GB) | | [GeForce RTX 3080 Ti](https://whatcanirunai.vercel.app/hardware/rtx-3080-ti/)12 GB usable | **82.5** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203080%20Ti&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203080%20Ti) | | [GeForce RTX 3090](https://whatcanirunai.vercel.app/hardware/rtx-3090/)24 GB usable | **82.5** / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203090&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203090) | | [GeForce RTX 3090 Ti](https://whatcanirunai.vercel.app/hardware/rtx-3090-ti/)24 GB usable | **82.5** / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203090%20Ti&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203090%20Ti) | | [GeForce RTX 4060](https://whatcanirunai.vercel.app/hardware/rtx-4060/)8 GB usable | **82.5** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204060&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204060) | | [GeForce RTX 4060 Ti 16GB](https://whatcanirunai.vercel.app/hardware/rtx-4060-ti-16gb/)16 GB usable | **82.5** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204060%20Ti%2016GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204060%20Ti%2016GB) | | [GeForce RTX 4070](https://whatcanirunai.vercel.app/hardware/rtx-4070/)12 GB usable | **82.5** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204070&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204070) | | [GeForce RTX 4070 Super](https://whatcanirunai.vercel.app/hardware/rtx-4070-super/)12 GB usable | **82.5** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204070%20Super&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204070%20Super) | | [GeForce RTX 4070 Ti Super](https://whatcanirunai.vercel.app/hardware/rtx-4070-ti-super/)16 GB usable | **82.5** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204070%20Ti%20Super&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204070%20Ti%20Super) | | [GeForce RTX 4080 Super](https://whatcanirunai.vercel.app/hardware/rtx-4080-super/)16 GB usable | **82.5** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204080%20Super&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204080%20Super) | | [GeForce RTX 4090](https://whatcanirunai.vercel.app/hardware/rtx-4090/)24 GB usable | **82.5** / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204090&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204090) | | [GeForce RTX 5070](https://whatcanirunai.vercel.app/hardware/rtx-5070/)12 GB usable | **82.5** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%205070&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%205070) | | [GeForce RTX 5080](https://whatcanirunai.vercel.app/hardware/rtx-5080/)16 GB usable | **82.5** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%205080&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%205080) | | [GeForce RTX 5090](https://whatcanirunai.vercel.app/hardware/rtx-5090/)32 GB usable | **82.5** / 32.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%205090&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%205090) | | [Radeon RX 7600 XT](https://whatcanirunai.vercel.app/hardware/rx-7600-xt/)16 GB usable | **82.5** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%207600%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%207600%20XT) | | [Radeon RX 7800 XT](https://whatcanirunai.vercel.app/hardware/rx-7800-xt/)16 GB usable | **82.5** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%207800%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%207800%20XT) | | [Radeon RX 7900 XT](https://whatcanirunai.vercel.app/hardware/rx-7900-xt/)20 GB usable | **82.5** / 20.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%207900%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%207900%20XT) | | [Radeon RX 7900 XTX](https://whatcanirunai.vercel.app/hardware/rx-7900-xtx/)24 GB usable | **82.5** / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%207900%20XTX&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%207900%20XTX) | | [Intel Arc B580](https://whatcanirunai.vercel.app/hardware/arc-b580/)12 GB usable | **82.5** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Intel%20Arc%20B580&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Intel%20Arc%20B580) | | [Intel Arc Pro B70 32GB](https://whatcanirunai.vercel.app/hardware/arc-pro-b70/)32 GB usable | **82.5** / 32.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Intel%20Arc%20Pro%20B70%2032GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Intel%20Arc%20Pro%20B70%2032GB) | | [Mac mini M4 16GB](https://whatcanirunai.vercel.app/hardware/mac-mini-m4-16/)12 GB usable | **82.5** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Mac%20mini%20M4%2016GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Mac%20mini%20M4%2016GB) | | [Mac mini M6 16GB](https://whatcanirunai.vercel.app/hardware/mac-mini-m6-16/)12 GB usable | **82.5** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Mac%20mini%20M6%2016GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Mac%20mini%20M6%2016GB) | | [Mac mini M6 24GB](https://whatcanirunai.vercel.app/hardware/mac-mini-m6-24/)18 GB usable | **82.5** / 18.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Mac%20mini%20M6%2024GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Mac%20mini%20M6%2024GB) | | [Mac mini M6 32GB](https://whatcanirunai.vercel.app/hardware/mac-mini-m6-32/)24 GB usable | **82.5** / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Mac%20mini%20M6%2032GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Mac%20mini%20M6%2032GB) | | [Mac mini M5 Pro 64GB](https://whatcanirunai.vercel.app/hardware/mac-mini-m5-pro-64/)48 GB usable | **82.5** / 48.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Mac%20mini%20M5%20Pro%2064GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Mac%20mini%20M5%20Pro%2064GB) | | [MacBook Pro M4 Max 128GB](https://whatcanirunai.vercel.app/hardware/macbook-pro-m4-max-128/)96 GB usable | **82.5** / 96.0 GB | Q4FitsQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=MacBook%20Pro%20M4%20Max%20128GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=MacBook%20Pro%20M4%20Max%20128GB) | | [MacBook Pro M5 Max 128GB](https://whatcanirunai.vercel.app/hardware/macbook-pro-m5-max-128/)96 GB usable | **82.5** / 96.0 GB | Q4FitsQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=MacBook%20Pro%20M5%20Max%20128GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=MacBook%20Pro%20M5%20Max%20128GB) | | [MacBook Pro M6 32GB](https://whatcanirunai.vercel.app/hardware/macbook-pro-m6-32/)24 GB usable | **82.5** / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=MacBook%20Pro%20M6%2032GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=MacBook%20Pro%20M6%2032GB) | | [Mac Studio M5 Ultra 256GB](https://whatcanirunai.vercel.app/hardware/mac-studio-m5-ultra-256/)192 GB usable | **82.5** / 192.0 GB | Q4FitsQ8FitsFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Mac%20Studio%20M5%20Ultra%20256GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Mac%20Studio%20M5%20Ultra%20256GB) | | [Mac Studio M5 Ultra 512GB](https://whatcanirunai.vercel.app/hardware/mac-studio-m5-ultra-512/)384 GB usable | **82.5** / 384.0 GB | Q4FitsQ8FitsFP16Fits | [Amazon](https://www.amazon.com/s?k=Mac%20Studio%20M5%20Ultra%20512GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Mac%20Studio%20M5%20Ultra%20512GB) | | [Framework Desktop (Ryzen AI Max+ 395) 128GB](https://whatcanirunai.vercel.app/hardware/framework-desktop-128/)96 GB usable | **82.5** / 96.0 GB | Q4FitsQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Framework%20Desktop%20%28Ryzen%20AI%20Max%2B%20395%29%20128GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Framework%20Desktop%20%28Ryzen%20AI%20Max%2B%20395%29%20128GB) | | [NVIDIA DGX Spark 64GB](https://whatcanirunai.vercel.app/hardware/dgx-spark-64/)48 GB usable | **82.5** / 48.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20DGX%20Spark%2064GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20DGX%20Spark%2064GB) | | [NVIDIA DGX Spark 128GB](https://whatcanirunai.vercel.app/hardware/dgx-spark-128/)96 GB usable | **82.5** / 96.0 GB | Q4FitsQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20DGX%20Spark%20128GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20DGX%20Spark%20128GB) | | [GeForce RTX 2060 6GB](https://whatcanirunai.vercel.app/hardware/rtx-2060/)6 GB usable | **82.5** / 6.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%202060%206GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%202060%206GB) | | [GeForce RTX 2060 12GB](https://whatcanirunai.vercel.app/hardware/rtx-2060-12gb/)12 GB usable | **82.5** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%202060%2012GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%202060%2012GB) | | [GeForce RTX 2060 Super](https://whatcanirunai.vercel.app/hardware/rtx-2060-super/)8 GB usable | **82.5** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%202060%20Super&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%202060%20Super) | | [GeForce RTX 2070](https://whatcanirunai.vercel.app/hardware/rtx-2070/)8 GB usable | **82.5** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%202070&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%202070) | | [GeForce RTX 2070 Super](https://whatcanirunai.vercel.app/hardware/rtx-2070-super/)8 GB usable | **82.5** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%202070%20Super&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%202070%20Super) | | [GeForce RTX 2080](https://whatcanirunai.vercel.app/hardware/rtx-2080/)8 GB usable | **82.5** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%202080&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%202080) | | [GeForce RTX 2080 Super](https://whatcanirunai.vercel.app/hardware/rtx-2080-super/)8 GB usable | **82.5** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%202080%20Super&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%202080%20Super) | | [GeForce RTX 2080 Ti](https://whatcanirunai.vercel.app/hardware/rtx-2080-ti/)11 GB usable | **82.5** / 11.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%202080%20Ti&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%202080%20Ti) | | [NVIDIA Titan RTX](https://whatcanirunai.vercel.app/hardware/titan-rtx/)24 GB usable | **82.5** / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20Titan%20RTX&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20Titan%20RTX) | | [GeForce RTX 3070 Ti](https://whatcanirunai.vercel.app/hardware/rtx-3070-ti/)8 GB usable | **82.5** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203070%20Ti&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203070%20Ti) | | [GeForce RTX 3080 12GB](https://whatcanirunai.vercel.app/hardware/rtx-3080-12gb/)12 GB usable | **82.5** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203080%2012GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203080%2012GB) | | [GeForce RTX 4060 Ti 8GB](https://whatcanirunai.vercel.app/hardware/rtx-4060-ti-8gb/)8 GB usable | **82.5** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204060%20Ti%208GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204060%20Ti%208GB) | | [GeForce RTX 4070 Ti](https://whatcanirunai.vercel.app/hardware/rtx-4070-ti/)12 GB usable | **82.5** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204070%20Ti&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204070%20Ti) | | [GeForce RTX 4080](https://whatcanirunai.vercel.app/hardware/rtx-4080/)16 GB usable | **82.5** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204080&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204080) | | [GeForce RTX 5060](https://whatcanirunai.vercel.app/hardware/rtx-5060/)8 GB usable | **82.5** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%205060&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%205060) | | [GeForce RTX 5060 Ti 8GB](https://whatcanirunai.vercel.app/hardware/rtx-5060-ti-8gb/)8 GB usable | **82.5** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%205060%20Ti%208GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%205060%20Ti%208GB) | | [GeForce RTX 5060 Ti 16GB](https://whatcanirunai.vercel.app/hardware/rtx-5060-ti-16gb/)16 GB usable | **82.5** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%205060%20Ti%2016GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%205060%20Ti%2016GB) | | [GeForce RTX 5070 Ti](https://whatcanirunai.vercel.app/hardware/rtx-5070-ti/)16 GB usable | **82.5** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%205070%20Ti&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%205070%20Ti) | | [Radeon RX 6700 XT](https://whatcanirunai.vercel.app/hardware/rx-6700-xt/)12 GB usable | **82.5** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%206700%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%206700%20XT) | | [Radeon RX 6750 XT](https://whatcanirunai.vercel.app/hardware/rx-6750-xt/)12 GB usable | **82.5** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%206750%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%206750%20XT) | | [Radeon RX 6800](https://whatcanirunai.vercel.app/hardware/rx-6800/)16 GB usable | **82.5** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%206800&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%206800) | | [Radeon RX 6800 XT](https://whatcanirunai.vercel.app/hardware/rx-6800-xt/)16 GB usable | **82.5** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%206800%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%206800%20XT) | | [Radeon RX 6900 XT](https://whatcanirunai.vercel.app/hardware/rx-6900-xt/)16 GB usable | **82.5** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%206900%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%206900%20XT) | | [Radeon RX 6950 XT](https://whatcanirunai.vercel.app/hardware/rx-6950-xt/)16 GB usable | **82.5** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%206950%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%206950%20XT) | | [Radeon RX 7600](https://whatcanirunai.vercel.app/hardware/rx-7600/)8 GB usable | **82.5** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%207600&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%207600) | | [Radeon RX 7700 XT](https://whatcanirunai.vercel.app/hardware/rx-7700-xt/)12 GB usable | **82.5** / 12.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%207700%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%207700%20XT) | | [Radeon RX 7900 GRE](https://whatcanirunai.vercel.app/hardware/rx-7900-gre/)16 GB usable | **82.5** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%207900%20GRE&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%207900%20GRE) | | [Radeon RX 9060 XT 8GB](https://whatcanirunai.vercel.app/hardware/rx-9060-xt-8gb/)8 GB usable | **82.5** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%209060%20XT%208GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%209060%20XT%208GB) | | [Radeon RX 9060 XT 16GB](https://whatcanirunai.vercel.app/hardware/rx-9060-xt-16gb/)16 GB usable | **82.5** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%209060%20XT%2016GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%209060%20XT%2016GB) | | [Radeon RX 9070](https://whatcanirunai.vercel.app/hardware/rx-9070/)16 GB usable | **82.5** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%209070&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%209070) | | [Radeon RX 9070 XT](https://whatcanirunai.vercel.app/hardware/rx-9070-xt/)16 GB usable | **82.5** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%209070%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%209070%20XT) | | [Intel Arc A750](https://whatcanirunai.vercel.app/hardware/arc-a750/)8 GB usable | **82.5** / 8.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Intel%20Arc%20A750&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Intel%20Arc%20A750) | | [Intel Arc A770 16GB](https://whatcanirunai.vercel.app/hardware/arc-a770-16gb/)16 GB usable | **82.5** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Intel%20Arc%20A770%2016GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Intel%20Arc%20A770%2016GB) | | [Intel Arc B570](https://whatcanirunai.vercel.app/hardware/arc-b570/)10 GB usable | **82.5** / 10.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=Intel%20Arc%20B570&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Intel%20Arc%20B570) | | [NVIDIA RTX A4000](https://whatcanirunai.vercel.app/hardware/rtx-a4000/)16 GB usable | **82.5** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20RTX%20A4000&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20RTX%20A4000) | | [NVIDIA RTX A5000](https://whatcanirunai.vercel.app/hardware/rtx-a5000/)24 GB usable | **82.5** / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20RTX%20A5000&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20RTX%20A5000) | | [NVIDIA RTX A6000](https://whatcanirunai.vercel.app/hardware/rtx-a6000/)48 GB usable | **82.5** / 48.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20RTX%20A6000&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20RTX%20A6000) | | [NVIDIA RTX 2000 Ada 16GB](https://whatcanirunai.vercel.app/hardware/rtx-2000-ada/)16 GB usable | **82.5** / 16.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20RTX%202000%20Ada%2016GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20RTX%202000%20Ada%2016GB) | | [NVIDIA RTX 4000 Ada 20GB](https://whatcanirunai.vercel.app/hardware/rtx-4000-ada/)20 GB usable | **82.5** / 20.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20RTX%204000%20Ada%2020GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20RTX%204000%20Ada%2020GB) | | [NVIDIA RTX 6000 Ada 48GB](https://whatcanirunai.vercel.app/hardware/rtx-6000-ada/)48 GB usable | **82.5** / 48.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20RTX%206000%20Ada%2048GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20RTX%206000%20Ada%2048GB) | | [NVIDIA RTX Pro 6000 Blackwell 96GB](https://whatcanirunai.vercel.app/hardware/rtx-pro-6000-blackwell/)96 GB usable | **82.5** / 96.0 GB | Q4FitsQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20RTX%20Pro%206000%20Blackwell%2096GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20RTX%20Pro%206000%20Blackwell%2096GB) | | [NVIDIA Tesla P40 24GB](https://whatcanirunai.vercel.app/hardware/tesla-p40/)24 GB usable | **82.5** / 24.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20Tesla%20P40%2024GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20Tesla%20P40%2024GB) | | [NVIDIA Tesla V100 32GB (PCIe)](https://whatcanirunai.vercel.app/hardware/tesla-v100-32gb/)32 GB usable | **82.5** / 32.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20Tesla%20V100%2032GB%20%28PCIe%29&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20Tesla%20V100%2032GB%20%28PCIe%29) | | [AMD Radeon Instinct MI50 32GB](https://whatcanirunai.vercel.app/hardware/instinct-mi50-32gb/)32 GB usable | **82.5** / 32.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=AMD%20Radeon%20Instinct%20MI50%2032GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=AMD%20Radeon%20Instinct%20MI50%2032GB) | | [AMD Radeon Instinct MI60 32GB](https://whatcanirunai.vercel.app/hardware/instinct-mi60/)32 GB usable | **82.5** / 32.0 GB | Q4Won’t fitQ8Won’t fitFP16Won’t fit | [Amazon](https://www.amazon.com/s?k=AMD%20Radeon%20Instinct%20MI60%2032GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=AMD%20Radeon%20Instinct%20MI60%2032GB) | We may earn a commission when you buy through these links, at no extra cost to you. ## Quick answers How much VRAM does gpt-oss-120b need? About 82.5 GB at Q4\_K\_M, 143.8 GB at Q8\_0 and 269.7 GB at FP16\. These are estimates: weights plus about 15% for the KV cache at a \~4k context, plus 1 GB for the runtime. What is the cheapest GPU that runs gpt-oss-120b? Of the GPUs we track, the NVIDIA RTX Pro 6000 Blackwell 96GB (96 GB, $8565 list price) is the cheapest one that runs it fully on the GPU at Q4. Can a Mac or mini PC run gpt-oss-120b? Yes. The cheapest Mac or unified-memory mini PC we track that runs it at Q4 is the Framework Desktop (Ryzen AI Max+ 395) 128GB (128 GB, 96.0 GB usable for models, $3449). How much VRAM does gpt-oss-120b need for 32k context? About 83.5 GB at Q4\_K\_M with an FP16 KV cache (1.2 GB of that is the cache), or 87.1 GB at 128k. Estimated from the model's published config. How many GPUs and Macs can run gpt-oss-120b? 7 of the 82 GPUs and Macs we track run it fully at Q4. --- Agent guide: https://whatcanirunai.vercel.app/llms.txt · JSON API: https://whatcanirunai.vercel.app/developers/