# Best GPU for running Mistral locally | What Can I Run AI? > The cheapest GPUs and Macs that run Mistral AI’s open models (Mistral 7B, Nemo, Small 3.2, Small 4) locally, model by model, with VRAM needs at Q4. Source: https://whatcanirunai.vercel.app/best-gpu-for/mistral/ # Best GPU for running Mistral locally Which GPU or Mac you need for Mistral AI’s open models (Mistral 7B, Nemo, Small 3.2, Small 4), from the cheapest card that runs the small one to what it takes for Mistral-Small-4-119B-2603\. All checks are at Q4\_K\_M, about 4k context. Cheapest way in: **Intel Arc B570** runs Mistral-7B-Instruct-v0.3 for $219\. For Mistral-Small-4-119B-2603, the cheapest fit we track is **Framework Desktop (Ryzen AI Max+ 395) 128GB** at $3449. ## Cheapest hardware per model | Model | Cheapest GPU that fits | Cheapest Mac or mini-PC that fits | | -------------------------------------------------------------------------------------------------- | --------------------------------------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------- | | [Mistral-7B-Instruct-v0.3](https://whatcanirunai.vercel.app/models/mistral-7b-instruct-v0.3/)\~6.1 GB at Q4 | [Intel Arc B570](https://whatcanirunai.vercel.app/hardware/arc-b570/)$219 list | [Mac mini M6 16GB](https://whatcanirunai.vercel.app/hardware/mac-mini-m6-16/)$899 Apple list price, M6 12C CPU/12C GPU, 16GB/256GB | | [Mistral-Nemo-Instruct-2407](https://whatcanirunai.vercel.app/models/mistral-nemo-instruct-2407/)\~9.5 GB at Q4 | [Intel Arc B580](https://whatcanirunai.vercel.app/hardware/arc-b580/)$249 list | [Mac mini M6 16GB](https://whatcanirunai.vercel.app/hardware/mac-mini-m6-16/)$899 Apple list price, M6 12C CPU/12C GPU, 16GB/256GB | | [Mistral-Small-3.2-24B-Instruct-2506](https://whatcanirunai.vercel.app/models/mistral-small-3.2-24b-instruct-2506/)\~17.7 GB at Q4 | [Radeon RX 7900 XT](https://whatcanirunai.vercel.app/hardware/rx-7900-xt/)$899 list | [Mac mini M6 32GB](https://whatcanirunai.vercel.app/hardware/mac-mini-m6-32/)$1799 Apple list price, M6 12C CPU/12C GPU, 32GB/1TB | | [Mistral-Small-4-119B-2603](https://whatcanirunai.vercel.app/models/mistral-small-4-119b-2603/)\~84.2 GB at Q4 | [NVIDIA RTX Pro 6000 Blackwell 96GB](https://whatcanirunai.vercel.app/hardware/rtx-pro-6000-blackwell/)$8565 list | [Framework Desktop (Ryzen AI Max+ 395) 128GB](https://whatcanirunai.vercel.app/hardware/framework-desktop-128/)$3449 Framework list price, DIY Edition 128GB | "Fits" means the model needs 90% or less of usable memory at Q4 ([how we calculate](https://whatcanirunai.vercel.app/method/)). Prices are dated snapshots, mostly launch MSRP, so street prices can differ a lot; see each device page for its source. ## Every priced machine, cheapest first Q4 verdict for each Mistral model.FitsTightWon’t fit | Hardware | Price | Mistral-7B-Instruct-v0.3 | Mistral-Nemo-Instruct-2407 | Mistral-Small-3.2-24B-Instruct-2506 | Mistral-Small-4-119B-2603 | Check price | | ------------------------------------------------------------------------------------------- | ------ | ------------------------ | -------------------------- | ----------------------------------- | ------------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | [Intel Arc B570](https://whatcanirunai.vercel.app/hardware/arc-b570/)10 GB usable | $219 | Fits | Tight | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=Intel%20Arc%20B570&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Intel%20Arc%20B570) | | [GeForce RTX 3050 8GB](https://whatcanirunai.vercel.app/hardware/rtx-3050-8gb/)8 GB usable | $249 | Fits | Won’t fit | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203050%208GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203050%208GB) | | [Intel Arc B580](https://whatcanirunai.vercel.app/hardware/arc-b580/)12 GB usable | $249 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=Intel%20Arc%20B580&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Intel%20Arc%20B580) | | [Radeon RX 7600](https://whatcanirunai.vercel.app/hardware/rx-7600/)8 GB usable | $269 | Fits | Won’t fit | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%207600&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%207600) | | [Intel Arc A750](https://whatcanirunai.vercel.app/hardware/arc-a750/)8 GB usable | $289 | Fits | Won’t fit | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=Intel%20Arc%20A750&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Intel%20Arc%20A750) | | [GeForce RTX 4060](https://whatcanirunai.vercel.app/hardware/rtx-4060/)8 GB usable | $299 | Fits | Won’t fit | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204060&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204060) | | [GeForce RTX 5060](https://whatcanirunai.vercel.app/hardware/rtx-5060/)8 GB usable | $299 | Fits | Won’t fit | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%205060&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%205060) | | [Radeon RX 9060 XT 8GB](https://whatcanirunai.vercel.app/hardware/rx-9060-xt-8gb/)8 GB usable | $299 | Fits | Won’t fit | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%209060%20XT%208GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%209060%20XT%208GB) | | [GeForce RTX 3060 12GB](https://whatcanirunai.vercel.app/hardware/rtx-3060-12gb/)12 GB usable | $329 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203060%2012GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203060%2012GB) | | [Radeon RX 7600 XT](https://whatcanirunai.vercel.app/hardware/rx-7600-xt/)16 GB usable | $329 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%207600%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%207600%20XT) | | [GeForce RTX 2060 6GB](https://whatcanirunai.vercel.app/hardware/rtx-2060/)6 GB usable | $349 | Won’t fit | Won’t fit | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%202060%206GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%202060%206GB) | | [Radeon RX 9060 XT 16GB](https://whatcanirunai.vercel.app/hardware/rx-9060-xt-16gb/)16 GB usable | $349 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%209060%20XT%2016GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%209060%20XT%2016GB) | | [Intel Arc A770 16GB](https://whatcanirunai.vercel.app/hardware/arc-a770-16gb/)16 GB usable | $349 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=Intel%20Arc%20A770%2016GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Intel%20Arc%20A770%2016GB) | | [GeForce RTX 5060 Ti 8GB](https://whatcanirunai.vercel.app/hardware/rtx-5060-ti-8gb/)8 GB usable | $379 | Fits | Won’t fit | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%205060%20Ti%208GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%205060%20Ti%208GB) | | [GeForce RTX 3060 Ti](https://whatcanirunai.vercel.app/hardware/rtx-3060-ti/)8 GB usable | $399 | Fits | Won’t fit | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203060%20Ti&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203060%20Ti) | | [GeForce RTX 2060 Super](https://whatcanirunai.vercel.app/hardware/rtx-2060-super/)8 GB usable | $399 | Fits | Won’t fit | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%202060%20Super&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%202060%20Super) | | [GeForce RTX 4060 Ti 8GB](https://whatcanirunai.vercel.app/hardware/rtx-4060-ti-8gb/)8 GB usable | $399 | Fits | Won’t fit | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204060%20Ti%208GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204060%20Ti%208GB) | | [GeForce RTX 5060 Ti 16GB](https://whatcanirunai.vercel.app/hardware/rtx-5060-ti-16gb/)16 GB usable | $429 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%205060%20Ti%2016GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%205060%20Ti%2016GB) | | [Radeon RX 7700 XT](https://whatcanirunai.vercel.app/hardware/rx-7700-xt/)12 GB usable | $449 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%207700%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%207700%20XT) | | [Radeon RX 6700 XT](https://whatcanirunai.vercel.app/hardware/rx-6700-xt/)12 GB usable | $479 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%206700%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%206700%20XT) | | [GeForce RTX 3070](https://whatcanirunai.vercel.app/hardware/rtx-3070/)8 GB usable | $499 | Fits | Won’t fit | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203070&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203070) | | [GeForce RTX 4060 Ti 16GB](https://whatcanirunai.vercel.app/hardware/rtx-4060-ti-16gb/)16 GB usable | $499 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204060%20Ti%2016GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204060%20Ti%2016GB) | | [Radeon RX 7800 XT](https://whatcanirunai.vercel.app/hardware/rx-7800-xt/)16 GB usable | $499 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%207800%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%207800%20XT) | | [GeForce RTX 2070](https://whatcanirunai.vercel.app/hardware/rtx-2070/)8 GB usable | $499 | Fits | Won’t fit | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%202070&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%202070) | | [GeForce RTX 2070 Super](https://whatcanirunai.vercel.app/hardware/rtx-2070-super/)8 GB usable | $499 | Fits | Won’t fit | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%202070%20Super&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%202070%20Super) | | [GeForce RTX 5070](https://whatcanirunai.vercel.app/hardware/rtx-5070/)12 GB usable | $549 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%205070&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%205070) | | [Radeon RX 6750 XT](https://whatcanirunai.vercel.app/hardware/rx-6750-xt/)12 GB usable | $549 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%206750%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%206750%20XT) | | [Radeon RX 7900 GRE](https://whatcanirunai.vercel.app/hardware/rx-7900-gre/)16 GB usable | $549 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%207900%20GRE&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%207900%20GRE) | | [Radeon RX 9070](https://whatcanirunai.vercel.app/hardware/rx-9070/)16 GB usable | $549 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%209070&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%209070) | | [Radeon RX 6800](https://whatcanirunai.vercel.app/hardware/rx-6800/)16 GB usable | $579 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%206800&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%206800) | | [GeForce RTX 4070](https://whatcanirunai.vercel.app/hardware/rtx-4070/)12 GB usable | $599 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204070&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204070) | | [GeForce RTX 4070 Super](https://whatcanirunai.vercel.app/hardware/rtx-4070-super/)12 GB usable | $599 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204070%20Super&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204070%20Super) | | [GeForce RTX 3070 Ti](https://whatcanirunai.vercel.app/hardware/rtx-3070-ti/)8 GB usable | $599 | Fits | Won’t fit | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203070%20Ti&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203070%20Ti) | | [Radeon RX 9070 XT](https://whatcanirunai.vercel.app/hardware/rx-9070-xt/)16 GB usable | $599 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%209070%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%209070%20XT) | | [Radeon RX 6800 XT](https://whatcanirunai.vercel.app/hardware/rx-6800-xt/)16 GB usable | $649 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%206800%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%206800%20XT) | | [NVIDIA RTX 2000 Ada 16GB](https://whatcanirunai.vercel.app/hardware/rtx-2000-ada/)16 GB usable | $649 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20RTX%202000%20Ada%2016GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20RTX%202000%20Ada%2016GB) | | [GeForce RTX 3080 10GB](https://whatcanirunai.vercel.app/hardware/rtx-3080-10gb/)10 GB usable | $699 | Fits | Tight | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203080%2010GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203080%2010GB) | | [GeForce RTX 2080](https://whatcanirunai.vercel.app/hardware/rtx-2080/)8 GB usable | $699 | Fits | Won’t fit | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%202080&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%202080) | | [GeForce RTX 2080 Super](https://whatcanirunai.vercel.app/hardware/rtx-2080-super/)8 GB usable | $699 | Fits | Won’t fit | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%202080%20Super&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%202080%20Super) | | [GeForce RTX 5070 Ti](https://whatcanirunai.vercel.app/hardware/rtx-5070-ti/)16 GB usable | $749 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%205070%20Ti&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%205070%20Ti) | | [Mac mini M4 16GB](https://whatcanirunai.vercel.app/hardware/mac-mini-m4-16/)12 GB usable | $789 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=Mac%20mini%20M4%2016GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Mac%20mini%20M4%2016GB) | | [GeForce RTX 4070 Ti Super](https://whatcanirunai.vercel.app/hardware/rtx-4070-ti-super/)16 GB usable | $799 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204070%20Ti%20Super&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204070%20Ti%20Super) | | [GeForce RTX 3080 12GB](https://whatcanirunai.vercel.app/hardware/rtx-3080-12gb/)12 GB usable | $799 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203080%2012GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203080%2012GB) | | [GeForce RTX 4070 Ti](https://whatcanirunai.vercel.app/hardware/rtx-4070-ti/)12 GB usable | $799 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204070%20Ti&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204070%20Ti) | | [Radeon RX 7900 XT](https://whatcanirunai.vercel.app/hardware/rx-7900-xt/)20 GB usable | $899 | Fits | Fits | Fits | Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%207900%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%207900%20XT) | | [Mac mini M6 16GB](https://whatcanirunai.vercel.app/hardware/mac-mini-m6-16/)12 GB usable | $899 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=Mac%20mini%20M6%2016GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Mac%20mini%20M6%2016GB) | | [Intel Arc Pro B70 32GB](https://whatcanirunai.vercel.app/hardware/arc-pro-b70/)32 GB usable | $949 | Fits | Fits | Fits | Won’t fit | [Amazon](https://www.amazon.com/s?k=Intel%20Arc%20Pro%20B70%2032GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Intel%20Arc%20Pro%20B70%2032GB) | | [GeForce RTX 4080 Super](https://whatcanirunai.vercel.app/hardware/rtx-4080-super/)16 GB usable | $999 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204080%20Super&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204080%20Super) | | [GeForce RTX 5080](https://whatcanirunai.vercel.app/hardware/rtx-5080/)16 GB usable | $999 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%205080&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%205080) | | [Radeon RX 7900 XTX](https://whatcanirunai.vercel.app/hardware/rx-7900-xtx/)24 GB usable | $999 | Fits | Fits | Fits | Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%207900%20XTX&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%207900%20XTX) | | [GeForce RTX 2080 Ti](https://whatcanirunai.vercel.app/hardware/rtx-2080-ti/)11 GB usable | $999 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%202080%20Ti&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%202080%20Ti) | | [Radeon RX 6900 XT](https://whatcanirunai.vercel.app/hardware/rx-6900-xt/)16 GB usable | $999 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%206900%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%206900%20XT) | | [NVIDIA RTX A4000](https://whatcanirunai.vercel.app/hardware/rtx-a4000/)16 GB usable | $1000 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20RTX%20A4000&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20RTX%20A4000) | | [Radeon RX 6950 XT](https://whatcanirunai.vercel.app/hardware/rx-6950-xt/)16 GB usable | $1099 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=Radeon%20RX%206950%20XT&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Radeon%20RX%206950%20XT) | | [GeForce RTX 3080 Ti](https://whatcanirunai.vercel.app/hardware/rtx-3080-ti/)12 GB usable | $1199 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203080%20Ti&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203080%20Ti) | | [GeForce RTX 4080](https://whatcanirunai.vercel.app/hardware/rtx-4080/)16 GB usable | $1199 | Fits | Fits | Won’t fit | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204080&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204080) | | [NVIDIA RTX 4000 Ada 20GB](https://whatcanirunai.vercel.app/hardware/rtx-4000-ada/)20 GB usable | $1250 | Fits | Fits | Fits | Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20RTX%204000%20Ada%2020GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20RTX%204000%20Ada%2020GB) | | [Mac mini M6 24GB](https://whatcanirunai.vercel.app/hardware/mac-mini-m6-24/)18 GB usable | $1299 | Fits | Fits | Tight | Won’t fit | [Amazon](https://www.amazon.com/s?k=Mac%20mini%20M6%2024GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Mac%20mini%20M6%2024GB) | | [GeForce RTX 3090](https://whatcanirunai.vercel.app/hardware/rtx-3090/)24 GB usable | $1499 | Fits | Fits | Fits | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203090&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203090) | | [GeForce RTX 4090](https://whatcanirunai.vercel.app/hardware/rtx-4090/)24 GB usable | $1599 | Fits | Fits | Fits | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%204090&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%204090) | | [Mac mini M6 32GB](https://whatcanirunai.vercel.app/hardware/mac-mini-m6-32/)24 GB usable | $1799 | Fits | Fits | Fits | Won’t fit | [Amazon](https://www.amazon.com/s?k=Mac%20mini%20M6%2032GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Mac%20mini%20M6%2032GB) | | [GeForce RTX 3090 Ti](https://whatcanirunai.vercel.app/hardware/rtx-3090-ti/)24 GB usable | $1999 | Fits | Fits | Fits | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%203090%20Ti&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%203090%20Ti) | | [GeForce RTX 5090](https://whatcanirunai.vercel.app/hardware/rtx-5090/)32 GB usable | $1999 | Fits | Fits | Fits | Won’t fit | [Amazon](https://www.amazon.com/s?k=GeForce%20RTX%205090&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=GeForce%20RTX%205090) | | [NVIDIA RTX A5000](https://whatcanirunai.vercel.app/hardware/rtx-a5000/)24 GB usable | $2250 | Fits | Fits | Fits | Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20RTX%20A5000&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20RTX%20A5000) | | [MacBook Pro M6 32GB](https://whatcanirunai.vercel.app/hardware/macbook-pro-m6-32/)24 GB usable | $2399 | Fits | Fits | Fits | Won’t fit | [Amazon](https://www.amazon.com/s?k=MacBook%20Pro%20M6%2032GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=MacBook%20Pro%20M6%2032GB) | | [NVIDIA Titan RTX](https://whatcanirunai.vercel.app/hardware/titan-rtx/)24 GB usable | $2499 | Fits | Fits | Fits | Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20Titan%20RTX&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20Titan%20RTX) | | [Mac mini M5 Pro 64GB](https://whatcanirunai.vercel.app/hardware/mac-mini-m5-pro-64/)48 GB usable | $3199 | Fits | Fits | Fits | Won’t fit | [Amazon](https://www.amazon.com/s?k=Mac%20mini%20M5%20Pro%2064GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Mac%20mini%20M5%20Pro%2064GB) | | [Framework Desktop (Ryzen AI Max+ 395) 128GB](https://whatcanirunai.vercel.app/hardware/framework-desktop-128/)96 GB usable | $3449 | Fits | Fits | Fits | Fits | [Amazon](https://www.amazon.com/s?k=Framework%20Desktop%20%28Ryzen%20AI%20Max%2B%20395%29%20128GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Framework%20Desktop%20%28Ryzen%20AI%20Max%2B%20395%29%20128GB) | | [NVIDIA RTX A6000](https://whatcanirunai.vercel.app/hardware/rtx-a6000/)48 GB usable | $4649 | Fits | Fits | Fits | Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20RTX%20A6000&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20RTX%20A6000) | | [MacBook Pro M4 Max 128GB](https://whatcanirunai.vercel.app/hardware/macbook-pro-m4-max-128/)96 GB usable | $4999 | Fits | Fits | Fits | Fits | [Amazon](https://www.amazon.com/s?k=MacBook%20Pro%20M4%20Max%20128GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=MacBook%20Pro%20M4%20Max%20128GB) | | [NVIDIA DGX Spark 64GB](https://whatcanirunai.vercel.app/hardware/dgx-spark-64/)48 GB usable | $4999 | Fits | Fits | Fits | Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20DGX%20Spark%2064GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20DGX%20Spark%2064GB) | | [MacBook Pro M5 Max 128GB](https://whatcanirunai.vercel.app/hardware/macbook-pro-m5-max-128/)96 GB usable | $6699 | Fits | Fits | Fits | Fits | [Amazon](https://www.amazon.com/s?k=MacBook%20Pro%20M5%20Max%20128GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=MacBook%20Pro%20M5%20Max%20128GB) | | [NVIDIA RTX 6000 Ada 48GB](https://whatcanirunai.vercel.app/hardware/rtx-6000-ada/)48 GB usable | $6799 | Fits | Fits | Fits | Won’t fit | [Amazon](https://www.amazon.com/s?k=NVIDIA%20RTX%206000%20Ada%2048GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20RTX%206000%20Ada%2048GB) | | [NVIDIA DGX Spark 128GB](https://whatcanirunai.vercel.app/hardware/dgx-spark-128/)96 GB usable | $6950 | Fits | Fits | Fits | Fits | [Amazon](https://www.amazon.com/s?k=NVIDIA%20DGX%20Spark%20128GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20DGX%20Spark%20128GB) | | [NVIDIA RTX Pro 6000 Blackwell 96GB](https://whatcanirunai.vercel.app/hardware/rtx-pro-6000-blackwell/)96 GB usable | $8565 | Fits | Fits | Fits | Fits | [Amazon](https://www.amazon.com/s?k=NVIDIA%20RTX%20Pro%206000%20Blackwell%2096GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=NVIDIA%20RTX%20Pro%206000%20Blackwell%2096GB) | | [Mac Studio M5 Ultra 256GB](https://whatcanirunai.vercel.app/hardware/mac-studio-m5-ultra-256/)192 GB usable | $9499 | Fits | Fits | Fits | Fits | [Amazon](https://www.amazon.com/s?k=Mac%20Studio%20M5%20Ultra%20256GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Mac%20Studio%20M5%20Ultra%20256GB) | | [Mac Studio M5 Ultra 512GB](https://whatcanirunai.vercel.app/hardware/mac-studio-m5-ultra-512/)384 GB usable | $22299 | Fits | Fits | Fits | Fits | [Amazon](https://www.amazon.com/s?k=Mac%20Studio%20M5%20Ultra%20512GB&tag=whatcanirunai-20)[eBay](https://www.ebay.com/sch/i.html?%5Fnkw=Mac%20Studio%20M5%20Ultra%20512GB) | We may earn a commission when you buy through these links, at no extra cost to you. ## Quick answers What is the cheapest GPU for running Mistral locally? Of the devices we track, the Intel Arc B570 ($219) is the cheapest that runs Mistral-7B-Instruct-v0.3 at Q4. What hardware do I need for Mistral-Small-4-119B-2603? The cheapest fit we track is the Framework Desktop (Ryzen AI Max+ 395) 128GB at $3449\. Mistral-Small-4-119B-2603 needs about 84.2 GB at Q4. How much VRAM does Mistral need? Mistral-7B-Instruct-v0.3 needs about 6.1 GB at Q4; Mistral-Small-4-119B-2603 needs about 84.2 GB. These are estimates at Q4\_K\_M with about 4k context. ## Other guides * [Best GPU for running Llama locally](https://whatcanirunai.vercel.app/best-gpu-for/llama/)3 models * [Best GPU for running Qwen3 locally](https://whatcanirunai.vercel.app/best-gpu-for/qwen3/)4 models * [Best GPU for running gpt-oss locally](https://whatcanirunai.vercel.app/best-gpu-for/gpt-oss/)2 models * [Best GPU for running DeepSeek R1 locally](https://whatcanirunai.vercel.app/best-gpu-for/deepseek-r1/)4 models * [Best GPU for running Gemma 3 locally](https://whatcanirunai.vercel.app/best-gpu-for/gemma-3/)3 models * [Best GPU for running Gemma 4 locally](https://whatcanirunai.vercel.app/best-gpu-for/gemma-4/)5 models * [Best GPU for running Qwen3.8 locally](https://whatcanirunai.vercel.app/best-gpu-for/qwen3.8/)3 models * [Best GPU for running Ornith 1.5 locally](https://whatcanirunai.vercel.app/best-gpu-for/ornith-1.5/)3 models * [Best GPU for running Nemotron locally](https://whatcanirunai.vercel.app/best-gpu-for/nemotron/)3 models * [Best GPU for running Liquid AI LFM locally](https://whatcanirunai.vercel.app/best-gpu-for/liquid-lfm/)2 models * [Best GPU for running GLM locally](https://whatcanirunai.vercel.app/best-gpu-for/glm/)4 models * [Best GPU for running Phi locally](https://whatcanirunai.vercel.app/best-gpu-for/phi/)4 models * [Best GPU for running long-memory models locally](https://whatcanirunai.vercel.app/best-gpu-for/memory-models/)3 models * [Best GPU for running local coding models locally](https://whatcanirunai.vercel.app/best-gpu-for/coding-models/)8 models --- Agent guide: https://whatcanirunai.vercel.app/llms.txt · JSON API: https://whatcanirunai.vercel.app/developers/