Best local LLMs by VRAM size

Pick how much GPU memory you have. Each page lists every model that runs fully in it at Q4. Odd size, or a Mac? Try the VRAM calculator.

Memory sizes

• Best LLMs for 4 GB VRAM148 models fit
• Best LLMs for 6 GB VRAM198 models fit
• Best LLMs for 8 GB VRAM315 models fit
• Best LLMs for 10 GB VRAM340 models fit
• Best LLMs for 12 GB VRAM350 models fit
• Best LLMs for 16 GB VRAM388 models fit
• Best LLMs for 20 GB VRAM404 models fit
• Best LLMs for 24 GB VRAM423 models fit
• Best LLMs for 32 GB VRAM504 models fit
• Best LLMs for 48 GB VRAM511 models fit
• Best LLMs for 64 GB VRAM525 models fit
• Best LLMs for 96 GB VRAM545 models fit
• Best LLMs for 128 GB VRAM554 models fit

Or start from a model family