can-i-run-this-llm

Build advisor

What should I buy?

Work backwards from the model you want to run. Pick a model, a quantization, and a target speed — we'll rank the cheapest hardware that actually clears it, or point you to the cloud when nothing consumer-grade can.

Cheaper to rent than buy? Compare the costs.Buy vs rent →

Cheapest hardware that runs it — 16 options

  • #1NVIDIA RTX 3060 (12GB)GPU · needs a host PC~$28954 tok/sRuns greatBuy →
  • #2NVIDIA RTX 4060 Ti (16GB)GPU · needs a host PC~$44944 tok/sRuns greatBuy →
  • #3NVIDIA RTX 4070 (12GB)GPU · needs a host PC~$54972 tok/sRuns greatBuy →
  • #4NVIDIA RTX 3090 (24GB)GPU · needs a host PC~$800119 tok/sRuns greatBuy →
  • #5AMD RX 7900 XTX (24GB)GPU · needs a host PC~$899121 tok/sRuns greatBuy →
  • #6NVIDIA RTX 4080 (16GB)GPU · needs a host PC~$99997 tok/sRuns greatBuy →
  • #7NVIDIA RTX 4090 (24GB)GPU · needs a host PC~$1,599125 tok/sRuns greatBuy →
  • #8MacBook Pro M4 Pro (24GB)~$1,99936 tok/sRuns greatBuy →
  • #9MacBook Pro M4 Pro (48GB)~$2,39936 tok/sRuns greatBuy →
  • #10NVIDIA RTX 5090 (32GB)GPU · needs a host PC~$2,499184 tok/sRuns greatBuy →
  • #11MacBook Pro M4 Max (48GB)~$3,19961 tok/sRuns greatBuy →
  • #12Mac Studio M2 Ultra (64GB)~$3,99979 tok/sRuns greatBuy →
  • #13MacBook Pro M4 Max (128GB)~$4,69961 tok/sRuns greatBuy →
  • #14Mac Studio M2 Ultra (192GB)~$5,59979 tok/sRuns greatBuy →
  • #15NVIDIA RTX 6000 Ada (48GB)GPU · needs a host PC~$6,800121 tok/sRuns greatBuy →
  • #16NVIDIA RTX Pro 6000 Blackwell (96GB)GPU · needs a host PC~$8,500184 tok/sRuns greatBuy →

Prices are approximate new street prices (USD, mid-2026); GPU prices exclude the rest of the PC. Buy links are affiliate links — we may earn a commission at no cost to you.