Cost engine
Buy a rig, or rent the cloud?
A local machine costs money up front but is cheap to run; the cloud costs nothing up front but adds up. Pick what you want to run and how much you'll use it — we'll show when buying pays for itself.
Buy it
$289 once
+ ~$5/mo electricity (250 W · 4 h/day)
Rent the cloud
~$60/mo
at ~$0.5/hr for a GPU that runs Llama 3.1 8B
Buying the NVIDIA RTX 3060 (12GB) pays for itself in about 5 months vs renting, at 4 h/day — then it's ~$55/mo cheaper.
Total cost over time
| After | Buy | Rent | Cheaper |
|---|---|---|---|
| 12 mo | $350 | $720 | Buy |
| 24 mo | $411 | $1,440 | Buy |
| 36 mo | $473 | $2,160 | Buy |
Estimates. Power draw, electricity rates, and cloud prices vary; cloud rates are a representative on-demand figure for the model's size class. Excludes the cost of the rest of a PC for GPU rigs.
Not sure which machine? See what to buy →