Skip to main contentThe Local Bench

14 datasheets · prices in USD

Hardware datasheets

Capacity decides what fits; bandwidth decides how fast it runs. Every device with its memory, bandwidth, power and price, and the largest model it holds.

  • Discrete graphics card
  • Mac Studio
  • Mini PC
  • NVIDIA DGX Spark
  • Laptop
  • Home server
  • Multi-GPU tower

All hardware

Cheapest first. Bandwidth per GB of memory is a quick read on how a device balances size against speed.

Device
Memory
Bandwidth
Load power
Price
Largest model, 8k
GeForce RTX 5060 Ti 16 GB
NVIDIA · Discrete GPU
16 GBSourced448 GB/sSourced250 WSample$779.99Sourcedgpt-oss-20b
GeForce RTX 4060 Ti 16 GB
NVIDIA · Discrete GPU
16 GBSourced288 GB/sSourced230 WSample$844.37Estimategpt-oss-20b
Radeon RX 7900 XTX 24 GB
AMD · Discrete GPU
24 GBSourced960 GB/sSourced400 WSample$899SampleQwen3 32B
GeForce RTX 3090 24 GB (used)
NVIDIA · Discrete GPU
24 GBSourced936 GB/sSourced420 WSample$1,200SourcedQwen3 32B
128 GBSourced90 GB/sSourced200 WSample$1,400Samplegpt-oss-120b
2× RTX 3090 (used) 48 GB
NVIDIA · Multi-GPU
48 GBSourced936 GB/sSourced780 WSample$2,400EstimateLlama 3.3 70B Instruct
Mac Studio M5 Max (base)
Apple · Apple unified
36 GBSourced460 GB/sSourced150 WSample$2,499SourcedQwen3 32B
128 GBSourced256 GB/sSourced120 WSourced$3,499.99Sourcedgpt-oss-120b
GeForce RTX 4090 24 GB
NVIDIA · Discrete GPU
24 GBSourced1,008 GB/sSourced500 WSample$4,395SourcedQwen3 32B
NVIDIA DGX Spark FE 128 GB
NVIDIA · Unified memory
128 GBSourced273 GB/sSourced170 WSample$4,699Sourcedgpt-oss-120b
MacBook Pro M4 Max 40c · 128 GB
Apple · Apple unified
128 GBSourced546 GB/sSourced140 WSample$4,699Samplegpt-oss-120b
Mac Studio M5 Ultra (base)
Apple · Apple unified
96 GBSourced1,200 GB/sSourced240 WSample$5,499Sourcedgpt-oss-120b
GeForce RTX 5090 32 GB
NVIDIA · Discrete GPU
32 GBSourced1,792 GB/sSourced650 WSample$7,199.99SourcedQwen3 32B
Mac Studio M5 Ultra · 512 GB
Apple · Apple unified
512 GBSourced1,200 GB/sSourced260 WSample$9,999Samplegpt-oss-120b

Also as JSON and CSV.