Skip to main contentThe Local Bench

MacBook Pro M4 Max 40c · 128 GB

Apple · Apple unified · as of 2026-10-12

Specs sourced · published reference runs · catalogue speeds mostly estimated
Laptop
  • Data checked: 2026-10-12. Review interval shown below. Prices need review after 30 days; specifications and benchmark collections after 90 days. Dates describe the recorded check, not a live retailer quote.

    • Verified Checked against the primary source (for example the model’s config.json on Hugging Face).
    • Sourced Taken from a cited source; not yet independently checked.
    • Estimate Calculated with the published formulas; not a measurement.
    • Sample Placeholder data for layout; not a real figure.
    • Not yet measured No public, citable score found for this benchmark yet. We never fill the gap with a guess.

    Verified metadata is not a measured performance result. Only cited runs matching model, device, quant and recorded context can replace speed estimates. Estimates assume one stream and F16 KV cache, with a ±25% uncertainty band. A published run applies only to its recorded runtime and conditions; missing settings are unknown.

    • llama-2-7b · macbook-pro-m4-max-128g
      llamafile (Metal) · Q4_0 · LocalScore generation
      Recorded 2026-10-12 · historical source record · repeat count unknownSourced
      Third-party measurement used to calibrate η (brief §4.3): implies η ≈ 0.43. Run source
    • llama-2-7b · macbook-pro-m4-max-128g
      llama.cpp (Metal) · Q4_0 · tg128
      Recorded 2026-10-12 · historical source record · repeat count unknownSourced
      Llama 2 7B Q4_0, llama-bench tg128, M4 Max 40-core GPU (546 GB/s), pinned commit 8e672ef (Nov 2023) for comparability; newer builds are faster. Run source

    Evidence labels · Freshness policy · Calculation methodology

128GB
memory, 96.0 GB usableSourced
546GB/s
memory bandwidthSourced
$4,699
price, USDSample
10of 10
catalogue models fit at 8k

A laptop with twice Strix Halo's bandwidth. MLX and Metal llama.cpp are both mature.

Decode-speed ceiling for a model is 546 GB/s ÷ GB read per token. For a 16.6 GB file that is 33 tok/s; real runtimes reach roughly 45% of it. Why bandwidth is the limit.

See every model on this device

Specifications

Memory
128 GBSourcedConfigurable to 128 GB on the 16-core-CPU/40-core-GPU M4 Max, Apple tech specs, checked 2026-10-12. Source
Bandwidth
546 GB/sSourcedVendor spec page, checked 2026-10-12. Source
FP16 dense compute
34 TFLOPSSampleSample FP16 dense compute; pending vendor-sheet citation.
Load power at wall
140 WSampleSample wall power under load.
Price, USD
$4,699SampleSample price.
Price, CAD
CA$6,706SampleUSD price × 1.4271 (Bank of Canada USD/CAD, 2026-10-09); no Canadian retail listing captured. Converted from a sample USD value. Source

Models that run

Default quant, single stream, 8k context. Fastest first; estimates are ±25% until measured.

Model
Quant
Memory
Verdict
Decode, tok/s
Max context
gpt-oss-20bMXFP412.9 GBFits107.3Estimate128k
Qwen3 30B-A3BQ4_K_M19.9 GBFits87.4Estimate32k
gpt-oss-120bMXFP464.3 GBFits79.9Estimate128k
Llama 3.1 8B InstructQ4_K_M6.6 GBFits41.0Estimate128k
Qwen3 8BQ4_K_M6.8 GBFits39.4Estimate32k
Qwen3 14BQ4_K_M10.9 GBFits23.8Estimate32k
Mistral Small 3.2 24BQ4_K_M16.2 GBFits15.7Estimate128k
Gemma 3 27B ITQ4_K_M18.2 GBFits13.9Estimate128k
Qwen3 32BQ4_K_M22.5 GBFits11.2Estimate32k
Llama 3.3 70B InstructQ4_K_M45.8 GBFits5.4Estimate128k

Published reference runs

Third-party llama.cpp measurements on this device, with conditions and source. Llama 2 7B Q4_0 runs are the community calibration test; they are not catalogue models.

Model
Quant
Date
Runtime · test
Decode, tok/s
Conditions
llama-2-7bQ4_02026-10-12llamafile (Metal) · LocalScore generation62.5SourcedThird-party measurement used to calibrate η (brief §4.3): implies η ≈ 0.43. Source
llama-2-7bQ4_02026-10-12llama.cpp (Metal) · tg12883.1SourcedLlama 2 7B Q4_0, llama-bench tg128, M4 Max 40-core GPU (546 GB/s), pinned commit 8e672ef (Nov 2023) for comparability; newer builds are faster. Source

Usable memory: discrete VRAM − 0.5 GB reserve; unified RAM × 0.75; fits when total ≤ 90% of usable (concept brief §7.3). Markdown · JSON