Skip to main contentThe Local Bench

Rev. 2026.10

Rankings

Pick your memory class. Speed and quality sit side by side and are never folded into one magic score, so you can see the trade-off yourself.

Estimates included · filter for measured runs

4 matching models. Includes formula estimates. This ordering is not a measured leaderboard.

16 GB class, on GeForce RTX 5060 Ti 16 GB

Default quant, 8k context, single stream. Fastest first.

#
Model
Quant
Memory
Verdict
Decode, tok/s
Quality score
1gpt-oss-20bMXFP412.9 GBFits117.4Estimate1,287Sourced
2Llama 3.1 8B InstructQ4_K_M6.6 GBFits44.8Estimate1,187Sourced
3Qwen3 8BQ4_K_M6.8 GBFits43.1EstimateNot yet measured
4Qwen3 14BQ4_K_M10.9 GBFits26.0EstimateNot yet measured
  • Data checked: 2026-10-12. Review interval shown below. Prices need review after 30 days; specifications and benchmark collections after 90 days. Dates describe the recorded check, not a live retailer quote.

    • Verified Checked against the primary source (for example the model’s config.json on Hugging Face).
    • Sourced Taken from a cited source; not yet independently checked.
    • Estimate Calculated with the published formulas; not a measurement.
    • Sample Placeholder data for layout; not a real figure.
    • Not yet measured No public, citable score found for this benchmark yet. We never fill the gap with a guess.

    Verified metadata is not a measured performance result. Only cited runs matching model, device, quant and recorded context can replace speed estimates. Estimates assume one stream and F16 KV cache, with a ±25% uncertainty band. A published run applies only to its recorded runtime and conditions; missing settings are unknown.

    Evidence labels · Freshness policy · Calculation methodology

Category rankings

One cited public benchmark per category; models without a comparable score are listed as not yet measured.

Each class uses one reference device. Cited benchmark runs only replace estimates when model, device, quant and recorded 8k context match. Sample speed figures are excluded. Unavailable quality scores are not filled with placeholders. Speed and quality are independent; vendor and community results may use different runtime settings. Special-purpose models have separate rankings by a cited public benchmark: start at Models.

Machine-readable: /api/v1/rankings/24gb.json and the other classes.