Skip to main contentThe Local Bench

10 general datasheets · 102 special-purpose models · rev. 2026.10

Model datasheets

Every open-weight model we track, with its architecture checked against the model's own config.json and its GGUF file sizes read from the Hugging Face API.

Catalogue coverage is limited to the models listed below. Gemma 3 4B and 12B from the setup guide, and the Gemma 4 and Qwen 3.8 families discussed in the cover story, are not supported by our fit calculator yet. Editorial coverage does not supply verified model sizes or fit data. Try the tested CPU setup.

All models

Smallest first. The 24 GB column is a used RTX 3090 at the default quant and 8k context. Speeds: sample or estimate

Model
Parameters
Context
Default quant
File
24 GB card, 8k
Decode, tok/s
Licence
Llama 3.1 8B Instruct
Meta
8.0 B128kQ4_K_M4.9 GBVerifiedFits93.7EstimateLlama 3.1 Community License
Qwen3 8B
Alibaba Qwen
8.2 B32kQ4_K_M5.0 GBVerifiedFits90.0EstimateApache-2.0
Qwen3 14B
Alibaba Qwen
14.8 B32kQ4_K_M9.0 GBVerifiedFits54.3EstimateApache-2.0
gpt-oss-20b
OpenAI
20.9 B
3.6 B active
128kMXFP412.1 GBVerifiedFits245.3EstimateApache-2.0
Mistral Small 3.2 24B
Mistral AI
24.0 B128kQ4_K_M14.3 GBVerifiedFits35.8EstimateApache-2.0
Gemma 3 27B IT
Google DeepMind
27.4 B128kQ4_K_M16.6 GBVerifiedFits31.8EstimateGemma Terms of Use
Qwen3 30B-A3B
Alibaba Qwen
30.5 B
3.3 B active
32kQ4_K_M18.6 GBVerifiedFits199.8EstimateApache-2.0
Qwen3 32B
Alibaba Qwen
32.8 B32kQ4_K_M19.8 GBVerifiedTight25.6EstimateApache-2.0
Llama 3.3 70B Instruct
Meta
70.6 B128kQ4_K_M42.5 GBVerifiedNeeds offload1.4EstimateLlama 3.3 Community License
gpt-oss-120b
OpenAI
116.8 B
5.1 B active
128kMXFP463.4 GBVerifiedNeeds offload17.3EstimateApache-2.0

Also available as JSON, CSV and Markdown.

Special-purpose models

102 open-weight models for one job each: maths, code, vision, documents, speech, images, search, small fast decisions, medicine, tools, languages, forecasting and robots. Each one was checked against the Hugging Face API on 2026-10-13 (parameters and licence). Scores come from one public benchmark per category, cited per row; where nobody has published a comparable number we say “not yet measured” instead of guessing.

102 models

Model
Category
Parameters
Licence
Headline score
DeepSeek R1-0528 Qwen3 8B
DeepSeek
Math and reasoning8.2 BMIT86%
AIME 2024, pass@1
OpenReasoning Nemotron 32B
NVIDIA
Math and reasoning32.8 BCC-BY-4.089.2%
AIME 2024, pass@1
QwQ 32B
Alibaba Qwen
Math and reasoning32.8 BApache-2.079.5%
AIME 2024, pass@1
Phi-4 reasoning
Microsoft
Math and reasoning14.7 BMIT75.3%
AIME 2024, pass@1
OpenMath Nemotron 7B
NVIDIA
Math and reasoning7.6 BCC-BY-4.074.8%
AIME 2024, pass@1
Phi-4 mini reasoning
Microsoft
Math and reasoning3.8 BMIT57.5%
AIME 2024, pass@1
DeepSeek R1 Distill Qwen 7B
DeepSeek
Math and reasoning7.6 BMIT55.5%
AIME 2024, pass@1
Devstral Small 1.1
Mistral AI
Coding23.6 BApache-2.053.6%
SWE-bench Verified, % resolved
OpenHands LM 32B
All Hands AI
Coding32.8 BMIT37.2%
SWE-bench Verified, % resolved
Qwen3 Coder 30B-A3B
Alibaba Qwen
Coding30.5 BApache-2.0Not yet measured
Qwen2.5 Coder 32B
Alibaba Qwen
Coding32.8 BApache-2.0Not yet measured
Qwen2.5 Coder 7B
Alibaba Qwen
Coding7.6 BApache-2.0Not yet measured
DeepSeek Coder V2 Lite
DeepSeek
Coding15.7 BDeepSeek LicenseNot yet measured
Qwen2.5 VL 7B
Alibaba Qwen
Vision-language8.3 BApache-2.058.6%
MMMU (val)
Kimi-VL A3B
Moonshot AI
Vision-language16.4 BMIT57%
MMMU (val)
SmolVLM2 2.2B
Hugging Face
Vision-language2.2 BApache-2.042%
MMMU (val)
Qwen3 VL 8B
Alibaba Qwen
Vision-language8.8 BApache-2.0Not yet measured
Qwen3 VL 30B-A3B
Alibaba Qwen
Vision-language31.1 BApache-2.0Not yet measured
InternVL3 8B
Shanghai AI Lab
Vision-language7.9 BApache-2.0Not yet measured
Gemma 3 12B
Google
Vision-language12.2 BGemma Terms of UseNot yet measured
olmOCR 2 7B
Ai2
OCR and documents8.3 BApache-2.082.4%
olmOCR-Bench, overall
PaddleOCR-VL
Baidu PaddlePaddle
OCR and documents959 MApache-2.080%
olmOCR-Bench, overall
DeepSeek-OCR
DeepSeek
OCR and documents3.3 BMIT75.7%
olmOCR-Bench, overall
Nanonets OCR2 3B
Nanonets
OCR and documents3.8 BNot declared on Hugging Face
Check terms before commercial use
69.5%
olmOCR-Bench, overall
dots.ocr
rednote hilab
OCR and documents3.0 BMITNot yet measured
Granite Docling 258M
IBM
OCR and documents258 MApache-2.0Not yet measured
SmolDocling 256M
IBM Research / Hugging Face
OCR and documents256 MCDLA-Permissive-2.0Not yet measured
Canary-Qwen 2.5B
NVIDIA
Speech to text2.6 BCC-BY-4.06.37%
Open ASR Leaderboard, average WER (English short-form)
Parakeet TDT 0.6B v2
NVIDIA
Speech to text—CC-BY-4.06.43%
Open ASR Leaderboard, average WER (English short-form)
Parakeet TDT 0.6B v3
NVIDIA
Speech to text627 MCC-BY-4.06.51%
Open ASR Leaderboard, average WER (English short-form)
Distil-Whisper large-v3.5
Hugging Face
Speech to text756 MMIT7.02%
Open ASR Leaderboard, average WER (English short-form)
Voxtral Mini 3B
Mistral AI
Speech to text4.7 BApache-2.07.84%
Open ASR Leaderboard, average WER (English short-form)
Whisper large-v3
OpenAI
Speech to text1.5 BApache-2.07.84%
Open ASR Leaderboard, average WER (English short-form)
Whisper large-v3 turbo
OpenAI
Speech to text809 MMIT8.39%
Open ASR Leaderboard, average WER (English short-form)
Canary 1B Flash
NVIDIA
Speech to text811 MCC-BY-4.0Not yet measured
Kokoro 82M
hexgrad
Text to speech—Apache-2.0Not yet measured
Chatterbox
Resemble AI
Text to speech—MITNot yet measured
CSM 1B
Sesame
Text to speech1.6 BApache-2.0Not yet measured
Dia 1.6B
Nari Labs
Text to speech1.6 BApache-2.0Not yet measured
Orpheus 3B
Canopy Labs
Text to speech3.8 BApache-2.0Not yet measured
VibeVoice 1.5B
Microsoft
Text to speech2.7 BMITNot yet measured
OpenAudio S1 mini
Fish Audio
Text to speech—CC-BY-NC-SA-4.0
Check terms before commercial use
Not yet measured
HiDream-I1 Full
HiDream.ai
Image generation17.1 BMIT0.83
GenEval, overall
FLUX.1 [dev]
Black Forest Labs
Image generation11.9 BFLUX.1 [dev] Non-Commercial
Check terms before commercial use
0.66
GenEval, overall
Stable Diffusion XL
Stability AI
Image generation2.6 BCreativeML OpenRAIL++-M0.55
GenEval, overall
FLUX.1 [schnell]
Black Forest Labs
Image generation11.9 BApache-2.0Not yet measured
FLUX.1 Kontext [dev]
Black Forest Labs
Image generation11.9 BFLUX.1 [dev] Non-Commercial
Check terms before commercial use
Not yet measured
Qwen-Image
Alibaba Qwen
Image generation20.4 BApache-2.0Not yet measured
Stable Diffusion 3.5 Medium
Stability AI
Image generation2.5 BStability AI CommunityNot yet measured
Qwen3 Embedding 8B
Alibaba Qwen
Embeddings and rerankers7.6 BApache-2.070.58
MMTEB (multilingual) mean task score; rerankers: MTEB-R
Qwen3 Embedding 0.6B
Alibaba Qwen
Embeddings and rerankers596 MApache-2.064.33
MMTEB (multilingual) mean task score; rerankers: MTEB-R
multilingual-e5-large-instruct
Microsoft (intfloat)
Embeddings and rerankers560 MMIT63.22
MMTEB (multilingual) mean task score; rerankers: MTEB-R
BGE-M3
BAAI
Embeddings and rerankers—MIT59.56
MMTEB (multilingual) mean task score; rerankers: MTEB-R
EmbeddingGemma 300M
Google
Embeddings and rerankers303 MGemma Terms of UseNot yet measured
Nomic Embed Text v1.5
Nomic AI
Embeddings and rerankers137 MApache-2.0Not yet measured
jina-embeddings-v3
Jina AI
Embeddings and rerankers572 MCC-BY-NC-4.0
Check terms before commercial use
Not yet measured
Qwen3 Reranker 0.6B
Alibaba Qwen
Embeddings and rerankers596 MApache-2.065.8
MMTEB (multilingual) mean task score; rerankers: MTEB-R
BGE Reranker v2 M3
BAAI
Embeddings and rerankers568 MApache-2.057.03
MMTEB (multilingual) mean task score; rerankers: MTEB-R
mxbai-rerank-large v2
Mixedbread
Embeddings and rerankers1.5 BApache-2.0Not yet measured
Qwen3 0.6B
Alibaba Qwen
Small fast 'System 1'752 MApache-2.023.93%
BFCL V4, overall accuracy
Llama 3.2 1B
Meta
Small fast 'System 1'1.2 BLlama 3.2 Community10.82%
BFCL V4, overall accuracy
Gemma 3 1B
Google
Small fast 'System 1'1.0 BGemma Terms of Use7.17%
BFCL V4, overall accuracy
Gemma 3 270M
Google
Small fast 'System 1'268 MGemma Terms of UseNot yet measured
Qwen3 1.7B
Alibaba Qwen
Small fast 'System 1'2.0 BApache-2.0Not yet measured
SmolLM3 3B
Hugging Face
Small fast 'System 1'3.1 BApache-2.0Not yet measured
LFM2 1.2B
Liquid AI
Small fast 'System 1'1.2 BLFM Open License v1.0Not yet measured
Phi-4 mini
Microsoft
Small fast 'System 1'3.8 BMITNot yet measured
Granite 4.0 H Micro
IBM
Small fast 'System 1'3.2 BApache-2.0Not yet measured
MedGemma 27B
Google
Biomedical28.8 BHealth AI Developer Foundations terms85.3%
MedQA (4-option), accuracy
MedGemma 1.5 4B
Google
Biomedical4.3 BHealth AI Developer Foundations terms69.1%
MedQA (4-option), accuracy
MedGemma 4B
Google
Biomedical4.3 BHealth AI Developer Foundations terms64.4%
MedQA (4-option), accuracy
MedGemma 27B text
Google
Biomedical27.0 BHealth AI Developer Foundations termsNot yet measured
TxGemma 9B chat
Google
Biomedical9.2 BHealth AI Developer Foundations termsNot yet measured
II-Medical 8B
Intelligent Internet
Biomedical8.2 BApache-2.0Not yet measured
Med42 8B
M42
Biomedical8.0 BLlama 3 CommunityNot yet measured
OpenBioLLM 8B
Saama AI (aaditya)
Biomedical—Llama 3 CommunityNot yet measured
xLAM-2 8B
Salesforce
Tool use and agents8.0 BCC-BY-NC-4.0
Check terms before commercial use
46.68%
BFCL V4, overall accuracy
ToolACE-2 8B
Team ACE
Tool use and agents8.0 BApache-2.042.44%
BFCL V4, overall accuracy
Qwen3 4B Instruct 2507
Alibaba Qwen
Tool use and agents4.0 BApache-2.035.68%
BFCL V4, overall accuracy
GLM-4.5 Air
Z.ai
Tool use and agents110.5 BMITNot yet measured
watt-tool 8B
Watt AI
Tool use and agents8.0 BApache-2.0Not yet measured
Hermes 3 8B
Nous Research
Tool use and agents8.0 BLlama 3 CommunityNot yet measured
Arch-Function 3B
Katanemo
Tool use and agents3.1 BKatanemo Research
Check terms before commercial use
Not yet measured
Gemma 3 4B
Google
Multilingual and translation4.3 BGemma Terms of Use1,273.2
LMArena text, non-English category (Elo-style)
Aya Expanse 32B
Cohere Labs
Multilingual and translation32.3 BCC-BY-NC-4.0
Check terms before commercial use
1,213.4
LMArena text, non-English category (Elo-style)
Aya Expanse 8B
Cohere Labs
Multilingual and translation8.0 BCC-BY-NC-4.0
Check terms before commercial use
1,180
LMArena text, non-English category (Elo-style)
Hunyuan-MT 7B
Tencent
Multilingual and translation8.0 BNot declared in HF metadata (see repo)
Check terms before commercial use
Not yet measured
Seed-X PPO 7B
ByteDance Seed
Multilingual and translation7.5 BOpenMDWNot yet measured
EuroLLM 9B
UTTER project
Multilingual and translation9.2 BApache-2.0Not yet measured
Tower+ 9B
Unbabel
Multilingual and translation9.2 BCC-BY-NC-SA-4.0
Check terms before commercial use
Not yet measured
NLLB-200 600M
Meta
Multilingual and translation—CC-BY-NC-4.0
Check terms before commercial use
Not yet measured
Chronos-2
Amazon
Time series119 MApache-2.00.698
GIFT-Eval MASE, geometric mean relative to seasonal naive (lower is better)
TimesFM 2.5
Google
Time series231 MApache-2.00.705
GIFT-Eval MASE, geometric mean relative to seasonal naive (lower is better)
Moirai 2.0 small
Salesforce
Time series11 MCC-BY-NC-4.0
Check terms before commercial use
0.728
GIFT-Eval MASE, geometric mean relative to seasonal naive (lower is better)
TimesFM 2.0 500M
Google
Time series499 MApache-2.00.758
GIFT-Eval MASE, geometric mean relative to seasonal naive (lower is better)
Chronos-Bolt base
Amazon
Time series205 MApache-2.00.808
GIFT-Eval MASE, geometric mean relative to seasonal naive (lower is better)
Chronos-Bolt small
Amazon
Time series48 MApache-2.00.822
GIFT-Eval MASE, geometric mean relative to seasonal naive (lower is better)
Granite TTM r2
IBM
Time series1 MApache-2.01.02
GIFT-Eval MASE, geometric mean relative to seasonal naive (lower is better)
SmolVLA
Hugging Face LeRobot
Robotics (VLA)450 MApache-2.087.3%
LIBERO, average success rate (4 suites)
π0 (LeRobot port)
Physical Intelligence
Robotics (VLA)3.5 BApache-2.086%
LIBERO, average success rate (4 suites)
OpenVLA 7B
Stanford / OpenVLA
Robotics (VLA)7.5 BMIT76.5%
LIBERO, average success rate (4 suites)
GR00T N1.5 3B
NVIDIA
Robotics (VLA)2.7 BNVIDIA One-Way Non-Commercial
Check terms before commercial use
Not yet measured

As JSON: /api/v1/specialists.json.