Category ranking · 4 models · checked 2026-10-13
Robotics (VLA)
Ranked by LIBERO, average success rate (4 suites). Source: SmolVLA paper, Table 2 (arXiv:2506.01844).
LIBERO, average success rate (4 suites)
3 with a published score, 1 not yet measured.
# | Model | Parameters | Score | Source | Licence |
|---|---|---|---|---|---|
| 1 | SmolVLA Hugging Face LeRobot | 450 M | 87.3%Sourced | Source SmolVLA (0.45B) row. | Apache-2.0 |
| 2 | π0 (LeRobot port) Physical Intelligence | 3.5 B | 86%Sourced | Source π0 (3.3B), VLA-pretrained row. | Apache-2.0 |
| 3 | OpenVLA 7B Stanford / OpenVLA | 7.5 B | 76.5%Sourced | Source OpenVLA (7B) row. | MIT |
| — | GR00T N1.5 3B NVIDIA | 2.7 B | Not yet measured | — | NVIDIA One-Way Non-Commercial Check terms before commercial use |
How to read this: one public benchmark per category, so you can compare like with like. We copy the published number and link it; we do not re-run it, average different benchmarks or fill gaps. Vendor-reported numbers use each vendor's own settings, so treat small gaps as ties. “Not yet measured” means we found no comparable public score, not that the model is weak.
Every model was checked against the Hugging Face API on 2026-10-13: it exists, is public, and has the parameter count and licence shown. Other categories: Math and reasoning · Coding · Vision-language · OCR and documents · Speech to text · Text to speech · Image generation · Embeddings and rerankers · Small fast 'System 1' · Biomedical · Tool use and agents · Multilingual and translation · Time series.
Machine-readable: /api/v1/categories/robotics-vla.json