Robotics
Task 39 / 47
QuadrupedGait
Optimize roughly eight gait parameters for a quadruped in simulation to maximize stable forward speed. Periodic locomotion with contact dynamics and fall constraints is scored by average speed or stability proxies—legged-robot locomotion parameter tuning.
Model leaderboard
Updated v1 results · 2026-09-15 · raw score, higher is better.
| # | Participant | Raw score | Medal |
|---|---|---|---|
| 1 | GLM-5 | 0.1085 | Gold |
| 2 | DeepSeek V3.2 | 0.0749 | Silver |
| 3 | Qwen3 Coder Next | 0.0232 | Bronze |
| 4 | Grok 4.20 | 0.0227 | — |
| 5 | GPT-5.4 | 0.022154337 | — |
| 6 | Claude Opus 4.6 | 0.0219 | — |
| 7 | Gemini 3.1 Pro Preview | 0.0218 | — |
| 7 | Seed 2.0 Pro | 0.0218 | — |
Framework results · original paper
Historical results from the original evaluators · normalized score (0–100).
| # | Participant | Score |
|---|---|---|
| 1 | Claude Opus 4.6 + ShinkaiEvolve | 100.0 |
| 2 | GPT-OSS + OpenEvolve | 42.0 |
| 3 | GPT-OSS + ShinkaiEvolve | 26.1 |
| 4 | GPT-OSS + ABMCTS | 4.4 |
| 5 | Claude Opus 4.6 + OpenEvolve | 0.0 |
| 6 | Claude Opus 4.6 + ABMCTS | 0.0 |
Model results use the updated scores and medal thresholds. No valid score earns zero medal credit. Historical framework scores use the original evaluators and have not been updated alongside the model results.