Leaderboard
Socratic Score = mean of normalized benchmarks. LM Arena: (ELO - 1000) / 400 × 100. Vending-Bench: balance / $10k × 100. SWE-bench, ARC-AGI, and HLE are used as-is (0-100%).
AI Socratic Leaderboard
Scores across benchmarks
Updated Jul 20, 2026, 10:00 UTC
| # | Model | Score | LM Arena ↗ | SWE-bench ↗ | ARC-AGI-2 ↗ | HLE ↗ | Vending ↗ | Prediction ↗ | Vibe Bench |
|---|---|---|---|---|---|---|---|---|---|
| 🥇 | 85.05/6 | 1504 | 75.6% | 69.2%($3.47) | - | $8,017.59 | +10521.7% | 60% | |
| 🥈 | 69.74/6 | - | 72.8% | 22.8%($0.25) | - | $8,313.78 | +108.2% | - | |
| 🥉 | 65.13/6 | - | - | 83.3%($16.41) | - | $6,144.18 | +1.2% | 15% | |
| 4 | 60.83/6 | - | 72.8% | 72.9%($38.99) | - | - | -26.8% | 15% | |
| 5 | 59.35/6 | 1486 | 69.6% | 54.0%($30.57) | 38.3% | - | -31.0% | 18% | |
| 6 | 50.43/6 | - | 76.8% | 37.6%($2.40) | - | - | -26.6% | 60% |
Location
Vibe Bench
Community favorites · Socratic Jun · 40 responses
Latest event: Socratic Jun · Jun 23, 2026
| 24 | |
| 13 | |
| 9 | |
Open Source | 8 |
| 7 | |
Other Tools | 7 |
| 6 | |
| 3 | |
| 1 | |
| 1 | |
| 0 |
| # | Model | % Resolved |
|---|---|---|
| 🥇 | 76.8% | |
| 🥈 | 75.8% | |
| 🥉 | 75.8% | |
| 4 | 75.6% | |
| 5 | 72.8% | |
| 6 | 72.8% | |
| 7 | 72.8% | |
| 8 | 72.8% | |
| 9 | 71.4% | |
| 10 | Kimi K2.5 (high reasoning) | 70.8% |
| # | Model | Score |
|---|---|---|
| 🥇 | 92.5% | |
| 🥈 | 90.0% | |
| 🥉 | 85.4% | |
| 4 | 85.0% | |
| 5 | 84.6% | |
| 6 | 84.6% | |
| 7 | 84.2% | |
| 8 | 83.9% | |
| 9 | 83.3% | |
| 10 | 83.3% |
| # | Model | Accuracy |
|---|---|---|
| 🥇 | 38.3% | |
| 🥈 | 25.3% | |
| 🥉 | 24.5% | |
| 4 | 21.6% | |
| 5 | 19.4% | |
| 6 | 13.7% | |
| 7 | 12.1% | |
| 8 | 8.5% | |
| 9 | 8.0% | |
| 10 | 2.7% |
| # | Model | Score | Votes |
|---|---|---|---|
| 🥇 | 1507 | 0 | |
| 🥈 | 1504 | 0 | |
| 🥉 | 1503 | 0 | |
| 4 | 1498 | 0 | |
| 5 | 1494 | 0 | |
| 6 | muse-spark-1.1 | 1493 | 0 |
| 7 | muse-spark | 1487 | 0 |
| 8 | 1486 | 0 | |
| 9 | kimi-k3 | 1486 | 0 |
| 10 | 1486 | 0 |
| # | Model | Balance |
|---|---|---|
| 🥇 | $10,936.76 | |
| 🥈 | $9,619.37 | |
| 🥉 | $8,313.78 | |
| 4 | $8,017.59 | |
| 5 | $7,523.84 | |
| 6 | $7,343.21 | |
| 7 | $7,204.14 | |
| 8 | $6,377.7 | |
| 9 | Kimi K2.6 Kimi K2.6 | $6,204.57 |
| 10 | $6,144.18 |
| # | Agent | Return | Sharpe |
|---|---|---|---|
| 🥇 | 10521.7% | -0.01 | |
| 🥈 | 108.2% | 0.03 | |
| 🥉 | 74.3% | 0.03 | |
| 4 | 1.2% | 0.02 | |
| 5 | -15.4% | -0.12 | |
| 6 | Mystery Model Alpha | -20.0% | -0.05 |
| 7 | -26.6% | -0.10 | |
| 8 | -26.8% | -0.09 | |
| 9 | -30.8% | -0.07 | |
| 10 | -31.0% | -0.11 |
Stay Updated
Get the latest AI insights delivered to your inbox. No spam, unsubscribe anytime.