Humanity's Last Exam measures frontier reasoning on expert-crafted, very high-difficulty questions. It is intended to separate top systems when easier benchmarks saturate.
Difficulty is intentionally high so scores stay far from saturation and preserve separation among frontier models; benchmark revisions aim to keep the test challenging as capabilities improve.
Revisions and rolling variants reduce strict comparability across releases; some label disputes mean small point differences should be interpreted cautiously.
Higher is better. Even top models score in single digits or low teens. Progress here signals genuine capability jumps.
Max score: 100
Based on ~500 samples, ~800 input tokens and ~500 output tokens per sample (1,300 total per sample).
Estimates from HLE paper. Actual costs vary with reasoning effort and multi-turn prompting.
Revisions and rolling variants reduce strict comparability across releases.
| # | Model | Score | Est. Eval Cost | Score/$ |
|---|---|---|---|---|
| 1 | 61.4 | $6.60 | 9.30 | |
| 2 | 59.1 | $16.50 | 3.58 | |
| 3 | 58.7 | $16.50 | 3.56 | |
| 4 | 57.5 | $6.60 | 8.71 | |
| 5 | 57.1 | $6.60 | 8.65 | |
| 6 | 56.8 | — | — | |
| 7 | 55.9 | $16.50 | 3.39 | |
| 8 | 55.6 | $6.60 | 8.42 | |
| 9 | 55.5 | $16.50 | 3.36 | |
| 10 | 55.0 | $3.30 | 16.7 | |
| 11 | 54.9 | $8.25 | 6.65 | |
| 12 | 54.7 | $16.50 | 3.32 | |
| 13 | 54.7 | $6.60 | 8.29 | |
| 14 | 54.6 | $16.50 | 3.31 | |
| 15 | 54.4 | $8.25 | 6.59 | |
| 16 | 53.8 | $16.50 | 3.26 | |
| 17 | 53.6 | $0.0000 | — | |
| 18 | 53.1 | $16.50 | 3.22 | |
| 19 | 52.9 | $3.30 | 16.0 | |
| 20 | 52.8 | $8.25 | 6.40 | |
| 21 | 52.7 | $16.50 | 3.19 | |
| 22 | 52.6 | $3.30 | 15.9 | |
| 23 | 52.5 | $3.30 | 15.9 | |
| 24 | 51.4 | $3.30 | 15.6 | |
| 25 | 51.3 | $8.25 | 6.22 | |
| 26 | 50.1 | $6.60 | 7.59 | |
| 27 | 50.0 | $3.30 | 15.2 | |
| 28 | 49.9 | $3.30 | 15.1 | |
| 29 | 49.5 | $6.60 | 7.50 | |
| 30 | 49.4 | $0.39 | 126 | |
| 31 | 49.2 | $16.50 | 2.98 | |
| 32 | 49.1 | $1.56 | 31.4 | |
| 33 | 48.9 | $16.50 | 2.96 | |
| 34 | 48.7 | $1.56 | 31.2 | |
| 35 | 48.7 | $8.25 | 5.90 | |
| 36 | 48.3 | $6.60 | 7.32 | |
| 37 | 48.0 | $0.21 | 229 | |
| 38 | 47.9 | $1.24 | 38.7 | |
| 39 | 47.9 | $3.30 | 14.5 | |
| 40 | 47.8 | $1.24 | 38.6 | |
| 41 | 47.5 | $1.56 | 30.4 | |
| 42 | 47.4 | $3.30 | 14.4 | |
| 43 | 47.3 | $6.60 | 7.17 | |
| 44 | 47.0 | $3.80 | 12.4 | |
| 45 | 46.9 | $8.25 | 5.68 | |
| 46 | 46.9 | $4.95 | 9.47 | |
| 47 | 46.5 | $1.08 | 43.3 | |
| 48 | 46.3 | $3.30 | 14.0 | |
| 49 | 46.2 | $1.65 | 28.0 | |
| 50 | 46.2 | $1.56 | 29.6 |