Problems from the American Invitational Mathematics Examination, a prestigious math competition for high school students with exceptionally difficult problems.
AIME problems reward creative problem decomposition instead of rote formula application; integer-answer format reduces partial-credit ambiguity in scoring.
Older exam years are likely represented in training corpora, which can inflate results for newer models; competition format emphasizes puzzle-solving and does not fully represent practical quantitative workflows.
Higher is better. Score out of ~30 (varies by year). Top models solve 20-25+ problems.
Max score: 30
Based on ~30 samples, ~200 input tokens and ~1,500 output tokens per sample (1,700 total per sample).
Estimates from AIME competition. Actual costs vary with reasoning effort and multi-turn prompting.
Older exam years are likely represented in training corpora, which can inflate results for newer models.
| # | Model | Score | Est. Eval Cost | Score/$ |
|---|---|---|---|---|
| 1 | 100.0 | $0.06 | 1.7k | |
| 2 | 100.0 | $0.02 | 5.2k | |
| 3 | 95.7 | $0.46 | 209 | |
| 4 | 94.3 | $0.69 | 136 | |
| 5 | 94.0 | $0.10 | 896 | |
| 6 | 94.0 | $0.20 | 459 | |
| 7 | 93.3 | $0.02 | 3.8k | |
| 8 | 91.7 | $0.46 | 200 | |
| 9 | 90.7 | $0.0000 | — | |
| 10 | 90.3 | $0.37 | 243 | |
| 11 | 89.3 | $0.13 | 662 | |
| 12 | 88.7 | $0.46 | 194 | |
| 13 | 87.3 | $0.0000 | — | |
| 14 | 87.3 | $0.07 | 1.2k | |
| 15 | 87.0 | $0.0000 | — | |
| 16 | 86.0 | $0.20 | 420 | |
| 17 | 86.0 | $0.0000 | — | |
| 18 | 84.7 | $0.10 | 828 | |
| 19 | 84.3 | $0.46 | 184 | |
| 20 | 84.3 | $0.0000 | — | |
| 21 | 84.3 | $0.0000 | — | |
| 22 | 84.0 | $0.0000 | — | |
| 23 | 83.0 | $0.46 | 181 | |
| 24 | 82.3 | $0.11 | 720 | |
| 25 | 81.3 | $0.0000 | — | |
| 26 | 80.7 | $0.03 | 3.1k | |
| 27 | 79.0 | $0.37 | 212 | |
| 28 | 78.0 | $0.0000 | — | |
| 29 | 77.3 | $0.0000 | — | |
| 30 | 77.0 | $0.20 | 376 | |
| 31 | 77.0 | $0.0000 | — | |
| 32 | 76.3 | $0.01 | 6.6k | |
| 33 | 75.7 | $3.46 | 21.8 | |
| 34 | 75.3 | $0.03 | 2.9k | |
| 35 | 74.7 | $0.0000 | — | |
| 36 | 74.7 | $0.0000 | — | |
| 37 | 72.7 | $0.02 | 4.7k | |
| 38 | 72.7 | $0.01 | 5.2k | |
| 39 | 72.3 | $2.79 | 25.9 | |
| 40 | 71.7 | $0.04 | 1.8k | |
| 41 | 71.3 | $0.0000 | — | |
| 42 | 70.7 | $0.0000 | — | |
| 43 | 70.3 | $0.02 | 3.8k | |
| 44 | 70.0 | $0.0000 | — | |
| 45 | 69.3 | $0.11 | 648 | |
| 46 | 69.0 | $0.0000 | — | |
| 47 | 68.7 | $0.0000 | — | |
| 48 | 68.3 | $0.19 | 356 | |
| 49 | 67.3 | $0.05 | 1.5k | |
| 50 | 67.0 | $0.05 | 1.2k |