Humanity's Last Exam with tool access (code execution, web search). Expert-crafted, very high-difficulty questions. Tool-augmented variant typically scores 5-15pp higher than no-tools.
This definition has not completed editorial and provenance review. Verify its metric, version, source, and evaluation configuration upstream before using it for a model-selection decision.
Measures frontier reasoning + tool orchestration. Same expert questions as HLE, so no-tools vs tools delta is meaningful.
Tool harness varies across labs — different tools/timeouts affect scores. Not strictly comparable to no-tools HLE.
Higher is better. Even top models score below 65%. Gains over no-tools variant indicate effective tool use on hard reasoning.
Max score: 100
Tool harness varies across labs — different tools/timeouts affect scores.
| # | Model | Score |
|---|---|---|
| 1 | 64.7 | |
| 2 | 58.7 | |
| 3 | 54.7 | |
| 4 | 53.3 | |
| 5 | 51.4 |