A benchmark testing common-sense reasoning, spatial understanding, and real-world problem solving — designed to expose gaps in model reasoning that other benchmarks miss.
Targets common-sense failures that high academic benchmark scores can miss; deceptively simple prompts expose brittle reasoning and weak world-model assumptions.
Relatively small test set, so individual model scores can be noisy; trends across model families are more informative.
Higher is better. Percentage accuracy. Human baseline is ~83%. Top models reach 40-60%.
Max score: 100
Based on ~200 samples, ~400 input tokens and ~200 output tokens per sample (600 total per sample).
Estimates from SimpleBench estimate. Actual costs vary with reasoning effort and multi-turn prompting.
Relatively small test set, so individual model scores can be noisy.
| # | Model | Score | Est. Eval Cost | Score/$ |
|---|---|---|---|---|
| 1 | 92.0 | $0.0000 | — | |
| 2 | 88.4 | $1.12 | 78.9 | |
| 3 | 85.0 | $0.0000 | — | |
| 4 | 83.6 | $2.80 | 29.9 | |
| 5 | 82.3 | $0.0000 | — | |
| 6 | 81.9 | $2.80 | 29.3 | |
| 7 | 81.9 | $2.80 | 29.3 | |
| 8 | 81.8 | $0.0000 | — | |
| 9 | 79.6 | $0.64 | 124 | |
| 10 | 79.6 | $0.64 | 124 | |
| 11 | 79.6 | $0.64 | 124 | |
| 12 | 77.9 | $0.01 | 6.5k | |
| 13 | 76.9 | $4.80 | 16.0 | |
| 14 | 76.9 | $9.60 | 8.01 | |
| 15 | 76.7 | $0.48 | 160 | |
| 16 | 76.4 | $0.64 | 119 | |
| 17 | 76.4 | $0.64 | 119 | |
| 18 | 76.3 | $0.11 | 681 | |
| 19 | 75.9 | $0.56 | 136 | |
| 20 | 74.5 | $0.27 | 276 | |
| 21 | 74.1 | $0.02 | 4.1k | |
| 22 | 73.1 | $0.56 | 131 | |
| 23 | 73.1 | $0.70 | 104 | |
| 24 | 72.5 | $0.80 | 90.6 | |
| 25 | 71.4 | $0.0000 | — | |
| 26 | 71.1 | $0.0000 | — | |
| 27 | 70.5 | $0.02 | 3.7k | |
| 28 | 70.4 | $0.50 | 141 | |
| 29 | 70.2 | $0.0000 | — | |
| 30 | 70.1 | $0.02 | 2.9k | |
| 31 | 70.0 | $0.40 | 175 | |
| 32 | 69.0 | $1.60 | 43.1 | |
| 33 | 67.6 | $1.40 | 48.3 | |
| 34 | 67.6 | $1.40 | 48.3 | |
| 35 | 67.6 | $1.40 | 48.3 | |
| 36 | 67.6 | $1.40 | 48.3 | |
| 37 | 67.5 | $4.80 | 14.1 | |
| 38 | 67.4 | $0.70 | 96.3 | |
| 39 | 65.9 | $0.80 | 82.4 | |
| 40 | 64.9 | $0.0000 | — | |
| 41 | 64.8 | $1.12 | 57.9 | |
| 42 | 64.8 | $1.40 | 46.3 | |
| 43 | 64.3 | $0.16 | 402 | |
| 44 | 63.8 | $9.60 | 6.65 | |
| 45 | 63.5 | $0.0000 | — | |
| 46 | 63.3 | $0.0000 | — | |
| 47 | 63.0 | $0.0000 | — | |
| 48 | 62.4 | $0.01 | 5.2k | |
| 49 | 62.4 | $0.50 | 125 | |
| 50 | 62.4 | $0.50 | 125 |