Math reasoning over visual content — 6,141 examples requiring mathematical understanding of charts, diagrams, geometry figures, and scientific plots.
Uniquely combines visual understanding with mathematical reasoning. Covers diverse visual math tasks from simple chart reading to complex geometric proofs.
Some tasks can be solved with OCR plus text-only math reasoning, which can bypass deeper visual grounding; benchmark is static and may become easier as published solutions proliferate.
Higher is better. Accuracy percentage.
Max score: 100
Some tasks can be solved with OCR plus text-only math reasoning, which can bypass deeper visual grounding.
| # | Model | Score |
|---|---|---|
| 1 | 81.2 | |
| 2 | 78.8 | |
| 3 | 78.7 | |
| 4 | 77.5 | |
| 5 | 74.1 | |
| 6 | 73.9 | |
| 7 | 73.9 | |
| 8 | 73.7 | |
| 9 | 73.3 | |
| 10 | 73.3 | |
| 11 | 73.0 | |
| 12 | 72.9 | |
| 13 | 72.9 | |
| 14 | 72.7 | |
| 15 | 72.7 | |
| 16 | 72.2 | |
| 17 | 72.2 | |
| 18 | 72.2 | |
| 19 | 72.1 | |
| 20 | 72.1 | |
| 21 | 72.0 | |
| 22 | 71.8 | |
| 23 | 71.7 | |
| 24 | 71.7 | |
| 25 | 71.7 | |
| 26 | 71.4 | |
| 27 | 71.3 | |
| 28 | 71.3 | |
| 29 | 71.2 | |
| 30 | 71.2 | |
| 31 | 71.0 | |
| 32 | 70.9 | |
| 33 | 70.9 | |
| 34 | 70.9 | |
| 35 | 70.9 | |
| 36 | 70.8 | |
| 37 | 70.8 | |
| 38 | 70.8 | |
| 39 | 70.8 | |
| 40 | 70.8 | |
| 41 | 70.7 | |
| 42 | 70.6 | |
| 43 | 70.6 | |
| 44 | 70.4 | |
| 45 | 70.4 | |
| 46 | 70.4 | |
| 47 | 70.4 | |
| 48 | 70.4 | |
| 49 | 70.3 | |
| 50 | 70.2 |