The harder 'Pro' variant of MMMU — college-level multimodal problems requiring expert knowledge in art, business, science, health, humanities, and engineering, with more challenging visual reasoning.
This definition has not completed editorial and provenance review. Verify its metric, version, source, and evaluation configuration upstream before using it for a model-selection decision.
Higher difficulty ceiling than standard MMMU. Tests advanced multimodal understanding across diverse disciplines.
Requires vision capabilities. Newer benchmark with fewer historical baselines.
Higher is better. Accuracy percentage (0–100%). Top models score ~85%.
Requires vision capabilities.
| # | Model | Score |
|---|---|---|
| 1 | 86.5 | |
| 2 | 86.5 | |
| 3 | 86.5 | |
| 4 | 85.4 | |
| 5 | 85.4 | |
| 6 | 84.1 | |
| 7 | 83.7 | |
| 8 | 83.6 | |
| 9 | 83.3 | |
| 10 | 83.1 | |
| 11 | 83.0 | |
| 12 | 83.0 | |
| 13 | 82.9 | |
| 14 | 82.8 | |
| 15 | 82.5 | |
| 16 | 82.5 | |
| 17 | 82.5 | |
| 18 | 82.5 | |
| 19 | 82.5 | |
| 20 | 82.4 | |
| 21 | 82.4 | |
| 22 | 82.3 | |
| 23 | 82.3 | |
| 24 | 82.3 | |
| 25 | 82.3 | |
| 26 | 82.2 | |
| 27 | 82.2 | |
| 28 | 82.2 | |
| 29 | 82.2 | |
| 30 | 82.2 | |
| 31 | 82.2 | |
| 32 | 82.2 | |
| 33 | 82.2 | |
| 34 | 82.2 | |
| 35 | 82.2 | |
| 36 | 82.2 | |
| 37 | 82.1 | |
| 38 | 82.1 | |
| 39 | 82.1 | |
| 40 | 82.1 | |
| 41 | 82.1 | |
| 42 | 82.1 | |
| 43 | 82.1 | |
| 44 | 82.1 | |
| 45 | 82.1 | |
| 46 | 82.1 | |
| 47 | 82.0 | |
| 48 | 82.0 | |
| 49 | 82.0 | |
| 50 | 82.0 |