Short-form video understanding from the Video-MME benchmark — questions about videos under 2 minutes, testing visual comprehension and scene understanding.
This definition has not completed editorial and provenance review. Verify its metric, version, source, and evaluation configuration upstream before using it for a model-selection decision.
Tests fundamental video understanding without long-context complexity. Highest scores of the three durations.
Shortest videos may be solvable from individual frames rather than requiring temporal reasoning.
Higher is better. Accuracy percentage (0–100%).
Shortest videos may be solvable from individual frames rather than requiring temporal reasoning.
| # | Model | Score |
|---|---|---|
| 1 | 84.5 | |
| 2 | 84.5 | |
| 3 | 82.8 | |
| 4 | 82.8 | |
| 5 | 79.8 | |
| 6 | 79.8 | |
| 7 | 74.9 | |
| 8 | 73.5 | |
| 9 | 73.2 | |
| 10 | 57.6 |