Medium-length video understanding from the Video-MME benchmark — questions about videos between 2–30 minutes, balancing temporal reasoning with manageable context.
This definition has not completed editorial and provenance review. Verify its metric, version, source, and evaluation configuration upstream before using it for a model-selection decision.
Tests video understanding at a practical length for most real-world video content.
Requires video processing. Few evaluated models (8).
Higher is better. Accuracy percentage (0–100%).
Requires video processing.
| # | Model | Score |
|---|---|---|
| 1 | 81.0 | |
| 2 | 81.0 | |
| 3 | 76.6 | |
| 4 | 76.6 | |
| 5 | 74.7 | |
| 6 | 74.7 | |
| 7 | 68.3 | |
| 8 | 60.1 | |
| 9 | 59.7 | |
| 10 | 48.9 |