Verified subset of SimpleQA scores from Epoch AI's collection. Same factuality benchmark as OpenAI's SimpleQA but with additional verification.
This definition has not completed editorial and provenance review. Verify its metric, version, source, and evaluation configuration upstream before using it for a model-selection decision.
Double-verified answers improve reliability over standard SimpleQA.
Score is 0–1 ratio (multiply by 100 for percentage). Top models: ~0.77.
Higher is better. Accuracy ratio (0–1).
Score is 0–1 ratio (multiply by 100 for percentage).
| # | Model | Score |
|---|---|---|
| 1 | 4.6 | |
| 2 | 3.1 | |
| 3 | 1.2 | |
| 4 | 1.1 | |
| 5 | 1.1 | |
| 6 | 1.0 | |
| 7 | 0.9 | |
| 8 | 0.8 | |
| 9 | 0.8 | |
| 10 | 0.8 | |
| 11 | 0.8 | |
| 12 | 0.8 | |
| 13 | 0.8 | |
| 14 | 0.8 | |
| 15 | 0.8 | |
| 16 | 0.8 | |
| 17 | 0.8 | |
| 18 | 0.8 | |
| 19 | 0.8 | |
| 20 | 0.7 | |
| 21 | 0.7 | |
| 22 | 0.7 | |
| 23 | 0.7 | |
| 24 | 0.7 | |
| 25 | 0.7 | |
| 26 | 0.7 | |
| 27 | 0.7 | |
| 28 | 0.7 | |
| 29 | 0.7 | |
| 30 | 0.7 | |
| 31 | 0.7 | |
| 32 | 0.7 | |
| 33 | 0.7 | |
| 34 | 0.7 | |
| 35 | 0.7 | |
| 36 | 0.7 | |
| 37 | 0.7 | |
| 38 | 0.7 | |
| 39 | 0.7 | |
| 40 | 0.7 | |
| 41 | 0.7 | |
| 42 | 0.7 | |
| 43 | 0.7 | |
| 44 | 0.6 | |
| 45 | 0.6 | |
| 46 | 0.6 | |
| 47 | 0.6 | |
| 48 | 0.6 | |
| 49 | 0.6 | |
| 50 | 0.6 |