Instruction Following Benchmark — tests a model's ability to precisely follow complex, multi-constraint instructions without deviating or hallucinating.
Measures whether models follow specific formatting, length, and content constraints. High scores correlate with practical reliability.
Benchmark focuses on explicit constraints, so it misses failures on ambiguous user intent; compliance with format rules does not guarantee factual correctness of generated content.
Higher is better. Measures accuracy of instruction adherence across increasingly complex prompts.
Max score: 100
Based on ~500 samples, ~200 input tokens and ~500 output tokens per sample (700 total per sample).
Estimates from IFBench paper. Actual costs vary with reasoning effort and multi-turn prompting.
Benchmark focuses on explicit constraints, so it misses failures on ambiguous user intent.
| # | Model | Score | Est. Eval Cost | Score/$ |
|---|---|---|---|---|
| 1 | 83.3 | $0.75 | 111 | |
| 2 | 82.9 | $1.70 | 48.8 | |
| 3 | 82.9 | $0.33 | 251 | |
| 4 | 81.4 | $0.74 | 111 | |
| 5 | 81.3 | $0.75 | 108 | |
| 6 | 81.2 | $0.75 | 108 | |
| 7 | 81.0 | $0.75 | 108 | |
| 8 | 80.5 | $2.13 | 37.9 | |
| 9 | 80.4 | $0.0000 | — | |
| 10 | 79.9 | $0.26 | 306 | |
| 11 | 79.6 | $2.63 | 30.3 | |
| 12 | 79.2 | $0.07 | 1.1k | |
| 13 | 79.0 | $2.63 | 30.1 | |
| 14 | 78.8 | $0.96 | 82.1 | |
| 15 | 78.8 | $0.96 | 82.1 | |
| 16 | 78.0 | $0.80 | 97.4 | |
| 17 | 78.0 | $0.44 | 177 | |
| 18 | 77.6 | $3.67 | 21.1 | |
| 19 | 77.2 | $0.40 | 193 | |
| 20 | 77.1 | $3.20 | 24.1 | |
| 21 | 76.6 | $2.08 | 36.8 | |
| 22 | 76.6 | $0.0000 | — | |
| 23 | 76.5 | $0.91 | 83.6 | |
| 24 | 76.3 | $2.40 | 31.8 | |
| 25 | 76.3 | $1.05 | 72.4 | |
| 26 | 76.0 | $1.09 | 69.4 | |
| 27 | 75.9 | $0.33 | 228 | |
| 28 | 75.9 | $0.0000 | — | |
| 29 | 75.9 | $0.33 | 228 | |
| 30 | 75.9 | $8.00 | 9.48 | |
| 31 | 75.7 | $0.84 | 90.1 | |
| 32 | 75.7 | $0.33 | 229 | |
| 33 | 75.7 | $0.33 | 229 | |
| 34 | 75.6 | $0.63 | 120 | |
| 35 | 75.6 | $0.0000 | — | |
| 36 | 75.4 | $0.53 | 144 | |
| 37 | 75.4 | $3.67 | 20.5 | |
| 38 | 75.4 | $3.67 | 20.5 | |
| 39 | 75.4 | $3.67 | 20.5 | |
| 40 | 75.2 | $0.80 | 94.0 | |
| 41 | 74.6 | $2.40 | 31.1 | |
| 42 | 74.1 | $2.63 | 28.2 | |
| 43 | 73.9 | $4.00 | 18.5 | |
| 44 | 73.9 | $0.41 | 183 | |
| 45 | 73.5 | $0.08 | 865 | |
| 46 | 73.5 | $0.07 | 1.1k | |
| 47 | 73.3 | $1.24 | 59.1 | |
| 48 | 73.3 | $1.20 | 61.1 | |
| 49 | 73.3 | $1.20 | 61.1 | |
| 50 | 73.2 | $0.90 | 81.7 |