Blended Price
Free/M
Input Price
Free/M
Output Price
Free/M
Speed
—
TTFT
—
Hidden, no data: AgMoBench Math, AgMoBench Agentic, AgMoBench Robustness, Output Speed
Axes
Filters
Providers
vcontinuous-leaderboard · tasks-created:2025-11-01:2026-03-01 · Devstral-Small-2-24B-Instruct-2512 · harness swe-rebench-react@tools · 5 attempts · pass@1 · swe-rebench:standardized:128k-or-model-limit · provider Devstral-Small-2-24B-Instruct-2512__tools · record Devstral-Small-2-24B-Instruct-2512__tools:1761955200000:1772323200000
{
"passAt5": 56.49999999999999,
"developer": "mistral",
"instanceType": "model",
"contextPolicy": "128k unless the model supports less",
"attemptsPerTask": 5,
"totalTokenUsage": 1978567.5591578092,
"modelReleaseDate": "2025-12-25",
"scoreStandardError": 1.1732147250869298,
"cachedTokenPercentage": 96.33876233005392,
"modelReleaseTimestamp": 1766620800000,
"standardContextTokens": 128000,
"averageInstanceCostUsd": 0.09315052587900408,
"potentialContamination": true,
"aggregateTaskRangeTimestamp": {
"to": 1772323200000,
"from": 1761955200000
},
"publishedTaskRangeTimestamp": {
"to": 1772323200000,
"from": 1761955200000
}
}Evidence observed 2026-03-01