Blended Price
$0.41/M
Input Price
$0.24/M
Output Price
$0.90/M
Speed
—
TTFT
—
Hidden, no data: AgMoBench Agentic, AgMoBench Robustness, Output Speed
Axes
Filters
Providers
vcontinuous-leaderboard · tasks-created:2025-01-01:2025-11-01 · DeepSeek-V3-0324 · harness swe-rebench-react@tools · 5 attempts · pass@1 · swe-rebench:standardized:128k-or-model-limit · provider DeepSeek-V3-0324__tools · record DeepSeek-V3-0324__tools:1735689600000:1761955200000
{
"passAt5": 36.6120218579235,
"developer": "deepseek",
"instanceType": "model",
"contextPolicy": "128k unless the model supports less",
"attemptsPerTask": 5,
"totalTokenUsage": 0,
"modelReleaseDate": "2025-03-24",
"scoreStandardError": 0.4540666920875106,
"cachedTokenPercentage": null,
"modelReleaseTimestamp": 1742774400000,
"standardContextTokens": 128000,
"averageInstanceCostUsd": 0,
"potentialContamination": true,
"aggregateTaskRangeTimestamp": {
"to": 1761955200000,
"from": 1735689600000
},
"publishedTaskRangeTimestamp": {
"to": 1761955200000,
"from": 1735689600000
}
}Evidence observed 2025-11-01
vcontinuous-leaderboard · tasks-created:2025-01-01:2025-08-01 · DeepSeek-V3-0324 · harness swe-rebench-react@text · 5 attempts · pass@1 · swe-rebench:standardized:128k-or-model-limit · provider DeepSeek-V3-0324__text · record DeepSeek-V3-0324__text:1735689600000:1754006400000
{
"passAt5": 38.539042821158695,
"developer": "deepseek",
"instanceType": "model",
"contextPolicy": "128k unless the model supports less",
"attemptsPerTask": 5,
"totalTokenUsage": 0,
"modelReleaseDate": "2025-03-24",
"scoreStandardError": 0.5125186385233197,
"cachedTokenPercentage": null,
"modelReleaseTimestamp": 1742774400000,
"standardContextTokens": 128000,
"averageInstanceCostUsd": 0,
"potentialContamination": true,
"aggregateTaskRangeTimestamp": {
"to": 1754006400000,
"from": 1735689600000
},
"publishedTaskRangeTimestamp": {
"to": 1754006400000,
"from": 1735689600000
}
}Evidence observed 2025-08-01