AgMoDB
ModelsAgentsOrchestratorsEvalsCompositesVisualizeIndustry
AgMoDB by @mistakeknot
All Models

Qwen2.5 Coder Instruct 32B

November 11, 2024Last synced Nov 5, 2026, 12:19 AM

Blended Price

Free/M

Input Price

Free/M

Output Price

Free/M

Speed

—

TTFT

—

Benchmark Scores

Intelligence Index
—
Coding Index
—
Math Index
—
MMLU Pro
63.5 / 100
GPQA Diamond
41.7 / 100
HLE
3.5 / 100
LiveCodeBench
29.5 / 100
SciCode
— / 100
MATH-500
76.7 / 100
AIME
12.0 / 30
AIME 2025
— / 30
IFBench
— / 100
LCR
— / 100
Terminal-Bench Hard
— / 100
τ²-Bench
— / 100

Performance Radar

Qwen2.5 Coder Instruct 32B
Field Average

Hidden, no data: AgMoBench Overall, AgMoBench Coding, AgMoBench Math, AgMoBench Agentic, AgMoBench Robustness, Output Speed

* Shared benchmarks shown in their place: GPQA Diamond, HLE

External Benchmarks

AA-Omniscience AccuracyPredicted
40.7 / 100
AA-Omniscience Hallucination RatePredicted
94.3 / 100
Aider PolyglotPredicted
15.5 / 100
AIME 2025Predicted
0.1 / 30
AlpacaEval 2.0 LCPredicted
37.3 / 100
AlpacaEval 2.0 RawPredicted
29.4 / 100
ARC-AGI-1Predicted
2.3 / 100
ARC-AGI-1 Cost per TaskPredicted
0.0
ARC-AGI-2Predicted
0.0 / 100
ARC-AGI-2 Cost per TaskPredicted
0.0
BFCL (Berkeley Function Calling)Predicted
31.6
BigCodeBench CompletePredicted
54.3 / 100
BigCodeBench InstructPredicted
44.5 / 100
AA Intelligence Index (Matrix)Predicted
65.5
AA Long Context Reasoning (Matrix)Predicted
70.0
AIME 2024Predicted
39.0
AIME 2025 (Matrix)Predicted
19.9
Arena-Hard AutoPredicted
49.0
BrowseCompPredicted
59.1
BRUMO 2025Predicted
73.5
CMIMC 2025Predicted
84.5
CritPtPredicted
0.1
GPQA Diamond (Matrix)Predicted
49.6
GSM8KPredicted
79.4
HLE (Matrix)Predicted
61.9
HMMT Feb 2025Predicted
30.1
HMMT Nov 2025Predicted
88.3
HumanEvalPredicted
79.6
IFBench (Matrix)Predicted
28.1
IFEvalPredicted
78.3
IMO 2025Predicted
9.9
LiveCodeBench (Matrix)Predicted
39.2
MATH-500 (Matrix)Predicted
89.9
MathArena Apex 2025Predicted
0.7
MMLUPredicted
79.9
MMLU-Pro (Matrix)Predicted
66.9
MMMU-ProPredicted
82.2
MRCR v2Predicted
73.9
OSWorld (Unversioned Matrix Import)Predicted
32.5 / 100
SimpleQAPredicted
17.6
SMT 2025Predicted
70.6
SWE-bench ProPredicted
27.2
Tau-Bench Telecom (Matrix)Predicted
94.9
Terminal-Bench 2.0Predicted
17.3
Terminal-Bench 1.0Predicted
12.0
USAMO 2025Predicted
4.4
Video-MMUPredicted
85.9
browsecompPredicted
56.4
BullshitBenchPredicted
55.3 / 100
Aider PolyglotPredicted
0.0
Apex AgentsPredicted
2.2
Arc Agi 2Predicted
2.1
BALROGPredicted
0.0
BIG-Bench HardPredicted
3.0
BoolQPredicted
0.9
CAD-EvalPredicted
7.5
Chess PuzzlesPredicted
0.1
CyBenchPredicted
0.1
DeepResearchBenchPredicted
0.3
FictionLiveBenchPredicted
0.4
GdpvalPredicted
0.2
GeoBenchPredicted
0.0
GSM8K (Epoch)Predicted
9.9
GSOPredicted
0.0
HellaSwagPredicted
20.0
HlePredicted
0.2
Lech Mazur WritingPredicted
6.8
METR Time HorizonsPredicted
0.2
OTIS Mock AIME 2024–2025Predicted
0.1
PIQAPredicted
0.9
PosttrainbenchPredicted
0.0
SimpleQA Verified (Epoch)Predicted
0.2
The Agent CompanyPredicted
1.1
TriviaQAPredicted
3.0
VPCTPredicted
0.3
WinoGrandePredicted
0.8
FrontierMathPredicted
51.0 / 100
GAIA Level 1Predicted
23.8
GAIA Level 2Predicted
7.4
GAIA Level 3Predicted
0.0
GAIAPredicted
14.7 / 100
IFBenchPredicted
0.3 / 100
LCRPredicted
0.0 / 100
LegalBenchPredicted
80.0 / 100
LiveBench CodingPredicted
63.6 / 100
LiveBench Data AnalysisPredicted
38.0 / 100
LiveBench LanguagePredicted
47.0 / 100
LiveBench MathPredicted
55.3 / 100
LiveBench OverallPredicted
40.1 / 100
LiveBench ReasoningPredicted
32.1 / 100
LongBench v2 EasyPredicted
39.6
LongBench v2 HardPredicted
38.2
LongBench v2Predicted
31.6 / 100
MathVistaPredicted
53.6 / 100
MedQA (USMLE)Predicted
71.7
MLE-bench (Original)Predicted
14.6 / 100
MMMUPredicted
59.8 / 100
MMTU Table UnderstandingPredicted
47.9 / 100
MT-BenchPredicted
7.9 / 10
NoLiMa (NIAH)Predicted
91.2 / 100
OCRBench v2Predicted
77.0 / 100
RE-BenchPredicted
0.2
SimpleBenchPredicted
20.4 / 100
simpleqaPredicted
18.6
SWE-bench LitePredicted
10.7 / 100
τ²-BenchPredicted
0.0 / 100
tau-bench RetailPredicted
74.8 / 100
Terminal-Bench HardPredicted
0.0 / 100
Vectara Factual ConsistencyPredicted
94.0 / 100
Vectara Hallucination RatePredicted
6.0 / 100
WebArenaPredicted
7.4 / 100
WeirdMLPredicted
17.3 / 100
WildBenchPredicted
50.2
Epoch Capabilities Indexepoch_ai
113.2
Open LLM Averageopen_llm_leaderboard
39.9 / 100
Open LLM: BBHopen_llm_leaderboard
66.3 / 100
Open LLM: GPQAopen_llm_leaderboard
34.9 / 100
Open LLM: IFEvalopen_llm_leaderboard
72.7 / 100
Open LLM: MATH Level 5open_llm_leaderboard
49.5 / 100
Open LLM: MMLU-PROopen_llm_leaderboard
44.1 / 100
Open LLM: MUSRopen_llm_leaderboard
43.9 / 100
SWE-bench Verifiedswebench
9.0 / 100

How Qwen2.5 Coder Instruct 32B Compares

Axes

Filters

$0.00 – $67.5
≥ 1.4

Providers

ai2ai21-labsalibabaanthropicarceeawsazurebaidu
openai
zai
meta
nvidia
xai
upstage
deepseek
alibaba
mistral
nous-research
aws
google
anthropic
xiaomi
stepfun
kimi
reflection
minimax
azure
inclusionai
reka-ai
cohere
bytedance_seed
inception
tencent
thinking-machines
Bubble size = Context Window
8191.00
2000000.00
Compare with other models