Models Agents EvalsIndustry

AgMoDB by @mistakeknot

o3-pro | AgMoDB

o3-pro

June 10, 2025Last synced Apr 7, 2026, 4:00 PM200K context

Blended Price

$35.00/M

Input Price

$20.00/M

Output Price

$80.00/M

Speed

21 tok/s

TTFT

89.57s

Benchmark Scores

Intelligence Index

External Benchmarks

Aider Polyglot

How o3-pro Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

40.7

Coding Index

—

Math Index

—

MMLU Pro

— / 100

GPQA Diamond

0.8 / 100

HLE

— / 100

LiveCodeBench

— / 100

SciCode

— / 100

MATH-500

— / 100

AIME

— / 30

AIME 2025

— / 30

IFBench

— / 100

LCR

— / 100

Terminal-Bench Hard

— / 100

τ²-Bench

— / 100

aider

84.9 / 100

ARC-AGI-1arc_agi

59.3 / 100

ARC-AGI-1 Cost per Taskarc_agi

4.2

ARC-AGI-2arc_agi

4.9 / 100

ARC-AGI-2 Cost per Taskarc_agi

7.6

AA-Omniscience AccuracyPredicted

44.4 / 100

AA-Omniscience Hallucination RatePredicted

96.5 / 100

AIMEPredicted

0.1 / 30

AIME 2025Predicted

0.9 / 30

AlpacaEval 2.0 LCPredicted

20.2 / 100

AlpacaEval 2.0 RawPredicted

15.9 / 100

BFCL (Berkeley Function Calling)Predicted

52.9

BigCodeBench CompletePredicted

37.9 / 100

BigCodeBench InstructPredicted

29.6 / 100

AA Intelligence Index (Matrix)Predicted

65.8

AA Long Context Reasoning (Matrix)Predicted

76.9

AIME 2024Predicted

98.8

AIME 2025 (Matrix)Predicted

99.9

Arena-Hard AutoPredicted

76.9

BrowseCompPredicted

74.3

BRUMO 2025Predicted

99.7

CMIMC 2025Predicted

94.9

CritPtPredicted

13.4

GPQA Diamond (Matrix)Predicted

89.7

GSM8KPredicted

97.9

HLE (Matrix)Predicted

46.2

HMMT Feb 2025Predicted

96.2

HMMT Nov 2025Predicted

93.7

HumanEvalPredicted

94.1

IFBench (Matrix)Predicted

66.9

IFEvalPredicted

91.6

IMO 2025Predicted

53.3

LiveCodeBench (Matrix)Predicted

83.7

MATH-500 (Matrix)Predicted

98.3

MathArena Apex 2025Predicted

11.3

MMLUPredicted

91.7

MMLU-Pro (Matrix)Predicted

88.7

MMMU-ProPredicted

80.1

MRCR v2Predicted

76.0

OSWorldPredicted

65.9

SimpleQAPredicted

65.5

SMT 2025Predicted

94.5

SWE-bench ProPredicted

49.6

Tau-Bench Telecom (Matrix)Predicted

98.8

Terminal-Bench 2.0Predicted

68.7

Terminal-Bench 1.0Predicted

49.2

USAMO 2025Predicted

32.4

Video-MMUPredicted

85.7

browsecompPredicted

81.5

BullshitBenchPredicted

52.7 / 100

Apex AgentsPredicted

3.4

BALROGPredicted

0.0

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.8

CAD-EvalPredicted

2.7

Chess PuzzlesPredicted

0.3

CyBenchPredicted

0.7

DeepResearchBenchPredicted

0.5

GdpvalPredicted

0.6

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

0.0

GSOPredicted

0.4

HellaSwagPredicted

0.0

HlePredicted

0.4

METR Time HorizonsPredicted

37.5

OTIS Mock AIME 2024–2025Predicted

0.9

PIQAPredicted

0.8

PosttrainbenchPredicted

0.0

SimpleQA Verified (Epoch)Predicted

0.7

The Agent CompanyPredicted

2.7

TriviaQAPredicted

21.6

VPCTPredicted

0.7

WinoGrandePredicted

0.8

FrontierMathPredicted

39.0 / 100

GAIA Level 1Predicted

75.2

GAIA Level 2Predicted

51.2

GAIA Level 3Predicted

52.5

GAIAPredicted

58.9 / 100

HLEPredicted

0.2 / 100

IFBenchPredicted

0.6 / 100

LCRPredicted

0.6 / 100

LegalBenchPredicted

66.9 / 100

LiveBench CodingPredicted

77.9 / 100

LiveBench Data AnalysisPredicted

57.8 / 100

LiveBench LanguagePredicted

62.9 / 100

LiveBench MathPredicted

86.6 / 100

LiveBench OverallPredicted

57.7 / 100

LiveBench ReasoningPredicted

54.5 / 100

LiveCodeBenchPredicted

0.7 / 100

LongBench v2 EasyPredicted

53.0

LongBench v2 HardPredicted

19.3

LongBench v2Predicted

24.0 / 100

MATH-500Predicted

0.9 / 100

MathVistaPredicted

56.3 / 100

MedQA (USMLE)Predicted

94.8

MLE-benchPredicted

70.8 / 100

MMLU ProPredicted

0.8 / 100

MMMUPredicted

82.7 / 100

MMTU Table UnderstandingPredicted

68.8 / 100

MT-BenchPredicted

7.8 / 10

NoLiMa (NIAH)Predicted

92.5 / 100

OCRBench v2Predicted

83.4 / 100

Open LLM AveragePredicted

11.8 / 100

Open LLM: BBHPredicted

37.2 / 100

Open LLM: GPQAPredicted

26.4 / 100

Open LLM: IFEvalPredicted

35.4 / 100

Open LLM: MATH Level 5Predicted

1.4 / 100

Open LLM: MMLU-PROPredicted

22.2 / 100

Open LLM: MUSRPredicted

37.8 / 100

RE-BenchPredicted

100.0

SciCodePredicted

0.3 / 100

SimpleBenchPredicted

67.5 / 100

simpleqaPredicted

59.9

SWE-bench LitePredicted

54.6 / 100

SWE-bench VerifiedPredicted

81.8 / 100

τ²-BenchPredicted

0.9 / 100

tau-bench RetailPredicted

91.4 / 100

Terminal-Bench HardPredicted

0.1 / 100

WebArenaPredicted

0.2 / 100

WildBenchPredicted

35.2

Aider Polyglotepoch_ai

0.7

Arc Agi 2epoch_ai

0.0

Epoch Capabilities Indexepoch_ai

148.2

FictionLiveBenchepoch_ai

0.9

Lech Mazur Writingepoch_ai

8.6

PRBench Financeseal

49.1

PRBench Legalseal

49.7

Vectara Factual Consistencyvectara_hallucination

76.7 / 100

Vectara Hallucination Ratevectara_hallucination

23.3 / 100

WeirdMLweirdml

58.2 / 100