Models Agents EvalsIndustry

AgMoDB by @mistakeknot

o3-mini | AgMoDB

o3-mini

January 31, 2025Last synced Apr 7, 2026, 4:00 PM200K context

Blended Price

$1.93/M

Input Price

$1.10/M

Output Price

$4.40/M

Speed

167 tok/s

TTFT

8.48s

Benchmark Scores

Intelligence Index

External Benchmarks

Aider Polyglot

How o3-mini Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

25.9

Coding Index

17.9

Math Index

—

MMLU Pro

0.8 / 100

GPQA Diamond

0.7 / 100

HLE

0.1 / 100

LiveCodeBench

0.7 / 100

SciCode

0.4 / 100

MATH-500

1.0 / 100

AIME

0.8 / 30

AIME 2025

— / 30

IFBench

— / 100

LCR

— / 100

Terminal-Bench Hard

0.1 / 100

τ²-Bench

0.3 / 100

aider

60.4 / 100

ARC-AGI-1arc_agi

34.5 / 100

ARC-AGI-1 Cost per Taskarc_agi

0.4

ARC-AGI-2arc_agi

3.0 / 100

ARC-AGI-2 Cost per Taskarc_agi

0.5

ARC-AGI-1benchmark_matrix

34.5 / 100

ARC-AGI-2benchmark_matrix

3.0 / 100

AIME 2024benchmark_matrix

87.3

AIME 2025 (Matrix)benchmark_matrix

86.5

Arena-Hard Autobenchmark_matrix

43.0

Chatbot Arena ELO (Matrix)benchmark_matrix

1364.0

Codeforces Ratingbenchmark_matrix

2130.0

GPQA Diamond (Matrix)benchmark_matrix

79.7

HLE (Matrix)benchmark_matrix

13.0

HMMT Feb 2025benchmark_matrix

50.0

HumanEvalbenchmark_matrix

97.6

IFEvalbenchmark_matrix

88.0

LiveCodeBench (Matrix)benchmark_matrix

74.1

MATH-500 (Matrix)benchmark_matrix

97.9

MMLUbenchmark_matrix

86.9

MMLU-Pro (Matrix)benchmark_matrix

80.0

USAMO 2025benchmark_matrix

2.1

FrontierMathbenchmark_matrix

11.0 / 100

simpleqabenchmark_matrix

13.8

SWE-bench Verifiedbenchmark_matrix

49.3 / 100

AA-Omniscience AccuracyPredicted

38.0 / 100

AA-Omniscience Hallucination RatePredicted

95.7 / 100

AIME 2025Predicted

0.6 / 30

AlpacaEval 2.0 LCPredicted

23.8 / 100

AlpacaEval 2.0 RawPredicted

28.8 / 100

BFCL (Berkeley Function Calling)Predicted

49.6

BigCodeBench CompletePredicted

58.7 / 100

BigCodeBench InstructPredicted

48.4 / 100

AA Intelligence Index (Matrix)Predicted

68.6

AA Long Context Reasoning (Matrix)Predicted

65.7

BrowseCompPredicted

56.8

BRUMO 2025Predicted

86.1

CMIMC 2025Predicted

73.2

CritPtPredicted

0.1

GSM8KPredicted

94.0

HMMT Nov 2025Predicted

56.3

IFBench (Matrix)Predicted

49.8

IMO 2025Predicted

14.5

MathArena Apex 2025Predicted

0.3

MMMU-ProPredicted

81.7

MRCR v2Predicted

85.3

OSWorldPredicted

37.5

SimpleQAPredicted

19.6

SMT 2025Predicted

80.5

SWE-bench ProPredicted

33.9

Tau-Bench Telecom (Matrix)Predicted

95.4

Terminal-Bench 2.0Predicted

14.4

Terminal-Bench 1.0Predicted

29.6

Video-MMUPredicted

75.7

browsecompPredicted

52.8

BullshitBenchPredicted

15.9 / 100

Apex AgentsPredicted

2.1

BALROGPredicted

0.0

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.7

DeepResearchBenchPredicted

0.3

GdpvalPredicted

0.2

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

9.8

HellaSwagPredicted

2.7

HlePredicted

0.1

METR Time HorizonsPredicted

2.2

PIQAPredicted

0.9

PosttrainbenchPredicted

50.1

SimpleQA Verified (Epoch)Predicted

0.3

The Agent CompanyPredicted

2.1

TriviaQAPredicted

4.5

VPCTPredicted

0.4

WinoGrandePredicted

0.9

IFBenchPredicted

0.5 / 100

LCRPredicted

0.3 / 100

LegalBenchPredicted

81.6 / 100

LiveBench CodingPredicted

65.4 / 100

LiveBench Data AnalysisPredicted

42.5 / 100

LiveBench LanguagePredicted

54.3 / 100

LiveBench MathPredicted

60.3 / 100

LiveBench OverallPredicted

45.4 / 100

LiveBench ReasoningPredicted

41.3 / 100

LongBench v2 EasyPredicted

52.9

LongBench v2 HardPredicted

32.2

LongBench v2Predicted

33.3 / 100

MathVistaPredicted

64.6 / 100

MLE-benchPredicted

22.0 / 100

MMMUPredicted

76.2 / 100

MMTU Table UnderstandingPredicted

60.7 / 100

MT-BenchPredicted

7.9 / 10

NoLiMa (NIAH)Predicted

94.4 / 100

OCRBench v2Predicted

86.6 / 100

Open LLM AveragePredicted

15.9 / 100

Open LLM: BBHPredicted

43.3 / 100

Open LLM: GPQAPredicted

29.0 / 100

Open LLM: IFEvalPredicted

58.5 / 100

Open LLM: MATH Level 5Predicted

11.0 / 100

Open LLM: MMLU-PROPredicted

26.3 / 100

Open LLM: MUSRPredicted

39.5 / 100

RE-BenchPredicted

2.8

tau-bench RetailPredicted

72.4 / 100

Vectara Factual ConsistencyPredicted

92.9 / 100

Vectara Hallucination RatePredicted

7.1 / 100

WebArenaPredicted

15.8 / 100

WildBenchPredicted

51.0

Aider Polyglotepoch_ai

0.1

Arc Agi 2epoch_ai

0.0

CAD-Evalepoch_ai

5.5

Chess Puzzlesepoch_ai

0.2

CyBenchepoch_ai

0.2

Epoch Capabilities Indexepoch_ai

141.5

FictionLiveBenchepoch_ai

0.4

GSOepoch_ai

0.0

Lech Mazur Writingepoch_ai

6.2

OTIS Mock AIME 2024–2025epoch_ai

0.6

GAIA Level 1gaia

81.1

GAIA Level 2gaia

54.7

GAIA Level 3gaia

23.1

GAIAgaia

58.2 / 100

MedQA (USMLE)medqa

94.8

PropensityBenchseal

33.2

SEAL Tool Use (Enterprise)seal

65.3

SimpleBenchsimplebench

22.8 / 100

simpleqasimpleqa

13.0

SWE-bench Liteswebench

30.3 / 100

SWE-bench Verifiedswebench

42.4 / 100

WeirdMLweirdml

43.7 / 100