Models Agents EvalsIndustry

AgMoDB by @mistakeknot

GPT-4.1 mini | AgMoDB

GPT-4.1 mini

April 14, 2025Last synced Apr 7, 2026, 4:00 PM1048K context

Blended Price

$0.70/M

Input Price

$0.40/M

Output Price

$1.60/M

Speed

88 tok/s

TTFT

0.52s

Benchmark Scores

Intelligence Index

External Benchmarks

Aider Polyglot

How GPT-4.1 mini Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

22.9

Coding Index

18.5

Math Index

46.3

MMLU Pro

0.8 / 100

GPQA Diamond

0.7 / 100

HLE

0.0 / 100

LiveCodeBench

0.5 / 100

SciCode

0.4 / 100

MATH-500

0.9 / 100

AIME

0.4 / 30

AIME 2025

0.5 / 30

IFBench

0.4 / 100

LCR

0.4 / 100

Terminal-Bench Hard

0.1 / 100

τ²-Bench

0.5 / 100

aider

32.4 / 100

ARC-AGI-1arc_agi

3.5 / 100

ARC-AGI-1 Cost per Taskarc_agi

0.0

ARC-AGI-2arc_agi

0.0 / 100

ARC-AGI-2 Cost per Taskarc_agi

0.0

ARC-AGI-1benchmark_matrix

3.5 / 100

ARC-AGI-2benchmark_matrix

0.0 / 100

Arena-Hard Autobenchmark_matrix

28.2

BigCodeBenchbenchmark_matrix

48.9

GPQA Diamond (Matrix)benchmark_matrix

55.0

HumanEvalbenchmark_matrix

90.0

IFEvalbenchmark_matrix

84.1

MMLUbenchmark_matrix

86.0

SimpleQAbenchmark_matrix

20.0

MMMUbenchmark_matrix

71.1 / 100

simpleqabenchmark_matrix

20.0

AA-Omniscience AccuracyPredicted

36.8 / 100

AA-Omniscience Hallucination RatePredicted

94.3 / 100

AlpacaEval 2.0 LCPredicted

20.7 / 100

AlpacaEval 2.0 RawPredicted

32.7 / 100

AA Intelligence Index (Matrix)Predicted

69.7

AA Long Context Reasoning (Matrix)Predicted

69.0

AIME 2024Predicted

65.1

AIME 2025 (Matrix)Predicted

75.2

BrowseCompPredicted

73.0

BRUMO 2025Predicted

62.1

CMIMC 2025Predicted

61.3

CritPtPredicted

0.1

GSM8KPredicted

91.1

HLE (Matrix)Predicted

54.4

HMMT Feb 2025Predicted

75.7

HMMT Nov 2025Predicted

48.6

IFBench (Matrix)Predicted

35.2

IMO 2025Predicted

8.7

LiveCodeBench (Matrix)Predicted

56.5

MATH-500 (Matrix)Predicted

94.8

MathArena Apex 2025Predicted

0.4

MMLU-Pro (Matrix)Predicted

77.7

MMMU-ProPredicted

81.5

MRCR v2Predicted

81.0

OSWorldPredicted

30.4

SMT 2025Predicted

72.8

SWE-bench ProPredicted

26.8

Tau-Bench Telecom (Matrix)Predicted

93.6

Terminal-Bench 2.0Predicted

15.4

Terminal-Bench 1.0Predicted

10.2

USAMO 2025Predicted

5.8

Video-MMUPredicted

66.3

browsecompPredicted

46.0

BullshitBenchPredicted

10.9 / 100

Apex AgentsPredicted

1.5

BALROGPredicted

0.0

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.8

Chess PuzzlesPredicted

0.1

CyBenchPredicted

0.2

DeepResearchBenchPredicted

0.3

GdpvalPredicted

0.2

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

39.4

GSOPredicted

0.0

HellaSwagPredicted

17.4

HlePredicted

0.1

Lech Mazur WritingPredicted

7.2

METR Time HorizonsPredicted

0.2

PIQAPredicted

0.9

PosttrainbenchPredicted

0.0

SimpleQA Verified (Epoch)Predicted

0.1

The Agent CompanyPredicted

1.6

TriviaQAPredicted

2.5

VPCTPredicted

0.3

WinoGrandePredicted

1.0

FrontierMathPredicted

8.7 / 100

GAIA Level 1Predicted

53.6

GAIA Level 2Predicted

37.2

GAIA Level 3Predicted

5.0

GAIAPredicted

37.7 / 100

LegalBenchPredicted

90.9 / 100

LiveBench CodingPredicted

61.4 / 100

LiveBench Data AnalysisPredicted

35.9 / 100

LiveBench LanguagePredicted

53.7 / 100

LiveBench MathPredicted

50.2 / 100

LiveBench OverallPredicted

44.7 / 100

LiveBench ReasoningPredicted

39.9 / 100

LongBench v2 EasyPredicted

48.7

LongBench v2 HardPredicted

46.2

LongBench v2Predicted

41.7 / 100

MathVistaPredicted

62.8 / 100

MLE-benchPredicted

9.6 / 100

MMTU Table UnderstandingPredicted

46.6 / 100

MT-BenchPredicted

8.6 / 10

Open LLM AveragePredicted

42.7 / 100

Open LLM: BBHPredicted

68.8 / 100

Open LLM: GPQAPredicted

35.8 / 100

Open LLM: IFEvalPredicted

76.1 / 100

Open LLM: MATH Level 5Predicted

55.1 / 100

Open LLM: MMLU-PROPredicted

55.0 / 100

Open LLM: MUSRPredicted

45.7 / 100

RE-BenchPredicted

0.1

SimpleBenchPredicted

30.5 / 100

SWE-bench LitePredicted

20.6 / 100

tau-bench RetailPredicted

66.2 / 100

Vectara Factual ConsistencyPredicted

94.3 / 100

Vectara Hallucination RatePredicted

5.7 / 100

WebArenaPredicted

23.0 / 100

WildBenchPredicted

55.9

BFCL (Berkeley Function Calling)bfcl

50.5

BigCodeBench Completebigcodebench

59.3 / 100

BigCodeBench Instructbigcodebench

48.9 / 100

Aider Polyglotepoch_ai

0.0

Arc Agi 2epoch_ai

0.0

CAD-Evalepoch_ai

4.6

Epoch Capabilities Indexepoch_ai

135.8

FictionLiveBenchepoch_ai

0.4

OTIS Mock AIME 2024–2025epoch_ai

0.4

EQ-Bench 3eqbench

1470.0

NoLiMa (NIAH)nolima

80.9 / 100

OCRBench v2open-vlm-leaderboard

84.0 / 100

simpleqasimpleqa

16.8

SWE-bench Verifiedswebench

23.9 / 100

WeirdMLweirdml

37.6 / 100