Models Agents EvalsIndustry

AgMoDB by @mistakeknot

GPT-4.1 | AgMoDB

GPT-4.1

April 14, 2025Last synced Apr 7, 2026, 4:00 PM1048K context

Blended Price

$3.50/M

Input Price

$2.00/M

Output Price

$8.00/M

Speed

127 tok/s

TTFT

0.50s

Benchmark Scores

Intelligence Index

External Benchmarks

Aider Polyglot

How GPT-4.1 Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

26.3

Coding Index

21.8

Math Index

34.7

MMLU Pro

0.8 / 100

GPQA Diamond

0.7 / 100

HLE

0.0 / 100

LiveCodeBench

0.5 / 100

SciCode

0.4 / 100

MATH-500

0.9 / 100

AIME

0.4 / 30

AIME 2025

0.3 / 30

IFBench

0.4 / 100

LCR

0.6 / 100

Terminal-Bench Hard

0.1 / 100

τ²-Bench

0.5 / 100

aider

78.2 / 100

ARC-AGI-1arc_agi

5.5 / 100

ARC-AGI-1 Cost per Taskarc_agi

0.0

ARC-AGI-2arc_agi

0.4 / 100

ARC-AGI-2 Cost per Taskarc_agi

0.1

ARC-AGI-1benchmark_matrix

5.5 / 100

ARC-AGI-2benchmark_matrix

0.4 / 100

AIME 2024benchmark_matrix

46.5

AIME 2025 (Matrix)benchmark_matrix

46.4

Arena-Hard Autobenchmark_matrix

61.5

Codeforces Ratingbenchmark_matrix

1807.0

GPQA Diamond (Matrix)benchmark_matrix

66.3

HLE (Matrix)benchmark_matrix

3.7

HMMT Feb 2025benchmark_matrix

19.4

HumanEvalbenchmark_matrix

92.0

IFEvalbenchmark_matrix

87.4

LiveCodeBench (Matrix)benchmark_matrix

44.7

MATH-500 (Matrix)benchmark_matrix

92.4

MMLUbenchmark_matrix

90.2

MMLU-Pro (Matrix)benchmark_matrix

81.8

MRCR v2benchmark_matrix

80.0

SimpleQAbenchmark_matrix

42.3

Terminal-Bench 1.0benchmark_matrix

30.3

MMMUbenchmark_matrix

74.8 / 100

simpleqabenchmark_matrix

42.3

SWE-bench Verifiedbenchmark_matrix

54.6 / 100

AA-Omniscience AccuracyPredicted

38.6 / 100

AA-Omniscience Hallucination RatePredicted

95.2 / 100

AlpacaEval 2.0 LCPredicted

35.3 / 100

AlpacaEval 2.0 RawPredicted

30.1 / 100

BigCodeBench CompletePredicted

41.4 / 100

BigCodeBench InstructPredicted

32.2 / 100

AA Intelligence Index (Matrix)Predicted

68.8

AA Long Context Reasoning (Matrix)Predicted

68.7

BrowseCompPredicted

72.6

BRUMO 2025Predicted

73.3

CMIMC 2025Predicted

69.2

CritPtPredicted

0.2

GSM8KPredicted

92.7

HMMT Nov 2025Predicted

92.9

IFBench (Matrix)Predicted

43.2

IMO 2025Predicted

4.8

MathArena Apex 2025Predicted

0.4

MMMU-ProPredicted

81.6

OSWorldPredicted

32.4

SMT 2025Predicted

77.9

SWE-bench ProPredicted

32.3

Tau-Bench Telecom (Matrix)Predicted

94.8

Terminal-Bench 2.0Predicted

23.3

USAMO 2025Predicted

9.3

Video-MMUPredicted

86.7

browsecompPredicted

50.7

Apex AgentsPredicted

1.8

BALROGPredicted

0.0

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.8

Chess PuzzlesPredicted

0.1

CyBenchPredicted

0.2

GdpvalPredicted

0.1

GSM8K (Epoch)Predicted

16.6

GSOPredicted

0.0

HellaSwagPredicted

7.9

Lech Mazur WritingPredicted

8.2

PIQAPredicted

0.9

PosttrainbenchPredicted

0.0

SimpleQA Verified (Epoch)Predicted

0.4

The Agent CompanyPredicted

1.9

TriviaQAPredicted

3.6

VPCTPredicted

0.4

WinoGrandePredicted

0.9

FrontierMathPredicted

10.9 / 100

LegalBenchPredicted

90.1 / 100

LiveBench CodingPredicted

73.8 / 100

LiveBench Data AnalysisPredicted

43.2 / 100

LiveBench LanguagePredicted

48.5 / 100

LiveBench MathPredicted

56.6 / 100

LiveBench OverallPredicted

46.0 / 100

LiveBench ReasoningPredicted

35.2 / 100

LongBench v2 EasyPredicted

55.0

LongBench v2 HardPredicted

46.9

LongBench v2Predicted

42.3 / 100

MathVistaPredicted

65.9 / 100

MMTU Table UnderstandingPredicted

51.4 / 100

MT-BenchPredicted

9.0 / 10

Open LLM AveragePredicted

14.5 / 100

Open LLM: BBHPredicted

26.1 / 100

Open LLM: GPQAPredicted

24.2 / 100

Open LLM: IFEvalPredicted

63.9 / 100

Open LLM: MATH Level 5Predicted

42.5 / 100

Open LLM: MMLU-PROPredicted

19.9 / 100

Open LLM: MUSRPredicted

29.9 / 100

tau-bench RetailPredicted

74.8 / 100

WebArenaPredicted

18.4 / 100

WildBenchPredicted

53.6

BFCL (Berkeley Function Calling)bfcl

54.0

BullshitBenchbullshitbench

14.0 / 100

Aider Polyglotepoch_ai

0.0

Arc Agi 2epoch_ai

0.0

CAD-Evalepoch_ai

7.3

DeepResearchBenchepoch_ai

0.3

Epoch Capabilities Indexepoch_ai

137.5

FictionLiveBenchepoch_ai

0.5

GeoBenchepoch_ai

0.0

Hleepoch_ai

0.1

METR Time Horizonsepoch_ai

0.4

OTIS Mock AIME 2024–2025epoch_ai

0.4

EQ-Bench 3eqbench

1519.0

GAIA Level 1gaia

86.8

GAIA Level 2gaia

70.9

GAIA Level 3gaia

30.8

GAIAgaia

69.7 / 100

IDP Coreidp-leaderboard

74.7 / 100

IDP OlmOCRidp-leaderboard

49.4 / 100

IDP OmniDocidp-leaderboard

79.9 / 100

IDP Overallidp-leaderboard

68.0 / 100

MLE-benchmlebench

30.2 / 100

NoLiMa (NIAH)nolima

97.0 / 100

OCRBench v2open-vlm-leaderboard

83.4 / 100

RE-Benchrebench

0.0

SimpleBenchsimplebench

27.0 / 100

simpleqasimpleqa

41.6

SWE-bench Liteswebench

2.7 / 100

SWE-bench Verifiedswebench

2.8 / 100

Vectara Factual Consistencyvectara_hallucination

94.4 / 100

Vectara Hallucination Ratevectara_hallucination

5.6 / 100

WeirdMLweirdml

39.0 / 100