Models Agents EvalsIndustry

AgMoDB by @mistakeknot

GPT-4 | AgMoDB

GPT-4

March 14, 2023Last synced Apr 7, 2026, 4:00 PM8K context

Blended Price

$37.50/M

Input Price

$30.00/M

Output Price

$60.00/M

Speed

31 tok/s

TTFT

0.76s

Benchmark Scores

Intelligence Index

External Benchmarks

Aider Polyglot

How GPT-4 Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

12.8

Coding Index

13.1

Math Index

—

MMLU Pro

— / 100

GPQA Diamond

— / 100

HLE

— / 100

LiveCodeBench

— / 100

SciCode

— / 100

MATH-500

— / 100

AIME

— / 30

AIME 2025

— / 30

IFBench

— / 100

LCR

— / 100

Terminal-Bench Hard

— / 100

τ²-Bench

— / 100

aider

45.3 / 100

ARC-AGI-1arc_agi

4.5 / 100

ARC-AGI-1 Cost per Taskarc_agi

0.1

ARC-AGI-2arc_agi

0.0 / 100

ARC-AGI-2 Cost per Taskarc_agi

0.1

AA-Omniscience AccuracyPredicted

38.7 / 100

AA-Omniscience Hallucination RatePredicted

94.7 / 100

AIMEPredicted

0.6 / 30

AIME 2025Predicted

0.3 / 30

AlpacaEval 2.0 LCPredicted

31.9 / 100

AlpacaEval 2.0 RawPredicted

31.7 / 100

BFCL (Berkeley Function Calling)Predicted

41.8

AA Intelligence Index (Matrix)Predicted

69.1

AA Long Context Reasoning (Matrix)Predicted

61.2

AIME 2024Predicted

37.7

AIME 2025 (Matrix)Predicted

47.5

Arena-Hard AutoPredicted

72.6

BrowseCompPredicted

52.7

BRUMO 2025Predicted

82.4

CMIMC 2025Predicted

63.9

CritPtPredicted

0.0

GPQA Diamond (Matrix)Predicted

72.7

GSM8KPredicted

92.4

HLE (Matrix)Predicted

10.3

HMMT Feb 2025Predicted

43.5

HMMT Nov 2025Predicted

92.6

HumanEvalPredicted

85.4

IFBench (Matrix)Predicted

35.6

IFEvalPredicted

81.8

IMO 2025Predicted

5.9

LiveCodeBench (Matrix)Predicted

54.0

MATH-500 (Matrix)Predicted

90.0

MathArena Apex 2025Predicted

2.4

MMLUPredicted

82.9

MMLU-Pro (Matrix)Predicted

74.7

MMMU-ProPredicted

81.4

MRCR v2Predicted

80.3

OSWorldPredicted

33.7

SimpleQAPredicted

34.2

SMT 2025Predicted

72.3

SWE-bench ProPredicted

24.5

Tau-Bench Telecom (Matrix)Predicted

94.1

Terminal-Bench 2.0Predicted

15.9

Terminal-Bench 1.0Predicted

13.7

USAMO 2025Predicted

6.2

Video-MMUPredicted

93.3

browsecompPredicted

48.3

BullshitBenchPredicted

8.4 / 100

Apex AgentsPredicted

1.9

BALROGPredicted

0.0

BoolQPredicted

0.9

CAD-EvalPredicted

5.3

Chess PuzzlesPredicted

0.1

DeepResearchBenchPredicted

7.1

GSOPredicted

0.0

PIQAPredicted

0.9

PosttrainbenchPredicted

59.8

SimpleQA Verified (Epoch)Predicted

0.2

TriviaQAPredicted

2.7

FrontierMathPredicted

9.5 / 100

GPQA DiamondPredicted

0.6 / 100

HLEPredicted

0.0 / 100

IFBenchPredicted

0.4 / 100

LCRPredicted

0.0 / 100

LegalBenchPredicted

86.7 / 100

LiveBench CodingPredicted

69.6 / 100

LiveBench Data AnalysisPredicted

41.2 / 100

LiveBench LanguagePredicted

50.3 / 100

LiveBench MathPredicted

52.4 / 100

LiveBench OverallPredicted

38.2 / 100

LiveBench ReasoningPredicted

25.5 / 100

LiveCodeBenchPredicted

0.4 / 100

MATH-500Predicted

0.9 / 100

MLE-benchPredicted

10.3 / 100

MMLU ProPredicted

0.7 / 100

MMTU Table UnderstandingPredicted

48.9 / 100

NoLiMa (NIAH)Predicted

93.8 / 100

Open LLM AveragePredicted

16.4 / 100

Open LLM: BBHPredicted

27.0 / 100

Open LLM: GPQAPredicted

35.3 / 100

Open LLM: IFEvalPredicted

69.9 / 100

Open LLM: MATH Level 5Predicted

55.4 / 100

Open LLM: MMLU-PROPredicted

21.3 / 100

Open LLM: MUSRPredicted

26.4 / 100

SciCodePredicted

0.3 / 100

τ²-BenchPredicted

0.1 / 100

tau-bench RetailPredicted

57.5 / 100

Terminal-Bench HardPredicted

0.1 / 100

Vectara Factual ConsistencyPredicted

92.2 / 100

Vectara Hallucination RatePredicted

7.8 / 100

WebArenaPredicted

20.1 / 100

BigCodeBench Completebigcodebench

58.9 / 100

BigCodeBench Instructbigcodebench

48.0 / 100

Aider Polyglotepoch_ai

0.1

Arc Agi 2epoch_ai

0.0

BIG-Bench Hardepoch_ai

3.0

CyBenchepoch_ai

0.1

Epoch Capabilities Indexepoch_ai

126.2

FictionLiveBenchepoch_ai

0.6

Gdpvalepoch_ai

0.1

GeoBenchepoch_ai

0.0

GSM8K (Epoch)epoch_ai

5.0

HellaSwagepoch_ai

10.0

Hleepoch_ai

0.0

Lech Mazur Writingepoch_ai

8.2

METR Time Horizonsepoch_ai

0.9

OTIS Mock AIME 2024–2025epoch_ai

0.1

Parameter Countepoch_ai

1800000000000.0

The Agent Companyepoch_ai

1.3

Training Computeepoch_ai

2.1e+25

VPCTepoch_ai

0.4

WinoGrandeepoch_ai

0.9

EQ-Bench 3eqbench

1594.0

GAIA Level 1gaia

50.5

GAIA Level 2gaia

33.3

GAIA Level 3gaia

14.3

GAIAgaia

35.5 / 100

LongBench v2 Easylongbench2

51.2

LongBench v2 Hardlongbench2

57.4

LongBench v2longbench2

50.1 / 100

MathVistamathvista

33.9 / 100

MMMUmmmu

56.8 / 100

MT-Benchmtbench

9.0 / 10

OCRBench v2open-vlm-leaderboard

82.2 / 100

RE-Benchrebench

8.9

SimpleBenchsimplebench

17.8 / 100

simpleqasimpleqa

38.8

SWE-bench Liteswebench

19.0 / 100

SWE-bench Verifiedswebench

21.6 / 100

Video-MME Longvideomme

56.9

Video-MME Mediumvideomme

59.7

Video-MMEvideomme

63.3 / 100

Video-MME Shortvideomme

73.2

WeirdMLweirdml

12.4 / 100

WildBenchwildbench

53.3