Models Agents EvalsIndustry

AgMoDB by @mistakeknot

GPT-4 Turbo | AgMoDB

GPT-4 Turbo

November 6, 2023Last synced Apr 7, 2026, 4:00 PM128K context

Blended Price

$15.00/M

Input Price

$10.00/M

Output Price

$30.00/M

Speed

27 tok/s

TTFT

0.88s

Benchmark Scores

Intelligence Index

External Benchmarks

AlpacaEval 2.0 LC

How GPT-4 Turbo Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

13.7

Coding Index

21.5

Math Index

—

MMLU Pro

0.7 / 100

GPQA Diamond

— / 100

HLE

0.0 / 100

LiveCodeBench

0.3 / 100

SciCode

0.3 / 100

MATH-500

0.7 / 100

AIME

0.1 / 30

AIME 2025

— / 30

IFBench

— / 100

LCR

— / 100

Terminal-Bench Hard

— / 100

τ²-Bench

— / 100

alpacaeval

55.0 / 100

AlpacaEval 2.0 Rawalpacaeval

46.1 / 100

AA-Omniscience AccuracyPredicted

39.3 / 100

AA-Omniscience Hallucination RatePredicted

96.9 / 100

Aider PolyglotPredicted

18.3 / 100

AIME 2025Predicted

0.2 / 30

ARC-AGI-1Predicted

3.3 / 100

ARC-AGI-1 Cost per TaskPredicted

0.0

ARC-AGI-2Predicted

0.0 / 100

ARC-AGI-2 Cost per TaskPredicted

0.0

BFCL (Berkeley Function Calling)Predicted

34.8

AA Intelligence Index (Matrix)Predicted

77.9

AA Long Context Reasoning (Matrix)Predicted

69.1

AIME 2024Predicted

44.2

AIME 2025 (Matrix)Predicted

19.7

Arena-Hard AutoPredicted

69.2

BrowseCompPredicted

53.7

BRUMO 2025Predicted

83.4

CMIMC 2025Predicted

60.5

CritPtPredicted

0.1

GPQA Diamond (Matrix)Predicted

53.9

GSM8KPredicted

86.4

HLE (Matrix)Predicted

9.3

HMMT Feb 2025Predicted

29.0

HMMT Nov 2025Predicted

94.9

HumanEvalPredicted

85.2

IFBench (Matrix)Predicted

22.2

IFEvalPredicted

82.2

IMO 2025Predicted

3.3

LiveCodeBench (Matrix)Predicted

43.7

MATH-500 (Matrix)Predicted

95.5

MathArena Apex 2025Predicted

0.4

MMLUPredicted

82.3

MMLU-Pro (Matrix)Predicted

71.1

MMMU-ProPredicted

80.6

MRCR v2Predicted

72.9

OSWorldPredicted

30.6

SimpleQAPredicted

21.2

SMT 2025Predicted

72.0

SWE-bench ProPredicted

26.7

Tau-Bench Telecom (Matrix)Predicted

93.8

Terminal-Bench 2.0Predicted

22.0

Terminal-Bench 1.0Predicted

11.1

USAMO 2025Predicted

4.4

Video-MMUPredicted

86.3

browsecompPredicted

60.1

BullshitBenchPredicted

9.3 / 100

Aider PolyglotPredicted

0.0

Apex AgentsPredicted

2.0

Arc Agi 2Predicted

0.0

BALROGPredicted

0.0

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.9

CAD-EvalPredicted

6.7

Chess PuzzlesPredicted

0.1

CyBenchPredicted

0.1

DeepResearchBenchPredicted

0.3

FictionLiveBenchPredicted

0.3

GdpvalPredicted

0.2

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

31.9

GSOPredicted

0.0

HellaSwagPredicted

23.9

HlePredicted

0.0

Lech Mazur WritingPredicted

6.9

PIQAPredicted

0.8

PosttrainbenchPredicted

0.0

SimpleQA Verified (Epoch)Predicted

0.4

The Agent CompanyPredicted

1.2

TriviaQAPredicted

2.1

VPCTPredicted

0.4

WinoGrandePredicted

0.8

FrontierMathPredicted

9.0 / 100

GPQA DiamondPredicted

0.5 / 100

IFBenchPredicted

0.3 / 100

LCRPredicted

0.1 / 100

LegalBenchPredicted

86.3 / 100

LiveBench CodingPredicted

61.6 / 100

LiveBench Data AnalysisPredicted

34.5 / 100

LiveBench LanguagePredicted

42.5 / 100

LiveBench MathPredicted

50.5 / 100

LiveBench OverallPredicted

36.2 / 100

LiveBench ReasoningPredicted

27.4 / 100

LongBench v2 EasyPredicted

42.7

LongBench v2 HardPredicted

41.5

LongBench v2Predicted

37.4 / 100

MathVistaPredicted

55.6 / 100

MLE-benchPredicted

9.4 / 100

MMMUPredicted

62.7 / 100

MMTU Table UnderstandingPredicted

47.1 / 100

MT-BenchPredicted

7.9 / 10

NoLiMa (NIAH)Predicted

92.5 / 100

OCRBench v2Predicted

80.4 / 100

Open LLM AveragePredicted

45.1 / 100

Open LLM: BBHPredicted

69.4 / 100

Open LLM: GPQAPredicted

35.8 / 100

Open LLM: IFEvalPredicted

76.6 / 100

Open LLM: MATH Level 5Predicted

49.5 / 100

Open LLM: MMLU-PROPredicted

55.7 / 100

Open LLM: MUSRPredicted

45.5 / 100

SWE-bench LitePredicted

12.7 / 100

SWE-bench VerifiedPredicted

29.7 / 100

τ²-BenchPredicted

0.2 / 100

tau-bench RetailPredicted

71.5 / 100

Terminal-Bench HardPredicted

0.0 / 100

Vectara Factual ConsistencyPredicted

92.1 / 100

Vectara Hallucination RatePredicted

7.9 / 100

WebArenaPredicted

10.6 / 100

BigCodeBench Completebigcodebench

58.2 / 100

BigCodeBench Instructbigcodebench

48.2 / 100

Epoch Capabilities Indexepoch_ai

127.7

METR Time Horizonsepoch_ai

0.9

OTIS Mock AIME 2024–2025epoch_ai

0.1

GAIA Level 1gaia

22.6

GAIA Level 2gaia

10.7

GAIA Level 3gaia

2.0

GAIAgaia

13.0 / 100

MedQA (USMLE)medqa

82.0

RE-Benchrebench

0.0

SimpleBenchsimplebench

25.1 / 100

simpleqasimpleqa

24.2

WeirdMLweirdml

18.0 / 100

WildBenchwildbench

56.1