Models Agents EvalsIndustry

AgMoDB by @mistakeknot

GPT-5 (high) | AgMoDB

GPT-5 (high)

August 7, 2025Last synced Apr 7, 2026, 4:00 PM400K context

Blended Price

$3.44/M

Input Price

$1.25/M

Output Price

$10.00/M

Speed

103 tok/s

TTFT

85.11s

Benchmark Scores

Intelligence Index

External Benchmarks

AA-Omniscience Accuracy

How GPT-5 (high) Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

44.6

Coding Index

36.0

Math Index

94.3

MMLU Pro

0.9 / 100

GPQA Diamond

0.9 / 100

HLE

0.3 / 100

LiveCodeBench

0.8 / 100

SciCode

0.4 / 100

MATH-500

1.0 / 100

AIME

1.0 / 30

AIME 2025

0.9 / 30

IFBench

0.7 / 100

LCR

0.8 / 100

Terminal-Bench Hard

0.3 / 100

τ²-Bench

0.8 / 100

aa_omniscience

38.9 / 100

Aider Polyglotaider

81.3 / 100

ARC-AGI-1arc_agi

6.0 / 100

ARC-AGI-1 Cost per Taskarc_agi

0.0

ARC-AGI-2arc_agi

0.0 / 100

ARC-AGI-2 Cost per Taskarc_agi

0.1

ARC-AGI-1benchmark_matrix

65.7 / 100

ARC-AGI-2benchmark_matrix

9.9 / 100

AA Intelligence Index (Matrix)benchmark_matrix

68.0

AA Long Context Reasoning (Matrix)benchmark_matrix

75.6

AIME 2024benchmark_matrix

94.6

AIME 2025 (Matrix)benchmark_matrix

94.6

BRUMO 2025benchmark_matrix

91.7

Chatbot Arena ELO (Matrix)benchmark_matrix

1460.0

CMIMC 2025benchmark_matrix

90.0

Codeforces Ratingbenchmark_matrix

2537.0

CritPtbenchmark_matrix

5.7

GPQA Diamond (Matrix)benchmark_matrix

88.4

HLE (Matrix)benchmark_matrix

35.2

HMMT Feb 2025benchmark_matrix

88.3

HMMT Nov 2025benchmark_matrix

89.2

HumanEvalbenchmark_matrix

94.0

IFEvalbenchmark_matrix

90.0

IMO 2025benchmark_matrix

38.1

LiveCodeBench (Matrix)benchmark_matrix

84.5

MATH-500 (Matrix)benchmark_matrix

99.4

MathArena Apex 2025benchmark_matrix

1.0

MMLUbenchmark_matrix

91.0

MMLU-Pro (Matrix)benchmark_matrix

87.0

OSWorldbenchmark_matrix

40.0

SMT 2025benchmark_matrix

92.0

SWE-bench Probenchmark_matrix

41.8

Tau-Bench Telecom (Matrix)benchmark_matrix

97.0

Terminal-Bench 2.0benchmark_matrix

35.2

Terminal-Bench 1.0benchmark_matrix

41.3

browsecompbenchmark_matrix

54.9

FrontierMathbenchmark_matrix

25.2 / 100

LiveBench Overallbenchmark_matrix

70.5 / 100

MMMUbenchmark_matrix

84.2 / 100

SimpleBenchbenchmark_matrix

61.6 / 100

simpleqabenchmark_matrix

55.0

SWE-bench Verifiedbenchmark_matrix

74.9 / 100

AA-Omniscience Hallucination RatePredicted

96.8 / 100

AlpacaEval 2.0 LCPredicted

55.2 / 100

AlpacaEval 2.0 RawPredicted

46.8 / 100

BFCL (Berkeley Function Calling)Predicted

54.1

BigCodeBench CompletePredicted

35.3 / 100

BigCodeBench InstructPredicted

27.1 / 100

Arena-Hard AutoPredicted

88.6

BrowseCompPredicted

59.1

GSM8KPredicted

88.5

IFBench (Matrix)Predicted

64.4

MMMU-ProPredicted

82.1

MRCR v2Predicted

77.4

SimpleQAPredicted

48.1

USAMO 2025Predicted

22.2

Video-MMUPredicted

75.9

Aider PolyglotPredicted

0.1

Apex AgentsPredicted

2.6

BALROGPredicted

0.0

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.7

CAD-EvalPredicted

1.8

Chess PuzzlesPredicted

0.2

CyBenchPredicted

0.5

DeepResearchBenchPredicted

0.5

FictionLiveBenchPredicted

0.9

GdpvalPredicted

0.3

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

0.7

GSOPredicted

0.0

HellaSwagPredicted

0.0

Lech Mazur WritingPredicted

8.6

METR Time HorizonsPredicted

41.3

OTIS Mock AIME 2024–2025Predicted

1.3

PIQAPredicted

0.8

PosttrainbenchPredicted

0.0

SimpleQA Verified (Epoch)Predicted

0.4

The Agent CompanyPredicted

3.6

TriviaQAPredicted

10.8

VPCTPredicted

0.4

WinoGrandePredicted

1.1

GAIA Level 1Predicted

68.0

GAIA Level 2Predicted

53.3

GAIA Level 3Predicted

48.0

GAIAPredicted

52.9 / 100

LongBench v2 EasyPredicted

59.1

LongBench v2 HardPredicted

50.2

LongBench v2Predicted

45.6 / 100

MathVistaPredicted

72.0 / 100

MT-BenchPredicted

8.3 / 10

NoLiMa (NIAH)Predicted

94.7 / 100

OCRBench v2Predicted

86.8 / 100

Open LLM AveragePredicted

20.5 / 100

Open LLM: BBHPredicted

50.9 / 100

Open LLM: GPQAPredicted

28.8 / 100

Open LLM: IFEvalPredicted

29.1 / 100

Open LLM: MATH Level 5Predicted

4.7 / 100

Open LLM: MMLU-PROPredicted

34.7 / 100

Open LLM: MUSRPredicted

40.6 / 100

SWE-bench LitePredicted

75.4 / 100

tau-bench RetailPredicted

86.4 / 100

WebArenaPredicted

13.0 / 100

WildBenchPredicted

47.6

browsecompbrowsecomp

54.9

BullshitBenchbullshitbench

21.0 / 100

Arc Agi 2epoch_ai

0.2

Epoch Capabilities Indexepoch_ai

150.0

Hleepoch_ai

0.3

EQ-Bench 3eqbench

1586.0

LegalBenchlegalbench

86.0 / 100

LiveBench Codinglivebench

78.6 / 100

LiveBench Data Analysislivebench

48.0 / 100

LiveBench Languagelivebench

70.0 / 100

LiveBench Mathlivebench

72.4 / 100

LiveBench Overalllivebench

60.0 / 100

LiveBench Reasoninglivebench

63.1 / 100

MedQA (USMLE)medqa

96.3

MLE-benchmlebench

39.6 / 100

MMMUmmmu

74.4 / 100

MMTU Table Understandingmmtu

69.6 / 100

RE-Benchrebench

95.7

MultiChallengeseal

63.2

PRBench Financeseal

51.3

PRBench Legalseal

49.0

SimpleBenchsimplebench

56.7 / 100

SWE-bench Verifiedswebench

75.6 / 100

Vectara Factual Consistencyvectara_hallucination

84.9 / 100

Vectara Hallucination Ratevectara_hallucination

15.1 / 100

WeirdMLweirdml

60.7 / 100