Models Agents EvalsIndustry

AgMoDB by @mistakeknot

Grok 4 | AgMoDB

Grok 4

July 10, 2025Last synced Apr 7, 2026, 4:00 PM256K context

Blended Price

$6.00/M

Input Price

$3.00/M

Output Price

$15.00/M

Speed

45 tok/s

TTFT

11.44s

Benchmark Scores

Intelligence Index

External Benchmarks

AA-Omniscience Accuracy

How Grok 4 Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

41.5

Coding Index

40.5

Math Index

92.7

MMLU Pro

0.9 / 100

GPQA Diamond

0.9 / 100

HLE

0.2 / 100

LiveCodeBench

0.8 / 100

SciCode

0.5 / 100

MATH-500

1.0 / 100

AIME

0.9 / 30

AIME 2025

0.9 / 30

IFBench

0.5 / 100

LCR

0.7 / 100

Terminal-Bench Hard

0.4 / 100

τ²-Bench

0.7 / 100

aa_omniscience

41.4 / 100

AA-Omniscience Hallucination Rateaa_omniscience

96.9 / 100

AA-Omniscience Indexaa_omniscience

15.3 / 100

Aider Polyglotaider

79.6 / 100

ARC-AGI-1arc_agi

89.5 / 100

ARC-AGI-1 Cost per Taskarc_agi

0.3

ARC-AGI-2arc_agi

65.1 / 100

ARC-AGI-2 Cost per Taskarc_agi

0.9

ARC-AGI-1benchmark_matrix

66.6 / 100

ARC-AGI-2benchmark_matrix

42.0 / 100

AA Intelligence Index (Matrix)benchmark_matrix

73.0

AA Long Context Reasoning (Matrix)benchmark_matrix

68.0

AIME 2024benchmark_matrix

94.0

AIME 2025 (Matrix)benchmark_matrix

94.0

BRUMO 2025benchmark_matrix

97.5

Chatbot Arena ELO (Matrix)benchmark_matrix

1465.0

CMIMC 2025benchmark_matrix

84.4

Codeforces Ratingbenchmark_matrix

2650.0

GPQA Diamond (Matrix)benchmark_matrix

91.0

HLE (Matrix)benchmark_matrix

44.4

HMMT Feb 2025benchmark_matrix

90.0

HMMT Nov 2025benchmark_matrix

93.3

HumanEvalbenchmark_matrix

95.0

IFEvalbenchmark_matrix

91.0

IMO 2025benchmark_matrix

11.9

LiveCodeBench (Matrix)benchmark_matrix

82.0

MATH-500 (Matrix)benchmark_matrix

98.5

MathArena Apex 2025benchmark_matrix

5.2

MMLUbenchmark_matrix

94.0

MMLU-Pro (Matrix)benchmark_matrix

85.3

MMMU-Probenchmark_matrix

81.0

OSWorldbenchmark_matrix

52.0

SimpleQAbenchmark_matrix

48.0

SMT 2025benchmark_matrix

84.6

SWE-bench Probenchmark_matrix

46.5

Terminal-Bench 2.0benchmark_matrix

23.1

Terminal-Bench 1.0benchmark_matrix

39.0

USAMO 2025benchmark_matrix

61.9

Video-MMUbenchmark_matrix

87.6

FrontierMathbenchmark_matrix

38.0 / 100

LiveBench Overallbenchmark_matrix

60.0 / 100

MMMUbenchmark_matrix

75.0 / 100

simpleqabenchmark_matrix

55.0

SWE-bench Verifiedbenchmark_matrix

79.0 / 100

AlpacaEval 2.0 LCPredicted

45.0 / 100

AlpacaEval 2.0 RawPredicted

34.6 / 100

BigCodeBench CompletePredicted

56.0 / 100

BigCodeBench InstructPredicted

45.7 / 100

Arena-Hard AutoPredicted

89.4

BrowseCompPredicted

62.4

CritPtPredicted

1.2

GSM8KPredicted

96.7

IFBench (Matrix)Predicted

59.8

MRCR v2Predicted

73.9

Tau-Bench Telecom (Matrix)Predicted

96.8

browsecompPredicted

58.8

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.7

CAD-EvalPredicted

2.7

GSM8K (Epoch)Predicted

1.6

GSOPredicted

0.0

HellaSwagPredicted

0.3

HlePredicted

0.2

PIQAPredicted

0.8

PosttrainbenchPredicted

0.0

The Agent CompanyPredicted

1.2

TriviaQAPredicted

9.2

VPCTPredicted

0.6

WinoGrandePredicted

1.1

GAIA Level 1Predicted

34.8

GAIA Level 2Predicted

47.7

GAIA Level 3Predicted

38.2

GAIAPredicted

30.7 / 100

LegalBenchPredicted

90.7 / 100

LongBench v2 EasyPredicted

59.5

LongBench v2 HardPredicted

51.2

LongBench v2Predicted

46.5 / 100

MathVistaPredicted

70.8 / 100

MLE-benchPredicted

37.5 / 100

MMTU Table UnderstandingPredicted

64.5 / 100

MT-BenchPredicted

8.6 / 10

NoLiMa (NIAH)Predicted

91.8 / 100

OCRBench v2Predicted

87.5 / 100

Open LLM AveragePredicted

17.7 / 100

Open LLM: BBHPredicted

51.0 / 100

Open LLM: GPQAPredicted

29.1 / 100

Open LLM: IFEvalPredicted

40.8 / 100

Open LLM: MATH Level 5Predicted

9.0 / 100

Open LLM: MMLU-PROPredicted

32.7 / 100

Open LLM: MUSRPredicted

40.8 / 100

RE-BenchPredicted

71.6

SWE-bench LitePredicted

71.3 / 100

tau-bench RetailPredicted

85.6 / 100

Vectara Factual ConsistencyPredicted

88.8 / 100

Vectara Hallucination RatePredicted

11.2 / 100

WebArenaPredicted

13.6 / 100

WildBenchPredicted

46.2

BFCL (Berkeley Function Calling)bfcl

63.0

BullshitBenchbullshitbench

56.0 / 100

Chatbot Arena ELOchatbot_arena

1491.0

Aider Polyglotepoch_ai

59.6

Apex Agentsepoch_ai

2.7

Arc Agi 2epoch_ai

0.2

BALROGepoch_ai

0.0

Chess Puzzlesepoch_ai

0.3

CyBenchepoch_ai

0.4

DeepResearchBenchepoch_ai

0.5

Epoch Capabilities Indexepoch_ai

147.4

FictionLiveBenchepoch_ai

1.0

Gdpvalepoch_ai

0.2

GeoBenchepoch_ai

0.0

Lech Mazur Writingepoch_ai

8.1

METR Time Horizonsepoch_ai

0.7

OTIS Mock AIME 2024–2025epoch_ai

0.8

Parameter Countepoch_ai

3000000000000.0

SimpleQA Verified (Epoch)epoch_ai

0.5

Training Computeepoch_ai

5.0000000000001e+26

EQ-Bench 3eqbench

1496.0

LiveBench Codinglivebench

58.5 / 100

LiveBench Data Analysislivebench

43.5 / 100

LiveBench Languagelivebench

42.0 / 100

LiveBench Mathlivebench

45.5 / 100

LiveBench Overalllivebench

39.7 / 100

LiveBench Reasoninglivebench

25.6 / 100

MedQA (USMLE)medqa

92.5

SimpleBenchsimplebench

60.5 / 100

WeirdMLweirdml

45.7 / 100