Models Agents EvalsIndustry

AgMoDB by @mistakeknot

Llama 4 Maverick | AgMoDB

Llama 4 Maverick

April 5, 2025Last synced Apr 7, 2026, 4:00 PM1049K context

Blended Price

$0.49/M

Input Price

$0.31/M

Output Price

$0.91/M

Speed

118 tok/s

TTFT

0.47s

Benchmark Scores

Intelligence Index

External Benchmarks

AA-Omniscience Index

How Llama 4 Maverick Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

18.4

Coding Index

15.6

Math Index

19.3

MMLU Pro

0.8 / 100

GPQA Diamond

0.7 / 100

HLE

0.0 / 100

LiveCodeBench

0.4 / 100

SciCode

0.3 / 100

MATH-500

0.9 / 100

AIME

0.4 / 30

AIME 2025

0.2 / 30

IFBench

0.4 / 100

LCR

0.5 / 100

Terminal-Bench Hard

0.1 / 100

τ²-Bench

0.2 / 100

aa_omniscience

-41.8 / 100

Aider Polyglotaider

15.6 / 100

ARC-AGI-1arc_agi

4.4 / 100

ARC-AGI-1 Cost per Taskarc_agi

0.0

ARC-AGI-2arc_agi

0.0 / 100

ARC-AGI-2 Cost per Taskarc_agi

0.0

ARC-AGI-1benchmark_matrix

4.4 / 100

ARC-AGI-2benchmark_matrix

0.0 / 100

AIME 2024benchmark_matrix

52.0

Arena-Hard Autobenchmark_matrix

73.5

BigCodeBenchbenchmark_matrix

49.7

Chatbot Arena ELO (Matrix)benchmark_matrix

1417.0

CritPtbenchmark_matrix

0.0

GPQA Diamond (Matrix)benchmark_matrix

69.8

HumanEvalbenchmark_matrix

82.0

IFEvalbenchmark_matrix

84.0

LiveCodeBench (Matrix)benchmark_matrix

43.4

MATH-500 (Matrix)benchmark_matrix

88.1

MMLUbenchmark_matrix

88.6

MMLU-Pro (Matrix)benchmark_matrix

80.5

SimpleQAbenchmark_matrix

20.0

Terminal-Bench 1.0benchmark_matrix

15.5

MMMUbenchmark_matrix

73.4 / 100

simpleqabenchmark_matrix

20.0

SWE-bench Verifiedbenchmark_matrix

46.5 / 100

AA-Omniscience AccuracyPredicted

35.9 / 100

AA-Omniscience Hallucination RatePredicted

94.3 / 100

AlpacaEval 2.0 LCPredicted

42.0 / 100

AlpacaEval 2.0 RawPredicted

32.9 / 100

AA Intelligence Index (Matrix)Predicted

69.6

AA Long Context Reasoning (Matrix)Predicted

68.9

AIME 2025 (Matrix)Predicted

37.1

BrowseCompPredicted

20.3

BRUMO 2025Predicted

60.2

CMIMC 2025Predicted

60.2

GSM8KPredicted

90.4

HLE (Matrix)Predicted

30.9

HMMT Feb 2025Predicted

70.3

HMMT Nov 2025Predicted

34.8

IFBench (Matrix)Predicted

35.2

IMO 2025Predicted

8.3

MathArena Apex 2025Predicted

0.1

MMMU-ProPredicted

81.4

MRCR v2Predicted

85.7

OSWorldPredicted

28.2

SMT 2025Predicted

72.2

SWE-bench ProPredicted

24.7

Tau-Bench Telecom (Matrix)Predicted

93.4

Terminal-Bench 2.0Predicted

15.3

USAMO 2025Predicted

3.2

Video-MMUPredicted

79.5

browsecompPredicted

46.0

Aider PolyglotPredicted

0.0

Apex AgentsPredicted

1.4

BALROGPredicted

0.0

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.8

CAD-EvalPredicted

5.7

Chess PuzzlesPredicted

0.1

CyBenchPredicted

0.1

DeepResearchBenchPredicted

0.3

GdpvalPredicted

0.2

GSM8K (Epoch)Predicted

41.6

GSOPredicted

0.0

HellaSwagPredicted

19.0

METR Time HorizonsPredicted

0.2

PIQAPredicted

0.9

PosttrainbenchPredicted

0.0

SimpleQA Verified (Epoch)Predicted

0.1

The Agent CompanyPredicted

1.5

TriviaQAPredicted

2.3

VPCTPredicted

0.3

WinoGrandePredicted

1.0

FrontierMathPredicted

8.5 / 100

GAIA Level 1Predicted

50.0

GAIA Level 2Predicted

32.7

GAIA Level 3Predicted

3.0

GAIAPredicted

34.5 / 100

LegalBenchPredicted

90.5 / 100

LiveBench CodingPredicted

61.2 / 100

LiveBench Data AnalysisPredicted

33.0 / 100

LiveBench LanguagePredicted

41.7 / 100

LiveBench MathPredicted

49.5 / 100

LiveBench OverallPredicted

35.7 / 100

LiveBench ReasoningPredicted

27.0 / 100

LongBench v2 EasyPredicted

47.7

LongBench v2 HardPredicted

45.6

LongBench v2Predicted

41.1 / 100

MathVistaPredicted

62.1 / 100

MLE-benchPredicted

9.0 / 100

MMTU Table UnderstandingPredicted

46.5 / 100

MT-BenchPredicted

7.9 / 10

OCRBench v2Predicted

84.0 / 100

Open LLM AveragePredicted

17.5 / 100

Open LLM: BBHPredicted

28.0 / 100

Open LLM: GPQAPredicted

25.0 / 100

Open LLM: IFEvalPredicted

29.9 / 100

Open LLM: MATH Level 5Predicted

71.6 / 100

Open LLM: MMLU-PROPredicted

22.3 / 100

Open LLM: MUSRPredicted

45.8 / 100

RE-BenchPredicted

0.0

SWE-bench LitePredicted

18.9 / 100

tau-bench RetailPredicted

65.7 / 100

WildBenchPredicted

56.0

BFCL (Berkeley Function Calling)bfcl

37.3

BigCodeBench Completebigcodebench

61.4 / 100

BigCodeBench Instructbigcodebench

49.7 / 100

BullshitBenchbullshitbench

28.0 / 100

Arc Agi 2epoch_ai

0.0

Epoch Capabilities Indexepoch_ai

133.1

FictionLiveBenchepoch_ai

0.3

GeoBenchepoch_ai

0.0

Hleepoch_ai

0.1

Lech Mazur Writingepoch_ai

6.4

OTIS Mock AIME 2024–2025epoch_ai

0.2

EQ-Bench 3eqbench

1186.0

MMMUmmmu

73.4 / 100

NoLiMa (NIAH)nolima

90.1 / 100

SimpleBenchsimplebench

27.7 / 100

SWE-bench Verifiedswebench

21.0 / 100

Vectara Factual Consistencyvectara_hallucination

91.8 / 100

Vectara Hallucination Ratevectara_hallucination

8.2 / 100

WebArenawebarena

7.1 / 100

WeirdMLweirdml

24.5 / 100