Models Agents EvalsIndustry

AgMoDB by @mistakeknot

Meta: Llama 3.1 405B Instruct | AgMoDB

Meta: Llama 3.1 405B Instruct

Last synced Mar 16, 2026, 7:04 AM131K context

Blended Price

$4.00/M

Input Price

$4.00/M

Output Price

$4.00/M

Speed

—

TTFT

—

Benchmark Scores

Intelligence Index

External Benchmarks

AlpacaEval 2.0 LC

How Meta: Llama 3.1 405B Instruct Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

—

Coding Index

—

Math Index

—

MMLU Pro

— / 100

GPQA Diamond

— / 100

HLE

— / 100

LiveCodeBench

— / 100

SciCode

— / 100

MATH-500

— / 100

AIME

— / 30

AIME 2025

— / 30

IFBench

— / 100

LCR

— / 100

Terminal-Bench Hard

— / 100

τ²-Bench

— / 100

alpacaeval

39.3 / 100

AlpacaEval 2.0 Rawalpacaeval

39.1 / 100

AA-Omniscience AccuracyPredicted

38.4 / 100

AA-Omniscience Hallucination RatePredicted

96.8 / 100

Aider PolyglotPredicted

24.0 / 100

AIMEPredicted

0.5 / 30

AIME 2025Predicted

0.2 / 30

ARC-AGI-1Predicted

12.6 / 100

ARC-AGI-1 Cost per TaskPredicted

0.1

ARC-AGI-2Predicted

0.0 / 100

ARC-AGI-2 Cost per TaskPredicted

0.0

BFCL (Berkeley Function Calling)Predicted

38.7

BigCodeBench CompletePredicted

61.7 / 100

BigCodeBench InstructPredicted

51.5 / 100

AA Intelligence Index (Matrix)Predicted

83.8

AA Long Context Reasoning (Matrix)Predicted

68.7

AIME 2024Predicted

76.8

AIME 2025 (Matrix)Predicted

52.7

Arena-Hard AutoPredicted

69.2

BrowseCompPredicted

20.2

BRUMO 2025Predicted

56.8

CMIMC 2025Predicted

58.5

CritPtPredicted

2.0

GPQA Diamond (Matrix)Predicted

60.0

GSM8KPredicted

89.2

HLE (Matrix)Predicted

12.0

HMMT Feb 2025Predicted

48.9

HMMT Nov 2025Predicted

86.8

HumanEvalPredicted

88.1

IFBench (Matrix)Predicted

31.1

IFEvalPredicted

87.0

IMO 2025Predicted

7.7

LiveCodeBench (Matrix)Predicted

58.7

MATH-500 (Matrix)Predicted

93.5

MathArena Apex 2025Predicted

0.3

MMLUPredicted

85.9

MMLU-Pro (Matrix)Predicted

70.7

MMMU-ProPredicted

81.2

MRCR v2Predicted

72.5

OSWorldPredicted

32.0

SimpleQAPredicted

25.2

SMT 2025Predicted

71.0

SWE-bench ProPredicted

31.6

Tau-Bench Telecom (Matrix)Predicted

93.2

Terminal-Bench 2.0Predicted

5.7

Terminal-Bench 1.0Predicted

11.3

USAMO 2025Predicted

1.9

Video-MMUPredicted

86.6

browsecompPredicted

62.7

BullshitBenchPredicted

8.9 / 100

Aider PolyglotPredicted

0.0

Apex AgentsPredicted

1.8

Arc Agi 2Predicted

0.0

BALROGPredicted

0.0

BoolQPredicted

0.9

CAD-EvalPredicted

7.4

Chess PuzzlesPredicted

0.1

DeepResearchBenchPredicted

0.6

FictionLiveBenchPredicted

0.3

GdpvalPredicted

0.1

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

45.6

GSOPredicted

0.0

HlePredicted

0.0

Lech Mazur WritingPredicted

7.0

METR Time HorizonsPredicted

0.7

PosttrainbenchPredicted

0.0

SimpleQA Verified (Epoch)Predicted

0.3

VPCTPredicted

0.3

FrontierMathPredicted

8.2 / 100

GAIA Level 1Predicted

36.8

GAIA Level 2Predicted

20.3

GAIA Level 3Predicted

1.0

GAIAPredicted

23.9 / 100

GPQA DiamondPredicted

0.5 / 100

HLEPredicted

0.0 / 100

IFBenchPredicted

0.3 / 100

LCRPredicted

0.1 / 100

LegalBenchPredicted

75.6 / 100

LiveBench CodingPredicted

60.8 / 100

LiveBench Data AnalysisPredicted

33.2 / 100

LiveBench LanguagePredicted

40.7 / 100

LiveBench MathPredicted

60.1 / 100

LiveBench OverallPredicted

34.8 / 100

LiveBench ReasoningPredicted

25.9 / 100

LiveCodeBenchPredicted

0.3 / 100

LongBench v2 EasyPredicted

45.1

LongBench v2 HardPredicted

44.4

LongBench v2Predicted

40.0 / 100

MATH-500Predicted

0.9 / 100

MathVistaPredicted

53.9 / 100

MedQA (USMLE)Predicted

78.3

MMLU ProPredicted

0.7 / 100

MMMUPredicted

66.3 / 100

MMTU Table UnderstandingPredicted

46.6 / 100

MT-BenchPredicted

7.9 / 10

OCRBench v2Predicted

78.7 / 100

Open LLM AveragePredicted

45.4 / 100

Open LLM: BBHPredicted

70.2 / 100

Open LLM: GPQAPredicted

38.9 / 100

Open LLM: IFEvalPredicted

72.9 / 100

Open LLM: MATH Level 5Predicted

50.1 / 100

Open LLM: MMLU-PROPredicted

56.7 / 100

Open LLM: MUSRPredicted

45.9 / 100

RE-BenchPredicted

0.0

SciCodePredicted

0.3 / 100

simpleqaPredicted

17.1

SWE-bench LitePredicted

58.0 / 100

SWE-bench VerifiedPredicted

32.6 / 100

τ²-BenchPredicted

0.1 / 100

tau-bench RetailPredicted

65.1 / 100

Terminal-Bench HardPredicted

0.0 / 100

Vectara Factual ConsistencyPredicted

94.6 / 100

Vectara Hallucination RatePredicted

5.4 / 100

WebArenaPredicted

64.0 / 100

WildBenchPredicted

55.9

BIG-Bench Hardepoch_ai

3.0

CyBenchepoch_ai

0.1

Epoch Capabilities Indexepoch_ai

128.0

HellaSwagepoch_ai

10.0

OpenBookQAepoch_ai

0.5

OTIS Mock AIME 2024–2025epoch_ai

0.1

Parameter Countepoch_ai

405000000000.0

PIQAepoch_ai

0.9

The Agent Companyepoch_ai

3.2

Training Computeepoch_ai

3.8e+25

TriviaQAepoch_ai

5.0

WinoGrandeepoch_ai

0.8

MLE-benchmlebench

3.3 / 100

NoLiMa (NIAH)nolima

94.7 / 100

SimpleBenchsimplebench

23.0 / 100

WeirdMLweirdml

21.4 / 100