Models Agents EvalsIndustry

AgMoDB by @mistakeknot

Anthropic: Claude Sonnet 4.5 | AgMoDB

Anthropic: Claude Sonnet 4.5

Last synced Apr 7, 2026, 2:03 PM1000K context

Blended Price

$6.00/M

Input Price

$3.00/M

Output Price

$15.00/M

Speed

—

TTFT

—

Benchmark Scores

Intelligence Index

External Benchmarks

AlpacaEval 2.0 LC

How Anthropic: Claude Sonnet 4.5 Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

—

Coding Index

—

Math Index

—

MMLU Pro

— / 100

GPQA Diamond

— / 100

HLE

— / 100

LiveCodeBench

— / 100

SciCode

— / 100

MATH-500

— / 100

AIME

— / 30

AIME 2025

— / 30

IFBench

— / 100

LCR

— / 100

Terminal-Bench Hard

— / 100

τ²-Bench

— / 100

alpacaeval

27.3 / 100

AlpacaEval 2.0 Rawalpacaeval

17.0 / 100

ARC-AGI-1arc_agi

25.5 / 100

ARC-AGI-1 Cost per Taskarc_agi

0.1

ARC-AGI-2arc_agi

3.8 / 100

ARC-AGI-2 Cost per Taskarc_agi

0.1

ARC-AGI-1benchmark_matrix

63.7 / 100

ARC-AGI-2benchmark_matrix

13.6 / 100

AIME 2024benchmark_matrix

88.0

AIME 2025 (Matrix)benchmark_matrix

87.0

Arena-Hard Autobenchmark_matrix

51.6

BRUMO 2025benchmark_matrix

90.8

CMIMC 2025benchmark_matrix

66.9

Codeforces Ratingbenchmark_matrix

1480.0

GPQA Diamond (Matrix)benchmark_matrix

83.4

HLE (Matrix)benchmark_matrix

19.8

HMMT Feb 2025benchmark_matrix

79.2

HumanEvalbenchmark_matrix

85.0

IFBench (Matrix)benchmark_matrix

42.3

IFEvalbenchmark_matrix

88.5

LiveCodeBench (Matrix)benchmark_matrix

68.0

MATH-500 (Matrix)benchmark_matrix

95.8

MathArena Apex 2025benchmark_matrix

1.6

MMLUbenchmark_matrix

86.5

MMLU-Pro (Matrix)benchmark_matrix

87.5

MMMU-Probenchmark_matrix

63.4

MRCR v2benchmark_matrix

10.8

OSWorldbenchmark_matrix

61.4

SimpleQAbenchmark_matrix

47.0

SMT 2025benchmark_matrix

84.0

SWE-bench Probenchmark_matrix

43.6

Tau-Bench Telecom (Matrix)benchmark_matrix

98.0

Terminal-Bench 2.0benchmark_matrix

42.8

Terminal-Bench 1.0benchmark_matrix

51.0

LiveBench Overallbenchmark_matrix

53.7 / 100

MMMUbenchmark_matrix

77.8 / 100

simpleqabenchmark_matrix

47.0

SWE-bench Verifiedbenchmark_matrix

77.2 / 100

tau-bench Retailbenchmark_matrix

86.2 / 100

AA-Omniscience AccuracyPredicted

41.6 / 100

AA-Omniscience Hallucination RatePredicted

96.7 / 100

Aider PolyglotPredicted

72.8 / 100

AIMEPredicted

0.1 / 30

AIME 2025Predicted

0.5 / 30

BFCL (Berkeley Function Calling)Predicted

27.9

BigCodeBench CompletePredicted

48.7 / 100

BigCodeBench InstructPredicted

38.1 / 100

AA Intelligence Index (Matrix)Predicted

55.3

AA Long Context Reasoning (Matrix)Predicted

75.7

BrowseCompPredicted

71.4

CritPtPredicted

1.9

GSM8KPredicted

92.3

HMMT Nov 2025Predicted

91.7

IMO 2025Predicted

33.9

USAMO 2025Predicted

26.6

Video-MMUPredicted

85.9

browsecompPredicted

78.5

Aider PolyglotPredicted

0.1

Apex AgentsPredicted

2.7

Arc Agi 2Predicted

0.4

BALROGPredicted

0.0

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.7

CAD-EvalPredicted

61.7

Chess PuzzlesPredicted

0.2

CyBenchPredicted

0.6

DeepResearchBenchPredicted

0.4

FictionLiveBenchPredicted

0.8

GdpvalPredicted

0.4

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

2.6

GSOPredicted

0.0

HellaSwagPredicted

0.1

HlePredicted

0.1

Lech Mazur WritingPredicted

8.4

METR Time HorizonsPredicted

4.2

OTIS Mock AIME 2024–2025Predicted

0.6

PIQAPredicted

0.8

PosttrainbenchPredicted

0.0

SimpleQA Verified (Epoch)Predicted

0.4

The Agent CompanyPredicted

1.1

TriviaQAPredicted

6.2

VPCTPredicted

0.3

WinoGrandePredicted

1.2

FrontierMathPredicted

22.5 / 100

GAIA Level 1Predicted

57.2

GAIA Level 2Predicted

37.1

GAIA Level 3Predicted

13.0

GAIAPredicted

40.1 / 100

GPQA DiamondPredicted

0.6 / 100

HLEPredicted

0.2 / 100

IFBenchPredicted

0.4 / 100

LCRPredicted

0.4 / 100

LiveCodeBenchPredicted

0.5 / 100

LongBench v2 EasyPredicted

48.0

LongBench v2 HardPredicted

41.1

LongBench v2Predicted

37.4 / 100

MATH-500Predicted

0.9 / 100

MathVistaPredicted

66.2 / 100

MedQA (USMLE)Predicted

90.3

MLE-benchPredicted

41.2 / 100

MMLU ProPredicted

0.7 / 100

MMTU Table UnderstandingPredicted

62.3 / 100

NoLiMa (NIAH)Predicted

92.3 / 100

OCRBench v2Predicted

85.4 / 100

Open LLM AveragePredicted

9.8 / 100

Open LLM: BBHPredicted

29.5 / 100

Open LLM: GPQAPredicted

26.6 / 100

Open LLM: IFEvalPredicted

22.5 / 100

Open LLM: MATH Level 5Predicted

5.2 / 100

Open LLM: MMLU-PROPredicted

16.3 / 100

Open LLM: MUSRPredicted

36.0 / 100

RE-BenchPredicted

95.9

SciCodePredicted

0.3 / 100

SimpleBenchPredicted

55.4 / 100

SWE-bench LitePredicted

31.6 / 100

τ²-BenchPredicted

0.4 / 100

Terminal-Bench HardPredicted

0.2 / 100

WebArenaPredicted

1.1 / 100

WildBenchPredicted

42.7

BullshitBenchbullshitbench

79.0 / 100

Epoch Capabilities Indexepoch_ai

147.1

EQ-Bench 3eqbench

1533.0

LegalBenchlegalbench

84.1 / 100

LiveBench Codinglivebench

76.1 / 100

LiveBench Data Analysislivebench

47.0 / 100

LiveBench Languagelivebench

76.0 / 100

LiveBench Mathlivebench

62.6 / 100

LiveBench Overalllivebench

53.7 / 100

LiveBench Reasoninglivebench

42.3 / 100

MMMUmmmu

77.8 / 100

MT-Benchmtbench

7.9 / 10

OpenRouter Token Volumeopenrouter_rankings

266000000000.0

OpenRouter Weekly Trendopenrouter_rankings

21.0

SWE-bench Verifiedswebench

73.0 / 100

Vectara Factual Consistencyvectara_hallucination

88.0 / 100

Vectara Hallucination Ratevectara_hallucination

12.0 / 100

WeirdMLweirdml

47.7 / 100