Models Agents EvalsIndustry

AgMoDB by @mistakeknot

Cohere: Command R7B (12-2024) | AgMoDB

Cohere: Command R7B (12-2024)

Last synced Apr 7, 2026, 2:04 PM128K context

Blended Price

$0.066/M

Input Price

$0.037/M

Output Price

$0.15/M

Speed

—

TTFT

—

Benchmark Scores

Intelligence Index

External Benchmarks

AlpacaEval 2.0 LC

How Cohere: Command R7B (12-2024) Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

—

Coding Index

—

Math Index

—

MMLU Pro

— / 100

GPQA Diamond

— / 100

HLE

— / 100

LiveCodeBench

— / 100

SciCode

— / 100

MATH-500

— / 100

AIME

— / 30

AIME 2025

— / 30

IFBench

— / 100

LCR

— / 100

Terminal-Bench Hard

— / 100

τ²-Bench

— / 100

alpacaeval

10.9 / 100

AlpacaEval 2.0 Rawalpacaeval

12.9 / 100

AA-Omniscience AccuracyPredicted

50.5 / 100

AA-Omniscience Hallucination RatePredicted

97.6 / 100

Aider PolyglotPredicted

46.5 / 100

AIMEPredicted

0.0 / 30

AIME 2025Predicted

0.1 / 30

ARC-AGI-1Predicted

86.1 / 100

ARC-AGI-1 Cost per TaskPredicted

1.3

ARC-AGI-2Predicted

56.3 / 100

ARC-AGI-2 Cost per TaskPredicted

2.2

BigCodeBench CompletePredicted

26.9 / 100

BigCodeBench InstructPredicted

20.9 / 100

AA Intelligence Index (Matrix)Predicted

55.7

AA Long Context Reasoning (Matrix)Predicted

77.8

AIME 2024Predicted

73.4

AIME 2025 (Matrix)Predicted

98.6

Arena-Hard AutoPredicted

39.6

BrowseCompPredicted

87.8

BRUMO 2025Predicted

99.8

CMIMC 2025Predicted

95.7

CritPtPredicted

24.9

GPQA Diamond (Matrix)Predicted

68.4

GSM8KPredicted

84.1

HLE (Matrix)Predicted

43.5

HMMT Feb 2025Predicted

89.1

HMMT Nov 2025Predicted

94.7

HumanEvalPredicted

83.8

IFBench (Matrix)Predicted

31.2

IFEvalPredicted

83.1

IMO 2025Predicted

55.1

LiveCodeBench (Matrix)Predicted

55.6

MATH-500 (Matrix)Predicted

91.4

MathArena Apex 2025Predicted

22.5

MMLUPredicted

82.7

MMLU-Pro (Matrix)Predicted

73.5

MMMU-ProPredicted

76.9

MRCR v2Predicted

82.7

OSWorldPredicted

43.1

SimpleQAPredicted

61.0

SMT 2025Predicted

94.9

SWE-bench ProPredicted

58.9

Tau-Bench Telecom (Matrix)Predicted

99.1

Terminal-Bench 2.0Predicted

79.7

Terminal-Bench 1.0Predicted

42.1

USAMO 2025Predicted

19.6

Video-MMUPredicted

84.3

browsecompPredicted

89.7

BullshitBenchPredicted

54.0 / 100

Aider PolyglotPredicted

0.1

Apex AgentsPredicted

4.5

Arc Agi 2Predicted

0.6

BALROGPredicted

0.0

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.8

CAD-EvalPredicted

12.6

Chess PuzzlesPredicted

0.4

CyBenchPredicted

0.2

DeepResearchBenchPredicted

0.5

FictionLiveBenchPredicted

0.6

GdpvalPredicted

0.7

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

0.0

GSOPredicted

0.6

HellaSwagPredicted

0.0

HlePredicted

0.2

Lech Mazur WritingPredicted

7.7

METR Time HorizonsPredicted

27.2

OTIS Mock AIME 2024–2025Predicted

0.1

PIQAPredicted

0.8

PosttrainbenchPredicted

0.0

SimpleQA Verified (Epoch)Predicted

0.5

The Agent CompanyPredicted

1.3

TriviaQAPredicted

16.8

VPCTPredicted

0.4

WinoGrandePredicted

0.7

FrontierMathPredicted

47.4 / 100

GAIA Level 1Predicted

21.1

GAIA Level 2Predicted

2.8

GAIA Level 3Predicted

0.0

GAIAPredicted

12.5 / 100

GPQA DiamondPredicted

0.5 / 100

HLEPredicted

0.1 / 100

IFBenchPredicted

0.4 / 100

LCRPredicted

0.0 / 100

LegalBenchPredicted

29.8 / 100

LiveBench CodingPredicted

79.7 / 100

LiveBench Data AnalysisPredicted

73.5 / 100

LiveBench LanguagePredicted

84.1 / 100

LiveBench MathPredicted

88.9 / 100

LiveBench OverallPredicted

77.9 / 100

LiveBench ReasoningPredicted

83.3 / 100

LiveCodeBenchPredicted

0.1 / 100

LongBench v2 EasyPredicted

36.2

LongBench v2 HardPredicted

29.0

LongBench v2Predicted

27.1 / 100

MATH-500Predicted

0.4 / 100

MathVistaPredicted

27.0 / 100

MedQA (USMLE)Predicted

78.9

MLE-benchPredicted

72.0 / 100

MMLU ProPredicted

0.5 / 100

MMMUPredicted

67.0 / 100

MMTU Table UnderstandingPredicted

57.7 / 100

MT-BenchPredicted

7.7 / 10

NoLiMa (NIAH)Predicted

85.3 / 100

OCRBench v2Predicted

67.0 / 100

Open LLM AveragePredicted

12.9 / 100

Open LLM: BBHPredicted

36.0 / 100

Open LLM: GPQAPredicted

25.7 / 100

Open LLM: IFEvalPredicted

42.3 / 100

Open LLM: MATH Level 5Predicted

4.0 / 100

Open LLM: MMLU-PROPredicted

21.1 / 100

Open LLM: MUSRPredicted

36.3 / 100

RE-BenchPredicted

100.0

SciCodePredicted

0.0 / 100

SimpleBenchPredicted

34.1 / 100

simpleqaPredicted

49.8

SWE-bench LitePredicted

20.6 / 100

SWE-bench VerifiedPredicted

65.1 / 100

τ²-BenchPredicted

0.1 / 100

tau-bench RetailPredicted

93.1 / 100

Terminal-Bench HardPredicted

0.0 / 100

Vectara Factual ConsistencyPredicted

85.2 / 100

Vectara Hallucination RatePredicted

14.8 / 100

WebArenaPredicted

0.0 / 100

WeirdMLPredicted

36.5 / 100

WildBenchPredicted

27.5

BFCL (Berkeley Function Calling)bfcl

32.1