Models Agents EvalsIndustry

AgMoDB by @mistakeknot

Mistral 7B Instruct | AgMoDB

Mistral 7B Instruct

September 27, 2023Last synced Apr 7, 2026, 4:00 PM33K context

Blended Price

$0.25/M

Input Price

$0.25/M

Output Price

$0.25/M

Speed

205 tok/s

TTFT

0.29s

Benchmark Scores

Intelligence Index

External Benchmarks

AlpacaEval 2.0 LC

How Mistral 7B Instruct Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

7.4

Coding Index

—

Math Index

—

MMLU Pro

0.2 / 100

GPQA Diamond

0.2 / 100

HLE

0.0 / 100

LiveCodeBench

0.0 / 100

SciCode

0.0 / 100

MATH-500

0.1 / 100

AIME

0.0 / 30

AIME 2025

— / 30

IFBench

0.2 / 100

LCR

0.0 / 100

Terminal-Bench Hard

— / 100

τ²-Bench

0.0 / 100

alpacaeval

17.1 / 100

AlpacaEval 2.0 Rawalpacaeval

14.7 / 100

AA-Omniscience AccuracyPredicted

52.5 / 100

AA-Omniscience Hallucination RatePredicted

97.1 / 100

Aider PolyglotPredicted

13.9 / 100

AIME 2025Predicted

0.0 / 30

ARC-AGI-1Predicted

32.7 / 100

ARC-AGI-1 Cost per TaskPredicted

0.4

ARC-AGI-2Predicted

64.6 / 100

ARC-AGI-2 Cost per TaskPredicted

0.5

BFCL (Berkeley Function Calling)Predicted

19.1

AA Intelligence Index (Matrix)Predicted

46.0

AA Long Context Reasoning (Matrix)Predicted

77.8

AIME 2024Predicted

22.7

AIME 2025 (Matrix)Predicted

83.0

Arena-Hard AutoPredicted

34.0

BrowseCompPredicted

90.2

BRUMO 2025Predicted

99.8

CMIMC 2025Predicted

90.9

CritPtPredicted

21.4

GPQA Diamond (Matrix)Predicted

39.9

GSM8KPredicted

84.1

HLE (Matrix)Predicted

32.8

HMMT Feb 2025Predicted

71.5

HMMT Nov 2025Predicted

94.8

HumanEvalPredicted

48.1

IFBench (Matrix)Predicted

35.4

IFEvalPredicted

70.4

IMO 2025Predicted

50.8

LiveCodeBench (Matrix)Predicted

27.9

MATH-500 (Matrix)Predicted

87.9

MathArena Apex 2025Predicted

27.7

MMLUPredicted

55.7

MMLU-Pro (Matrix)Predicted

34.3

MMMU-ProPredicted

75.9

MRCR v2Predicted

82.7

OSWorldPredicted

35.7

SimpleQAPredicted

49.4

SMT 2025Predicted

86.8

SWE-bench ProPredicted

25.2

Tau-Bench Telecom (Matrix)Predicted

99.2

Terminal-Bench 2.0Predicted

82.5

Terminal-Bench 1.0Predicted

32.9

USAMO 2025Predicted

10.6

Video-MMUPredicted

83.3

browsecompPredicted

90.4

BullshitBenchPredicted

49.2 / 100

Aider PolyglotPredicted

0.3

Apex AgentsPredicted

5.1

Arc Agi 2Predicted

0.6

BALROGPredicted

0.0

BIG-Bench HardPredicted

3.0

CAD-EvalPredicted

12.7

Chess PuzzlesPredicted

0.4

CyBenchPredicted

0.2

DeepResearchBenchPredicted

0.4

FictionLiveBenchPredicted

0.6

GdpvalPredicted

0.7

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

4.8

GSOPredicted

2.4

HellaSwagPredicted

0.0

HlePredicted

0.2

Lech Mazur WritingPredicted

6.9

METR Time HorizonsPredicted

13.5

OTIS Mock AIME 2024–2025Predicted

0.0

PosttrainbenchPredicted

0.0

SimpleQA Verified (Epoch)Predicted

0.5

The Agent CompanyPredicted

0.7

TriviaQAPredicted

29.8

VPCTPredicted

0.3

WinoGrandePredicted

0.6

FrontierMathPredicted

30.1 / 100

GAIA Level 1Predicted

3.7

GAIA Level 2Predicted

0.2

GAIA Level 3Predicted

0.0

GAIAPredicted

2.2 / 100

LegalBenchPredicted

13.1 / 100

LiveBench CodingPredicted

79.9 / 100

LiveBench Data AnalysisPredicted

73.3 / 100

LiveBench LanguagePredicted

84.1 / 100

LiveBench MathPredicted

89.1 / 100

LiveBench OverallPredicted

77.5 / 100

LiveBench ReasoningPredicted

82.5 / 100

LongBench v2 EasyPredicted

24.4

LongBench v2 HardPredicted

20.2

LongBench v2Predicted

29.8 / 100

MathVistaPredicted

32.6 / 100

MLE-benchPredicted

46.4 / 100

MMMUPredicted

49.6 / 100

MMTU Table UnderstandingPredicted

57.2 / 100

MT-BenchPredicted

7.3 / 10

NoLiMa (NIAH)Predicted

76.7 / 100

OCRBench v2Predicted

46.6 / 100

RE-BenchPredicted

100.0

SimpleBenchPredicted

43.1 / 100

simpleqaPredicted

40.3

SWE-bench LitePredicted

6.5 / 100

SWE-bench VerifiedPredicted

56.2 / 100

tau-bench RetailPredicted

93.4 / 100

Terminal-Bench HardPredicted

0.0 / 100

Vectara Factual ConsistencyPredicted

90.7 / 100

Vectara Hallucination RatePredicted

9.3 / 100

WebArenaPredicted

0.0 / 100

WeirdMLPredicted

6.7 / 100

BigCodeBench Completebigcodebench

27.3 / 100

BigCodeBench Instructbigcodebench

19.5 / 100

BoolQepoch_ai

0.8

Epoch Capabilities Indexepoch_ai

112.2

PIQAepoch_ai

0.8

HuggingFace Downloads (30d)hf-downloads

366021.0

HuggingFace Likeshf-downloads

52.0

Open LLM Averageopen_llm_leaderboard

12.3 / 100

Open LLM: BBHopen_llm_leaderboard

32.7 / 100

Open LLM: GPQAopen_llm_leaderboard

25.9 / 100

Open LLM: IFEvalopen_llm_leaderboard

43.4 / 100

Open LLM: MATH Level 5open_llm_leaderboard

1.4 / 100

Open LLM: MMLU-PROopen_llm_leaderboard

23.6 / 100

Open LLM: MUSRopen_llm_leaderboard

39.0 / 100

WildBenchwildbench

30.7