Models Agents EvalsIndustry

AgMoDB by @mistakeknot

Mistral: Mistral 7B Instruct v0.3 | AgMoDB

Mistral: Mistral 7B Instruct v0.3

Last synced Mar 3, 2026, 12:08 AM33K context

Blended Price

$0.20/M

Input Price

$0.20/M

Output Price

$0.20/M

Speed

—

TTFT

—

Benchmark Scores

Intelligence Index

External Benchmarks

AlpacaEval 2.0 LC

How Mistral: Mistral 7B Instruct v0.3 Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

—

Coding Index

—

Math Index

—

MMLU Pro

— / 100

GPQA Diamond

— / 100

HLE

— / 100

LiveCodeBench

— / 100

SciCode

— / 100

MATH-500

— / 100

AIME

— / 30

AIME 2025

— / 30

IFBench

— / 100

LCR

— / 100

Terminal-Bench Hard

— / 100

τ²-Bench

— / 100

alpacaeval

20.6 / 100

AlpacaEval 2.0 Rawalpacaeval

16.7 / 100

AA-Omniscience AccuracyPredicted

48.9 / 100

AA-Omniscience Hallucination RatePredicted

97.0 / 100

Aider PolyglotPredicted

29.9 / 100

AIMEPredicted

0.0 / 30

AIME 2025Predicted

0.0 / 30

ARC-AGI-1Predicted

30.0 / 100

ARC-AGI-1 Cost per TaskPredicted

0.3

ARC-AGI-2Predicted

7.3 / 100

ARC-AGI-2 Cost per TaskPredicted

0.3

BFCL (Berkeley Function Calling)Predicted

28.8

AA Intelligence Index (Matrix)Predicted

53.0

AA Long Context Reasoning (Matrix)Predicted

76.3

AIME 2024Predicted

70.4

AIME 2025 (Matrix)Predicted

92.1

Arena-Hard AutoPredicted

43.2

BrowseCompPredicted

84.5

BRUMO 2025Predicted

99.5

CMIMC 2025Predicted

92.4

CritPtPredicted

8.6

GPQA Diamond (Matrix)Predicted

58.2

GSM8KPredicted

89.5

HLE (Matrix)Predicted

34.1

HMMT Feb 2025Predicted

77.2

HMMT Nov 2025Predicted

93.8

HumanEvalPredicted

79.0

IFBench (Matrix)Predicted

42.1

IFEvalPredicted

73.7

IMO 2025Predicted

41.6

LiveCodeBench (Matrix)Predicted

45.3

MATH-500 (Matrix)Predicted

92.4

MathArena Apex 2025Predicted

12.4

MMLUPredicted

79.3

MMLU-Pro (Matrix)Predicted

67.3

MMMU-ProPredicted

78.0

MRCR v2Predicted

81.0

OSWorldPredicted

74.2

SimpleQAPredicted

42.8

SMT 2025Predicted

83.4

SWE-bench ProPredicted

54.6

Tau-Bench Telecom (Matrix)Predicted

98.8

Terminal-Bench 2.0Predicted

69.0

Terminal-Bench 1.0Predicted

31.9

USAMO 2025Predicted

12.8

Video-MMUPredicted

84.4

browsecompPredicted

85.9

BullshitBenchPredicted

33.2 / 100

Aider PolyglotPredicted

0.1

Apex AgentsPredicted

4.0

Arc Agi 2Predicted

0.1

BALROGPredicted

0.0

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.8

CAD-EvalPredicted

10.8

Chess PuzzlesPredicted

0.3

CyBenchPredicted

0.2

DeepResearchBenchPredicted

0.4

FictionLiveBenchPredicted

0.6

GdpvalPredicted

0.5

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

0.0

GSOPredicted

0.4

HellaSwagPredicted

0.0

HlePredicted

0.2

Lech Mazur WritingPredicted

7.3

METR Time HorizonsPredicted

9.4

OTIS Mock AIME 2024–2025Predicted

0.1

PIQAPredicted

0.8

PosttrainbenchPredicted

0.0

SimpleQA Verified (Epoch)Predicted

0.5

The Agent CompanyPredicted

1.1

TriviaQAPredicted

18.3

VPCTPredicted

0.2

WinoGrandePredicted

0.7

FrontierMathPredicted

32.6 / 100

GAIA Level 1Predicted

15.1

GAIA Level 2Predicted

1.8

GAIA Level 3Predicted

0.0

GAIAPredicted

8.9 / 100

GPQA DiamondPredicted

0.4 / 100

HLEPredicted

0.0 / 100

IFBenchPredicted

0.3 / 100

LCRPredicted

0.0 / 100

LegalBenchPredicted

34.8 / 100

LiveBench CodingPredicted

76.9 / 100

LiveBench Data AnalysisPredicted

66.8 / 100

LiveBench LanguagePredicted

78.4 / 100

LiveBench MathPredicted

84.4 / 100

LiveBench OverallPredicted

71.2 / 100

LiveBench ReasoningPredicted

75.0 / 100

LiveCodeBenchPredicted

0.1 / 100

LongBench v2 EasyPredicted

34.1

LongBench v2 HardPredicted

28.3

LongBench v2Predicted

31.0 / 100

MATH-500Predicted

0.4 / 100

MathVistaPredicted

35.1 / 100

MedQA (USMLE)Predicted

71.0

MLE-benchPredicted

42.7 / 100

MMLU ProPredicted

0.4 / 100

MMMUPredicted

61.7 / 100

MMTU Table UnderstandingPredicted

55.9 / 100

MT-BenchPredicted

6.5 / 10

NoLiMa (NIAH)Predicted

85.2 / 100

OCRBench v2Predicted

62.0 / 100

RE-BenchPredicted

99.9

SciCodePredicted

0.0 / 100

SimpleBenchPredicted

39.8 / 100

simpleqaPredicted

36.4

SWE-bench LitePredicted

14.1 / 100

SWE-bench VerifiedPredicted

52.0 / 100

τ²-BenchPredicted

0.0 / 100

tau-bench RetailPredicted

90.9 / 100

Terminal-Bench HardPredicted

0.0 / 100

Vectara Factual ConsistencyPredicted

87.8 / 100

Vectara Hallucination RatePredicted

12.2 / 100

WebArenaPredicted

0.1 / 100

WeirdMLPredicted

26.7 / 100

WildBenchPredicted

30.7

BigCodeBench Completebigcodebench

27.3 / 100

BigCodeBench Instructbigcodebench

19.5 / 100

Epoch Capabilities Indexepoch_ai

112.1

Open LLM Averageopen_llm_leaderboard

19.2 / 100

Open LLM: BBHopen_llm_leaderboard

47.2 / 100

Open LLM: GPQAopen_llm_leaderboard

27.9 / 100

Open LLM: IFEvalopen_llm_leaderboard

54.7 / 100

Open LLM: MATH Level 5open_llm_leaderboard

3.9 / 100

Open LLM: MMLU-PROopen_llm_leaderboard

30.8 / 100

Open LLM: MUSRopen_llm_leaderboard

37.4 / 100