Models Agents EvalsIndustry

AgMoDB by @mistakeknot

Mixtral 8x22B Instruct | AgMoDB

Mixtral 8x22B Instruct

April 17, 2024Last synced Apr 7, 2026, 4:00 PM

Blended Price

Free/M

Input Price

Free/M

Output Price

Free/M

Speed

0 tok/s

TTFT

0.00s

Benchmark Scores

Intelligence Index

External Benchmarks

AlpacaEval 2.0 LC

How Mixtral 8x22B Instruct Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

9.8

Coding Index

—

Math Index

—

MMLU Pro

0.5 / 100

GPQA Diamond

0.3 / 100

HLE

0.0 / 100

LiveCodeBench

0.1 / 100

SciCode

0.2 / 100

MATH-500

0.5 / 100

AIME

0.0 / 30

AIME 2025

— / 30

IFBench

— / 100

LCR

— / 100

Terminal-Bench Hard

— / 100

τ²-Bench

— / 100

alpacaeval

30.9 / 100

AlpacaEval 2.0 Rawalpacaeval

22.2 / 100

AA-Omniscience AccuracyPredicted

43.9 / 100

AA-Omniscience Hallucination RatePredicted

94.9 / 100

Aider PolyglotPredicted

9.8 / 100

AIME 2025Predicted

0.0 / 30

ARC-AGI-1Predicted

5.0 / 100

ARC-AGI-1 Cost per TaskPredicted

0.0

ARC-AGI-2Predicted

0.0 / 100

ARC-AGI-2 Cost per TaskPredicted

0.0

BFCL (Berkeley Function Calling)Predicted

25.6

AA Intelligence Index (Matrix)Predicted

80.0

AA Long Context Reasoning (Matrix)Predicted

58.6

AIME 2024Predicted

18.0

AIME 2025 (Matrix)Predicted

18.3

Arena-Hard AutoPredicted

47.3

BrowseCompPredicted

28.1

BRUMO 2025Predicted

89.9

CMIMC 2025Predicted

89.3

CritPtPredicted

0.4

GPQA Diamond (Matrix)Predicted

38.7

GSM8KPredicted

68.1

HLE (Matrix)Predicted

64.0

HMMT Feb 2025Predicted

31.1

HMMT Nov 2025Predicted

90.3

HumanEvalPredicted

76.0

IFBench (Matrix)Predicted

25.9

IFEvalPredicted

77.7

IMO 2025Predicted

14.8

LiveCodeBench (Matrix)Predicted

28.7

MATH-500 (Matrix)Predicted

91.0

MathArena Apex 2025Predicted

1.8

MMLUPredicted

74.4

MMLU-Pro (Matrix)Predicted

57.7

MMMU-ProPredicted

80.5

MRCR v2Predicted

76.1

OSWorldPredicted

24.2

SimpleQAPredicted

24.3

SMT 2025Predicted

73.4

SWE-bench ProPredicted

17.6

Tau-Bench Telecom (Matrix)Predicted

96.7

Terminal-Bench 2.0Predicted

13.6

Terminal-Bench 1.0Predicted

26.0

USAMO 2025Predicted

1.8

Video-MMUPredicted

93.4

browsecompPredicted

77.3

BullshitBenchPredicted

65.4 / 100

Aider PolyglotPredicted

0.0

Apex AgentsPredicted

2.2

Arc Agi 2Predicted

3.4

BALROGPredicted

0.0

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.9

CAD-EvalPredicted

10.3

Chess PuzzlesPredicted

0.2

DeepResearchBenchPredicted

0.3

FictionLiveBenchPredicted

0.4

GdpvalPredicted

0.1

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

5.2

GSOPredicted

0.0

HellaSwagPredicted

5.4

HlePredicted

0.2

Lech Mazur WritingPredicted

6.6

METR Time HorizonsPredicted

0.3

OTIS Mock AIME 2024–2025Predicted

0.0

PIQAPredicted

0.8

PosttrainbenchPredicted

60.0

SimpleQA Verified (Epoch)Predicted

0.4

The Agent CompanyPredicted

0.8

TriviaQAPredicted

5.4

VPCTPredicted

0.2

WinoGrandePredicted

0.7

FrontierMathPredicted

45.2 / 100

GAIA Level 1Predicted

10.1

GAIA Level 2Predicted

1.5

GAIA Level 3Predicted

0.0

GAIAPredicted

6.1 / 100

IFBenchPredicted

0.2 / 100

LCRPredicted

0.1 / 100

LegalBenchPredicted

63.0 / 100

LiveBench CodingPredicted

67.9 / 100

LiveBench Data AnalysisPredicted

46.1 / 100

LiveBench LanguagePredicted

57.0 / 100

LiveBench MathPredicted

65.6 / 100

LiveBench OverallPredicted

20.8 / 100

LiveBench ReasoningPredicted

43.8 / 100

LongBench v2 EasyPredicted

32.0

LongBench v2 HardPredicted

30.6

LongBench v2Predicted

29.1 / 100

MathVistaPredicted

44.8 / 100

MLE-benchPredicted

15.6 / 100

MMMUPredicted

52.4 / 100

MMTU Table UnderstandingPredicted

61.6 / 100

MT-BenchPredicted

8.0 / 10

NoLiMa (NIAH)Predicted

87.0 / 100

OCRBench v2Predicted

72.3 / 100

RE-BenchPredicted

4.5

SimpleBenchPredicted

24.2 / 100

simpleqaPredicted

22.0

SWE-bench LitePredicted

6.7 / 100

SWE-bench VerifiedPredicted

29.1 / 100

τ²-BenchPredicted

0.1 / 100

tau-bench RetailPredicted

81.1 / 100

Terminal-Bench HardPredicted

0.0 / 100

Vectara Factual ConsistencyPredicted

92.9 / 100

Vectara Hallucination RatePredicted

7.1 / 100

WebArenaPredicted

1.3 / 100

WildBenchPredicted

42.2

BigCodeBench Completebigcodebench

50.2 / 100

BigCodeBench Instructbigcodebench

40.6 / 100

CyBenchepoch_ai

0.1

Epoch Capabilities Indexepoch_ai

121.3

Open LLM Averageopen_llm_leaderboard

33.9 / 100

Open LLM: BBHopen_llm_leaderboard

61.2 / 100

Open LLM: GPQAopen_llm_leaderboard

37.3 / 100

Open LLM: IFEvalopen_llm_leaderboard

71.8 / 100

Open LLM: MATH Level 5open_llm_leaderboard

18.7 / 100

Open LLM: MMLU-PROopen_llm_leaderboard

44.8 / 100

Open LLM: MUSRopen_llm_leaderboard

43.1 / 100

WeirdMLweirdml

3.2 / 100