Models Agents EvalsIndustry

AgMoDB by @mistakeknot

DeepSeek V3.1 (Reasoning) | AgMoDB

DeepSeek V3.1 (Reasoning)

August 21, 2025Last synced Apr 7, 2026, 4:00 PM

Blended Price

$0.88/M

Input Price

$0.60/M

Output Price

$1.70/M

Speed

0 tok/s

TTFT

0.00s

Benchmark Scores

Intelligence Index

External Benchmarks

AA-Omniscience Accuracy

How DeepSeek V3.1 (Reasoning) Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

27.7

Coding Index

29.7

Math Index

89.7

MMLU Pro

0.9 / 100

GPQA Diamond

0.8 / 100

HLE

0.1 / 100

LiveCodeBench

0.8 / 100

SciCode

0.4 / 100

MATH-500

— / 100

AIME

— / 30

AIME 2025

0.9 / 30

IFBench

0.4 / 100

LCR

0.5 / 100

Terminal-Bench Hard

0.3 / 100

τ²-Bench

0.4 / 100

Predicted

38.3 / 100

AA-Omniscience Hallucination RatePredicted

95.9 / 100

Aider PolyglotPredicted

64.5 / 100

AIMEPredicted

0.9 / 30

AlpacaEval 2.0 LCPredicted

37.5 / 100

AlpacaEval 2.0 RawPredicted

29.2 / 100

ARC-AGI-1Predicted

14.7 / 100

ARC-AGI-1 Cost per TaskPredicted

0.1

ARC-AGI-2Predicted

0.1 / 100

ARC-AGI-2 Cost per TaskPredicted

0.1

BFCL (Berkeley Function Calling)Predicted

52.6

BigCodeBench CompletePredicted

60.2 / 100

BigCodeBench InstructPredicted

49.9 / 100

AA Intelligence Index (Matrix)Predicted

70.4

AA Long Context Reasoning (Matrix)Predicted

70.9

AIME 2024Predicted

94.9

AIME 2025 (Matrix)Predicted

92.8

Arena-Hard AutoPredicted

85.7

BrowseCompPredicted

58.7

BRUMO 2025Predicted

84.3

CMIMC 2025Predicted

73.6

CritPtPredicted

2.6

GPQA Diamond (Matrix)Predicted

82.6

GSM8KPredicted

95.2

HLE (Matrix)Predicted

16.7

HMMT Feb 2025Predicted

72.1

HMMT Nov 2025Predicted

63.8

HumanEvalPredicted

91.8

IFBench (Matrix)Predicted

48.9

IFEvalPredicted

89.6

IMO 2025Predicted

14.9

LiveCodeBench (Matrix)Predicted

75.4

MATH-500 (Matrix)Predicted

97.6

MathArena Apex 2025Predicted

0.7

MMLUPredicted

89.3

MMLU-Pro (Matrix)Predicted

84.0

MMMU-ProPredicted

82.2

MRCR v2Predicted

81.6

OSWorldPredicted

34.8

SimpleQAPredicted

29.6

SMT 2025Predicted

80.9

SWE-bench ProPredicted

35.2

Tau-Bench Telecom (Matrix)Predicted

43.1

Terminal-Bench 2.0Predicted

18.3

Terminal-Bench 1.0Predicted

20.9

USAMO 2025Predicted

11.8

Video-MMUPredicted

86.9

browsecompPredicted

56.9

BullshitBenchPredicted

16.5 / 100

Aider PolyglotPredicted

0.0

Apex AgentsPredicted

2.7

Arc Agi 2Predicted

0.0

BALROGPredicted

0.0

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.8

CAD-EvalPredicted

3.5

Chess PuzzlesPredicted

0.1

CyBenchPredicted

0.2

DeepResearchBenchPredicted

0.4

GdpvalPredicted

0.2

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

8.2

GSOPredicted

0.0

HellaSwagPredicted

0.5

HlePredicted

0.1

METR Time HorizonsPredicted

1.1

OTIS Mock AIME 2024–2025Predicted

0.7

PIQAPredicted

0.8

PosttrainbenchPredicted

0.0

SimpleQA Verified (Epoch)Predicted

0.3

The Agent CompanyPredicted

2.4

TriviaQAPredicted

5.0

VPCTPredicted

0.4

WinoGrandePredicted

1.0

FrontierMathPredicted

12.1 / 100

GAIA Level 1Predicted

77.8

GAIA Level 2Predicted

70.8

GAIA Level 3Predicted

72.5

GAIAPredicted

63.0 / 100

LegalBenchPredicted

92.1 / 100

LiveBench CodingPredicted

65.3 / 100

LiveBench Data AnalysisPredicted

42.4 / 100

LiveBench LanguagePredicted

51.9 / 100

LiveBench MathPredicted

59.9 / 100

LiveBench OverallPredicted

45.4 / 100

LiveBench ReasoningPredicted

40.1 / 100

LongBench v2 EasyPredicted

56.2

LongBench v2 HardPredicted

50.4

LongBench v2Predicted

45.6 / 100

MATH-500Predicted

1.0 / 100

MathVistaPredicted

69.9 / 100

MLE-benchPredicted

22.9 / 100

MMMUPredicted

79.0 / 100

MMTU Table UnderstandingPredicted

60.4 / 100

MT-BenchPredicted

8.0 / 10

NoLiMa (NIAH)Predicted

95.1 / 100

OCRBench v2Predicted

87.1 / 100

Open LLM AveragePredicted

31.5 / 100

Open LLM: BBHPredicted

61.4 / 100

Open LLM: GPQAPredicted

33.5 / 100

Open LLM: IFEvalPredicted

54.7 / 100

Open LLM: MATH Level 5Predicted

25.4 / 100

Open LLM: MMLU-PROPredicted

46.1 / 100

Open LLM: MUSRPredicted

44.2 / 100

RE-BenchPredicted

3.6

simpleqaPredicted

31.0

SWE-bench LitePredicted

40.1 / 100

SWE-bench VerifiedPredicted

58.2 / 100

tau-bench RetailPredicted

76.6 / 100

WebArenaPredicted

8.3 / 100

WeirdMLPredicted

45.9 / 100

WildBenchPredicted

46.8

Epoch Capabilities Indexepoch_ai

139.0

FictionLiveBenchepoch_ai

0.5

Lech Mazur Writingepoch_ai

8.5

SimpleBenchsimplebench

40.0 / 100

Vectara Factual Consistencyvectara_hallucination

94.5 / 100

Vectara Hallucination Ratevectara_hallucination

5.5 / 100