Models Agents EvalsIndustry

AgMoDB by @mistakeknot

DeepSeek LLM 67B Chat (V1) | AgMoDB

DeepSeek LLM 67B Chat (V1)

November 29, 2023Last synced Apr 7, 2026, 4:00 PM

Blended Price

Free/M

Input Price

Free/M

Output Price

Free/M

Speed

0 tok/s

TTFT

0.00s

Benchmark Scores

Intelligence Index

External Benchmarks

AlpacaEval 2.0 LC

How DeepSeek LLM 67B Chat (V1) Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

8.4

Coding Index

—

Math Index

—

MMLU Pro

— / 100

GPQA Diamond

— / 100

HLE

— / 100

LiveCodeBench

— / 100

SciCode

— / 100

MATH-500

— / 100

AIME

— / 30

AIME 2025

— / 30

IFBench

— / 100

LCR

— / 100

Terminal-Bench Hard

— / 100

τ²-Bench

— / 100

alpacaeval

17.8 / 100

AlpacaEval 2.0 Rawalpacaeval

12.1 / 100

AA-Omniscience AccuracyPredicted

42.6 / 100

AA-Omniscience Hallucination RatePredicted

96.3 / 100

Aider PolyglotPredicted

53.5 / 100

AIMEPredicted

0.2 / 30

AIME 2025Predicted

0.5 / 30

ARC-AGI-1Predicted

27.7 / 100

ARC-AGI-1 Cost per TaskPredicted

0.1

ARC-AGI-2Predicted

0.6 / 100

ARC-AGI-2 Cost per TaskPredicted

0.1

BFCL (Berkeley Function Calling)Predicted

44.2

BigCodeBench CompletePredicted

49.7 / 100

BigCodeBench InstructPredicted

40.1 / 100

AA Intelligence Index (Matrix)Predicted

64.2

AA Long Context Reasoning (Matrix)Predicted

72.9

AIME 2024Predicted

79.6

AIME 2025 (Matrix)Predicted

93.1

Arena-Hard AutoPredicted

57.6

BrowseCompPredicted

67.5

BRUMO 2025Predicted

95.0

CMIMC 2025Predicted

90.3

CritPtPredicted

1.0

GPQA Diamond (Matrix)Predicted

76.2

GSM8KPredicted

92.2

HLE (Matrix)Predicted

67.6

HMMT Feb 2025Predicted

74.7

HMMT Nov 2025Predicted

90.9

HumanEvalPredicted

89.4

IFBench (Matrix)Predicted

47.0

IFEvalPredicted

87.0

IMO 2025Predicted

22.5

LiveCodeBench (Matrix)Predicted

66.8

MATH-500 (Matrix)Predicted

93.7

MathArena Apex 2025Predicted

1.9

MMLUPredicted

87.0

MMLU-Pro (Matrix)Predicted

80.0

MMMU-ProPredicted

81.2

MRCR v2Predicted

77.4

OSWorldPredicted

48.8

SimpleQAPredicted

33.2

SMT 2025Predicted

80.5

SWE-bench ProPredicted

41.8

Tau-Bench Telecom (Matrix)Predicted

97.1

Terminal-Bench 2.0Predicted

33.4

Terminal-Bench 1.0Predicted

24.7

USAMO 2025Predicted

12.4

Video-MMUPredicted

86.1

browsecompPredicted

79.6

BullshitBenchPredicted

68.8 / 100

Aider PolyglotPredicted

0.1

Apex AgentsPredicted

2.5

Arc Agi 2Predicted

4.6

BALROGPredicted

0.0

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.8

CAD-EvalPredicted

11.1

Chess PuzzlesPredicted

0.2

CyBenchPredicted

0.2

DeepResearchBenchPredicted

0.4

FictionLiveBenchPredicted

0.6

GdpvalPredicted

0.3

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

0.8

GSOPredicted

0.0

HellaSwagPredicted

0.2

HlePredicted

0.2

Lech Mazur WritingPredicted

7.7

METR Time HorizonsPredicted

2.4

OTIS Mock AIME 2024–2025Predicted

0.3

PIQAPredicted

0.8

PosttrainbenchPredicted

0.0

SimpleQA Verified (Epoch)Predicted

0.4

The Agent CompanyPredicted

1.9

TriviaQAPredicted

11.2

VPCTPredicted

0.3

WinoGrandePredicted

0.8

FrontierMathPredicted

42.3 / 100

GAIA Level 1Predicted

56.4

GAIA Level 2Predicted

32.0

GAIA Level 3Predicted

6.0

GAIAPredicted

39.6 / 100

GPQA DiamondPredicted

0.6 / 100

HLEPredicted

0.1 / 100

IFBenchPredicted

0.5 / 100

LCRPredicted

0.1 / 100

LegalBenchPredicted

80.2 / 100

LiveBench CodingPredicted

69.7 / 100

LiveBench Data AnalysisPredicted

51.3 / 100

LiveBench LanguagePredicted

62.5 / 100

LiveBench MathPredicted

70.4 / 100

LiveBench OverallPredicted

55.1 / 100

LiveBench ReasoningPredicted

53.4 / 100

LiveCodeBenchPredicted

0.5 / 100

LongBench v2 EasyPredicted

48.5

LongBench v2 HardPredicted

42.4

LongBench v2Predicted

35.7 / 100

MATH-500Predicted

0.9 / 100

MathVistaPredicted

37.7 / 100

MLE-benchPredicted

34.0 / 100

MMLU ProPredicted

0.7 / 100

MMMUPredicted

74.3 / 100

MMTU Table UnderstandingPredicted

55.7 / 100

MT-BenchPredicted

7.9 / 10

NoLiMa (NIAH)Predicted

92.8 / 100

OCRBench v2Predicted

80.6 / 100

RE-BenchPredicted

56.8

SciCodePredicted

0.3 / 100

SimpleBenchPredicted

35.0 / 100

simpleqaPredicted

31.4

SWE-bench LitePredicted

29.7 / 100

SWE-bench VerifiedPredicted

48.5 / 100

τ²-BenchPredicted

0.3 / 100

tau-bench RetailPredicted

82.9 / 100

Terminal-Bench HardPredicted

0.0 / 100

Vectara Factual ConsistencyPredicted

91.2 / 100

Vectara Hallucination RatePredicted

8.8 / 100

WebArenaPredicted

1.9 / 100

WeirdMLPredicted

40.1 / 100

WildBenchPredicted

45.4

Open LLM Averageopen_llm_leaderboard

27.3 / 100

Open LLM: BBHopen_llm_leaderboard

52.4 / 100

Open LLM: GPQAopen_llm_leaderboard

31.6 / 100

Open LLM: IFEvalopen_llm_leaderboard

55.9 / 100

Open LLM: MATH Level 5open_llm_leaderboard

9.3 / 100

Open LLM: MMLU-PROopen_llm_leaderboard

39.4 / 100

Open LLM: MUSRopen_llm_leaderboard

50.6 / 100