AgMoDB
Models
Agents
Evals
Explore
Tools
Industry
Menu
DeepHermes 3 - Llama-3.1 8B Preview (Non-reasoning) | AgMoDB
All Models
DeepHermes 3 - Llama-3.1 8B Preview (Non-reasoning)
February 13, 2025
Last synced Apr 7, 2026, 4:00 PM
Blended Price
Free/M
Input Price
Free/M
Output Price
Free/M
Speed
0 tok/s
TTFT
0.00s
Benchmark Scores
Intelligence Index
External Benchmarks
AA-Omniscience Accuracy
Add to comparison
How DeepHermes 3 - Llama-3.1 8B Preview (Non-reasoning) Compares
Axes
X Axis
Blended Price (USD)
Y Axis
AgMoBench Overall
Bubble Size
Context Window
Filters
Blended Price (USD)
$0.00 – $30.0
AgMoBench Overall
≥ 3.5
Providers
ai21-labs
alibaba
anthropic
aws
azure
baidu
cohere
deepseek
+15 more
Table view
Filters
Show quadrants
Top models
anthropic
openai
google
meta
mistral
nvidia
kimi
xai
azure
deepseek
aws
cohere
baidu
ai21-labs
zai
reka-ai
xiaomi
alibaba
minimax
ibm
Bubble size = Context Window
16384.00
2000000.00
Compare with other models
7.6
Coding Index
—
Math Index
—
MMLU Pro
0.4
/ 100
GPQA Diamond
0.3
/ 100
HLE
0.0
/ 100
LiveCodeBench
0.1
/ 100
SciCode
0.1
/ 100
MATH-500
0.2
/ 100
AIME
0.0
/ 30
AIME 2025
—
/ 30
IFBench
—
/ 100
LCR
—
/ 100
Terminal-Bench Hard
—
/ 100
τ²-Bench
—
/ 100
Predicted
48.6
/ 100
AA-Omniscience Hallucination Rate
Predicted
96.5
/ 100
Aider Polyglot
Predicted
15.2
/ 100
AIME 2025
Predicted
0.0
/ 30
AlpacaEval 2.0 LC
Predicted
20.9
/ 100
AlpacaEval 2.0 Raw
Predicted
16.7
/ 100
ARC-AGI-1
Predicted
33.3
/ 100
ARC-AGI-1 Cost per Task
Predicted
0.2
ARC-AGI-2
Predicted
0.9
/ 100
ARC-AGI-2 Cost per Task
Predicted
0.2
BFCL (Berkeley Function Calling)
Predicted
23.1
BigCodeBench Complete
Predicted
31.0
/ 100
BigCodeBench Instruct
Predicted
24.3
/ 100
AA Intelligence Index (Matrix)
Predicted
52.7
AA Long Context Reasoning (Matrix)
Predicted
75.4
AIME 2024
Predicted
16.3
AIME 2025 (Matrix)
Predicted
85.5
Arena-Hard Auto
Predicted
18.0
BrowseComp
Predicted
83.4
BRUMO 2025
Predicted
99.0
CMIMC 2025
Predicted
93.1
CritPt
Predicted
1.8
GPQA Diamond (Matrix)
Predicted
44.1
GSM8K
Predicted
84.5
HLE (Matrix)
Predicted
26.0
HMMT Feb 2025
Predicted
83.7
HMMT Nov 2025
Predicted
93.2
HumanEval
Predicted
68.2
IFBench (Matrix)
Predicted
33.5
IFEval
Predicted
74.5
IMO 2025
Predicted
33.5
LiveCodeBench (Matrix)
Predicted
32.3
MATH-500 (Matrix)
Predicted
85.0
MathArena Apex 2025
Predicted
9.3
MMLU
Predicted
67.7
MMLU-Pro (Matrix)
Predicted
47.9
MMMU-Pro
Predicted
78.5
MRCR v2
Predicted
80.2
OSWorld
Predicted
31.3
SimpleQA
Predicted
40.2
SMT 2025
Predicted
80.6
SWE-bench Pro
Predicted
21.9
Tau-Bench Telecom (Matrix)
Predicted
98.5
Terminal-Bench 2.0
Predicted
63.1
Terminal-Bench 1.0
Predicted
14.2
USAMO 2025
Predicted
8.2
Video-MMU
Predicted
84.2
browsecomp
Predicted
84.9
BullshitBench
Predicted
65.9
/ 100
Aider Polyglot
Predicted
0.0
Apex Agents
Predicted
3.9
Arc Agi 2
Predicted
0.4
BALROG
Predicted
0.0
BIG-Bench Hard
Predicted
3.0
BoolQ
Predicted
0.9
CAD-Eval
Predicted
8.4
Chess Puzzles
Predicted
0.3
CyBench
Predicted
0.1
DeepResearchBench
Predicted
0.4
FictionLiveBench
Predicted
0.5
Gdpval
Predicted
0.4
GeoBench
Predicted
0.0
GSM8K (Epoch)
Predicted
4.8
GSO
Predicted
0.2
HellaSwag
Predicted
0.4
Hle
Predicted
0.2
Lech Mazur Writing
Predicted
6.9
METR Time Horizons
Predicted
3.8
OTIS Mock AIME 2024–2025
Predicted
0.0
PIQA
Predicted
0.8
Posttrainbench
Predicted
0.0
SimpleQA Verified (Epoch)
Predicted
0.4
The Agent Company
Predicted
0.9
TriviaQA
Predicted
13.7
VPCT
Predicted
0.4
WinoGrande
Predicted
0.7
FrontierMath
Predicted
37.3
/ 100
GAIA Level 1
Predicted
7.6
GAIA Level 2
Predicted
0.7
GAIA Level 3
Predicted
0.0
GAIA
Predicted
4.5
/ 100
IFBench
Predicted
0.2
/ 100
LCR
Predicted
0.0
/ 100
LegalBench
Predicted
31.3
/ 100
LiveBench Coding
Predicted
75.3
/ 100
LiveBench Data Analysis
Predicted
62.9
/ 100
LiveBench Language
Predicted
74.8
/ 100
LiveBench Math
Predicted
81.6
/ 100
LiveBench Overall
Predicted
67.0
/ 100
LiveBench Reasoning
Predicted
69.2
/ 100
LongBench v2 Easy
Predicted
29.3
LongBench v2 Hard
Predicted
25.5
LongBench v2
Predicted
28.9
/ 100
MathVista
Predicted
45.4
/ 100
MLE-bench
Predicted
48.2
/ 100
MMMU
Predicted
53.9
/ 100
MMTU Table Understanding
Predicted
47.3
/ 100
MT-Bench
Predicted
7.7
/ 10
OCRBench v2
Predicted
58.0
/ 100
RE-Bench
Predicted
98.7
SimpleBench
Predicted
34.5
/ 100
simpleqa
Predicted
31.4
SWE-bench Lite
Predicted
8.1
/ 100
SWE-bench Verified
Predicted
44.2
/ 100
τ²-Bench
Predicted
0.0
/ 100
tau-bench Retail
Predicted
73.7
/ 100
Terminal-Bench Hard
Predicted
0.0
/ 100
Vectara Factual Consistency
Predicted
89.4
/ 100
Vectara Hallucination Rate
Predicted
10.6
/ 100
WebArena
Predicted
4.3
/ 100
WeirdML
Predicted
8.4
/ 100
WildBench
Predicted
31.5
Epoch Capabilities Index
epoch_ai
115.9
HuggingFace Downloads (30d)
hf-downloads
1394154.0
HuggingFace Likes
hf-downloads
2119.0
NoLiMa (NIAH)
nolima
76.7
/ 100
Open LLM Average
open_llm_leaderboard
23.5
/ 100
Open LLM: BBH
open_llm_leaderboard
51.8
/ 100
Open LLM: GPQA
open_llm_leaderboard
29.8
/ 100
Open LLM: IFEval
open_llm_leaderboard
61.7
/ 100
Open LLM: MATH Level 5
open_llm_leaderboard
4.8
/ 100
Open LLM: MMLU-PRO
open_llm_leaderboard
31.4
/ 100
Open LLM: MUSR
open_llm_leaderboard
43.7
/ 100