AgMoDB
Models
Agents
Evals
Explore
Tools
Industry
Menu
NVIDIA: Llama 3.1 Nemotron Ultra 253B v1 | AgMoDB
All Models
NVIDIA: Llama 3.1 Nemotron Ultra 253B v1
Last synced Apr 7, 2026, 2:03 PM
131K context
Blended Price
$0.90/M
Input Price
$0.60/M
Output Price
$1.80/M
Speed
—
TTFT
—
Benchmark Scores
Intelligence Index
External Benchmarks
AIME 2025 (Matrix)
benchmark_matrix
Add to comparison
How NVIDIA: Llama 3.1 Nemotron Ultra 253B v1 Compares
Axes
X Axis
Blended Price (USD)
Y Axis
AgMoBench Overall
Bubble Size
Context Window
Filters
Blended Price (USD)
$0.00 – $30.0
AgMoBench Overall
≥ 3.5
Providers
ai21-labs
alibaba
anthropic
aws
azure
baidu
cohere
deepseek
+15 more
Table view
Filters
Show quadrants
Top models
anthropic
openai
google
meta
mistral
nvidia
kimi
xai
azure
deepseek
aws
cohere
baidu
ai21-labs
zai
reka-ai
xiaomi
alibaba
minimax
ibm
Bubble size = Context Window
16384.00
2000000.00
Compare with other models
—
Coding Index
—
Math Index
—
MMLU Pro
—
/ 100
GPQA Diamond
—
/ 100
HLE
—
/ 100
LiveCodeBench
—
/ 100
SciCode
—
/ 100
MATH-500
—
/ 100
AIME
—
/ 30
AIME 2025
—
/ 30
IFBench
—
/ 100
LCR
—
/ 100
Terminal-Bench Hard
—
/ 100
τ²-Bench
—
/ 100
72.5
Arena-Hard Auto
benchmark_matrix
92.7
Codeforces Rating
benchmark_matrix
1750.0
GPQA Diamond (Matrix)
benchmark_matrix
76.0
HLE (Matrix)
benchmark_matrix
15.0
HumanEval
benchmark_matrix
92.0
IFEval
benchmark_matrix
89.5
LiveCodeBench (Matrix)
benchmark_matrix
66.3
MATH-500 (Matrix)
benchmark_matrix
97.0
MMLU
benchmark_matrix
87.0
MMLU-Pro (Matrix)
benchmark_matrix
76.0
SimpleQA
benchmark_matrix
35.0
simpleqa
benchmark_matrix
35.0
SWE-bench Verified
benchmark_matrix
48.0
/ 100
AA-Omniscience Accuracy
Predicted
39.7
/ 100
AA-Omniscience Hallucination Rate
Predicted
95.6
/ 100
Aider Polyglot
Predicted
54.3
/ 100
AIME
Predicted
0.7
/ 30
AIME 2025
Predicted
0.7
/ 30
AlpacaEval 2.0 LC
Predicted
68.6
/ 100
AlpacaEval 2.0 Raw
Predicted
63.4
/ 100
ARC-AGI-1
Predicted
11.2
/ 100
ARC-AGI-1 Cost per Task
Predicted
0.0
ARC-AGI-2
Predicted
0.1
/ 100
ARC-AGI-2 Cost per Task
Predicted
0.1
BFCL (Berkeley Function Calling)
Predicted
48.3
BigCodeBench Complete
Predicted
58.7
/ 100
BigCodeBench Instruct
Predicted
48.5
/ 100
AA Intelligence Index (Matrix)
Predicted
70.6
AA Long Context Reasoning (Matrix)
Predicted
70.8
AIME 2024
Predicted
90.6
BrowseComp
Predicted
56.7
BRUMO 2025
Predicted
83.5
CMIMC 2025
Predicted
72.9
CritPt
Predicted
0.2
GSM8K
Predicted
94.3
HMMT Feb 2025
Predicted
65.5
HMMT Nov 2025
Predicted
89.0
IFBench (Matrix)
Predicted
48.5
IMO 2025
Predicted
14.2
MathArena Apex 2025
Predicted
0.7
MMMU-Pro
Predicted
81.7
MRCR v2
Predicted
75.0
OSWorld
Predicted
36.6
SMT 2025
Predicted
80.2
SWE-bench Pro
Predicted
35.6
Tau-Bench Telecom (Matrix)
Predicted
95.4
Terminal-Bench 2.0
Predicted
25.2
Terminal-Bench 1.0
Predicted
19.2
USAMO 2025
Predicted
10.0
Video-MMU
Predicted
86.5
browsecomp
Predicted
52.6
BullshitBench
Predicted
15.7
/ 100
Aider Polyglot
Predicted
0.0
Apex Agents
Predicted
1.9
Arc Agi 2
Predicted
0.0
BALROG
Predicted
0.0
BIG-Bench Hard
Predicted
3.0
BoolQ
Predicted
0.8
CAD-Eval
Predicted
4.1
Chess Puzzles
Predicted
0.1
CyBench
Predicted
0.2
DeepResearchBench
Predicted
0.3
FictionLiveBench
Predicted
0.5
Gdpval
Predicted
0.2
GeoBench
Predicted
0.0
GSM8K (Epoch)
Predicted
7.0
GSO
Predicted
0.0
HellaSwag
Predicted
2.1
Hle
Predicted
0.1
Lech Mazur Writing
Predicted
7.7
METR Time Horizons
Predicted
0.8
OTIS Mock AIME 2024–2025
Predicted
0.4
PIQA
Predicted
0.8
Posttrainbench
Predicted
0.0
SimpleQA Verified (Epoch)
Predicted
0.3
The Agent Company
Predicted
2.1
TriviaQA
Predicted
4.4
VPCT
Predicted
0.4
WinoGrande
Predicted
0.9
FrontierMath
Predicted
12.2
/ 100
GAIA Level 1
Predicted
68.7
GAIA Level 2
Predicted
55.5
GAIA Level 3
Predicted
32.9
GAIA
Predicted
52.3
/ 100
GPQA Diamond
Predicted
0.7
/ 100
HLE
Predicted
0.1
/ 100
IFBench
Predicted
0.5
/ 100
LCR
Predicted
0.1
/ 100
LegalBench
Predicted
90.2
/ 100
LiveBench Coding
Predicted
65.2
/ 100
LiveBench Data Analysis
Predicted
42.0
/ 100
LiveBench Language
Predicted
51.6
/ 100
LiveBench Math
Predicted
59.7
/ 100
LiveBench Overall
Predicted
45.0
/ 100
LiveBench Reasoning
Predicted
39.2
/ 100
LiveCodeBench
Predicted
0.6
/ 100
LongBench v2 Easy
Predicted
52.8
LongBench v2 Hard
Predicted
47.8
LongBench v2
Predicted
43.3
/ 100
MATH-500
Predicted
0.9
/ 100
MathVista
Predicted
59.5
/ 100
MLE-bench
Predicted
21.6
/ 100
MMLU Pro
Predicted
0.8
/ 100
MMMU
Predicted
75.6
/ 100
MMTU Table Understanding
Predicted
57.9
/ 100
MT-Bench
Predicted
7.9
/ 10
NoLiMa (NIAH)
Predicted
94.5
/ 100
OCRBench v2
Predicted
85.4
/ 100
Open LLM Average
Predicted
33.0
/ 100
Open LLM: BBH
Predicted
62.2
/ 100
Open LLM: GPQA
Predicted
33.7
/ 100
Open LLM: IFEval
Predicted
59.0
/ 100
Open LLM: MATH Level 5
Predicted
27.8
/ 100
Open LLM: MMLU-PRO
Predicted
46.9
/ 100
Open LLM: MUSR
Predicted
44.2
/ 100
RE-Bench
Predicted
2.6
SciCode
Predicted
0.4
/ 100
SimpleBench
Predicted
32.2
/ 100
SWE-bench Lite
Predicted
37.1
/ 100
τ²-Bench
Predicted
0.3
/ 100
tau-bench Retail
Predicted
76.6
/ 100
Terminal-Bench Hard
Predicted
0.1
/ 100
Vectara Factual Consistency
Predicted
92.9
/ 100
Vectara Hallucination Rate
Predicted
7.1
/ 100
WebArena
Predicted
16.7
/ 100
WeirdML
Predicted
40.4
/ 100
WildBench
Predicted
52.7
EQ-Bench 3
eqbench
1318.0
SWE-bench Verified
swebench
40.6
/ 100