AgMoDB
ModelsAgentsOrchestratorsEvalsCompositesVisualizeIndustry
AgMoDB by @mistakeknot
All Models

Gemini 1.5 Pro (Sep '24)

September 24, 2024Last synced Nov 5, 2026, 12:18 AM

Blended Price

Free/M

Input Price

Free/M

Output Price

Free/M

Speed

—

TTFT

—

Benchmark Scores

Intelligence Index
—
Coding Index
—
Math Index
—
MMLU Pro
75.0 / 100
GPQA Diamond
58.9 / 100
HLE
4.6 / 100
LiveCodeBench
31.6 / 100
SciCode
— / 100
MATH-500
87.6 / 100
AIME
23.0 / 30
AIME 2025
— / 30
IFBench
— / 100
LCR
— / 100
Terminal-Bench Hard
— / 100
τ²-Bench
— / 100

Performance Radar

Gemini 1.5 Pro (Sep '24)
Field Average

Hidden, no data: AgMoBench Agentic, AgMoBench Robustness, Output Speed

External Benchmarks

ARC-AGI-2arc_agi
0.8 / 100
ARC-AGI-2 Cost per Taskarc_agi
0.0
AA-Omniscience AccuracyPredicted
41.1 / 100
AA-Omniscience Hallucination RatePredicted
95.6 / 100
Aider PolyglotPredicted
40.1 / 100
AIME 2025Predicted
0.2 / 30
AlpacaEval 2.0 LCPredicted
37.8 / 100
AlpacaEval 2.0 RawPredicted
54.0 / 100
ARC-AGI-1Predicted
10.4 / 100
ARC-AGI-1 Cost per TaskPredicted
0.1
BFCL (Berkeley Function Calling)Predicted
41.5
AA Intelligence Index (Matrix)Predicted
82.4
AA Long Context Reasoning (Matrix)Predicted
71.4
AIME 2024Predicted
53.7
AIME 2025 (Matrix)Predicted
79.1
Arena-Hard AutoPredicted
68.3
BrowseCompPredicted
24.7
BRUMO 2025Predicted
87.3
CMIMC 2025Predicted
75.3
CritPtPredicted
0.1
GPQA Diamond (Matrix)Predicted
69.9
GSM8KPredicted
90.9
HLE (Matrix)Predicted
22.8
HMMT Feb 2025Predicted
72.7
HMMT Nov 2025Predicted
89.6
HumanEvalPredicted
91.0
IFBench (Matrix)Predicted
23.2
IFEvalPredicted
82.0
IMO 2025Predicted
15.4
LiveCodeBench (Matrix)Predicted
68.2
MATH-500 (Matrix)Predicted
96.7
MathArena Apex 2025Predicted
1.0
MMLUPredicted
86.6
MMLU-Pro (Matrix)Predicted
75.9
MMMU-ProPredicted
80.7
MRCR v2Predicted
74.5
OSWorld (Unversioned Matrix Import)Predicted
42.6 / 100
SimpleQAPredicted
27.4
SMT 2025Predicted
81.4
SWE-bench ProPredicted
37.9
Tau-Bench Telecom (Matrix)Predicted
96.0
Terminal-Bench 2.0Predicted
10.5
Terminal-Bench 1.0Predicted
18.5
USAMO 2025Predicted
8.6
Video-MMUPredicted
93.9
browsecompPredicted
58.9
BullshitBenchPredicted
7.3 / 100
Aider PolyglotPredicted
0.0
Apex AgentsPredicted
2.0
BIG-Bench HardPredicted
3.0
BoolQPredicted
0.8
Chess PuzzlesPredicted
0.1
DeepResearchBenchPredicted
0.2
FictionLiveBenchPredicted
0.4
GdpvalPredicted
0.2
GeoBenchPredicted
0.0
GSM8K (Epoch)Predicted
6.6
GSOPredicted
0.0
HellaSwagPredicted
6.9
Lech Mazur WritingPredicted
7.4
METR Time HorizonsPredicted
0.4
PIQAPredicted
0.8
PosttrainbenchPredicted
60.0
SimpleQA Verified (Epoch)Predicted
0.5
TriviaQAPredicted
4.3
VPCTPredicted
0.4
WinoGrandePredicted
0.8
FrontierMathPredicted
14.0 / 100
IFBenchPredicted
0.3 / 100
LCRPredicted
0.0 / 100
LegalBenchPredicted
73.3 / 100
LiveBench CodingPredicted
72.3 / 100
LiveBench Data AnalysisPredicted
49.6 / 100
LiveBench LanguagePredicted
68.2 / 100
LiveBench MathPredicted
66.6 / 100
LiveBench OverallPredicted
47.4 / 100
LiveBench ReasoningPredicted
62.1 / 100
LongBench v2 EasyPredicted
47.1
LongBench v2 HardPredicted
42.7
LongBench v2Predicted
38.7 / 100
MLE-bench (Original)Predicted
14.6 / 100
MMTU Table UnderstandingPredicted
47.2 / 100
MT-BenchPredicted
7.9 / 10
Open LLM AveragePredicted
13.1 / 100
Open LLM: BBHPredicted
24.5 / 100
Open LLM: GPQAPredicted
23.2 / 100
Open LLM: IFEvalPredicted
25.7 / 100
Open LLM: MATH Level 5Predicted
52.3 / 100
Open LLM: MMLU-PROPredicted
18.2 / 100
Open LLM: MUSRPredicted
28.4 / 100
RE-BenchPredicted
4.8
simpleqaPredicted
26.5
SWE-bench LitePredicted
23.1 / 100
SWE-bench VerifiedPredicted
47.0 / 100
τ²-BenchPredicted
0.1 / 100
tau-bench RetailPredicted
69.1 / 100
Terminal-Bench HardPredicted
0.0 / 100
Vectara Factual ConsistencyPredicted
92.7 / 100
Vectara Hallucination RatePredicted
7.3 / 100
WebArenaPredicted
11.5 / 100
WeirdMLPredicted
32.1 / 100
BigCodeBench Completebigcodebench
57.5 / 100
BigCodeBench Instructbigcodebench
43.8 / 100
Chatbot Arena ELOchatbot_arena
1319.0
arena_elo_visionchatbot_arena
1161.0
Cybenchcybench
7.5
Arc Agi 2epoch_ai
0.0
BALROGepoch_ai
0.0
CAD-Evalepoch_ai
3.6
CyBenchepoch_ai
0.1
Eci Scoresepoch_ai
129.3
Epoch Capabilities Indexepoch_ai
131.8
Hleepoch_ai
0.0
OTIS Mock AIME 2024–2025epoch_ai
0.2
Processed Data For Eciepoch_ai
0.0
The Agent Companyepoch_ai
6.8
GAIA Level 1gaia
58.1
GAIA Level 2gaia
51.6
GAIA Level 3gaia
24.5
GAIAgaia
49.2 / 100
LegalBenchlegalbench
69.1 / 100
MathVistamathvista
52.1 / 100
MedQA (USMLE)medqa
76.5
MMMUmmmu
62.2 / 100
MMMU-Prommmu
43.5
NoLiMa (NIAH)nolima
92.6 / 100
OCRBench v2open-vlm-leaderboard
75.4 / 100
SimpleBenchsimplebench
27.1 / 100
Video-MME Longvideomme
77.4
Video-MME Mediumvideomme
81.0
Video-MMEvideomme
81.3 / 100
Video-MME Shortvideomme
84.5
WildBenchwildbench
47.4

How Gemini 1.5 Pro (Sep '24) Compares

Axes

Filters

$0.00 – $67.5
≥ 1.4

Providers

ai2ai21-labsalibabaanthropicarceeawsazurebaidu
openai
zai
meta
nvidia
xai
upstage
deepseek
alibaba
mistral
nous-research
aws
google
anthropic
xiaomi
stepfun
kimi
reflection
minimax
azure
inclusionai
reka-ai
cohere
bytedance_seed
inception
tencent
thinking-machines
Bubble size = Context Window
8191.00
2000000.00
Compare with other models