AgMoDB
Models
Agents
Evals
Explore
Tools
Industry
Menu
Gemini 1.5 Flash (Sep '24) | AgMoDB
All Models
Gemini 1.5 Flash (Sep '24)
September 24, 2024
Last synced Apr 7, 2026, 4:00 PM
Blended Price
Free/M
Input Price
Free/M
Output Price
Free/M
Speed
0 tok/s
TTFT
0.00s
Benchmark Scores
Intelligence Index
External Benchmarks
AA-Omniscience Accuracy
Add to comparison
How Gemini 1.5 Flash (Sep '24) Compares
Axes
X Axis
Blended Price (USD)
Y Axis
AgMoBench Overall
Bubble Size
Context Window
Filters
Blended Price (USD)
$0.00 – $30.0
AgMoBench Overall
≥ 3.5
Providers
ai21-labs
alibaba
anthropic
aws
azure
baidu
cohere
deepseek
+15 more
Table view
Filters
Show quadrants
Top models
anthropic
openai
google
meta
mistral
nvidia
kimi
xai
azure
deepseek
aws
cohere
baidu
ai21-labs
zai
reka-ai
xiaomi
alibaba
minimax
ibm
Bubble size = Context Window
16384.00
2000000.00
Compare with other models
13.8
Coding Index
—
Math Index
—
MMLU Pro
0.7
/ 100
GPQA Diamond
0.5
/ 100
HLE
0.0
/ 100
LiveCodeBench
0.3
/ 100
SciCode
0.3
/ 100
MATH-500
0.8
/ 100
AIME
0.2
/ 30
AIME 2025
—
/ 30
IFBench
—
/ 100
LCR
—
/ 100
Terminal-Bench Hard
—
/ 100
τ²-Bench
—
/ 100
Predicted
41.1
/ 100
AA-Omniscience Hallucination Rate
Predicted
94.5
/ 100
Aider Polyglot
Predicted
15.7
/ 100
AIME 2025
Predicted
0.1
/ 30
AlpacaEval 2.0 LC
Predicted
41.6
/ 100
AlpacaEval 2.0 Raw
Predicted
28.6
/ 100
ARC-AGI-1
Predicted
7.6
/ 100
ARC-AGI-1 Cost per Task
Predicted
0.0
ARC-AGI-2
Predicted
8.9
/ 100
ARC-AGI-2 Cost per Task
Predicted
0.0
BFCL (Berkeley Function Calling)
Predicted
31.1
AA Intelligence Index (Matrix)
Predicted
64.9
AA Long Context Reasoning (Matrix)
Predicted
88.0
AIME 2024
Predicted
18.7
AIME 2025 (Matrix)
Predicted
65.4
Arena-Hard Auto
Predicted
47.2
BrowseComp
Predicted
60.5
BRUMO 2025
Predicted
76.7
CMIMC 2025
Predicted
67.7
CritPt
Predicted
0.1
GPQA Diamond (Matrix)
Predicted
49.5
GSM8K
Predicted
83.0
HLE (Matrix)
Predicted
48.2
HMMT Feb 2025
Predicted
71.5
HMMT Nov 2025
Predicted
88.7
HumanEval
Predicted
82.6
IFBench (Matrix)
Predicted
28.4
IFEval
Predicted
80.6
IMO 2025
Predicted
10.6
LiveCodeBench (Matrix)
Predicted
39.0
MATH-500 (Matrix)
Predicted
89.8
MathArena Apex 2025
Predicted
0.7
MMLU
Predicted
80.4
MMLU-Pro (Matrix)
Predicted
67.9
MMMU-Pro
Predicted
79.7
MRCR v2
Predicted
89.5
OSWorld
Predicted
43.0
SimpleQA
Predicted
19.6
SMT 2025
Predicted
76.2
SWE-bench Pro
Predicted
36.4
Tau-Bench Telecom (Matrix)
Predicted
95.2
Terminal-Bench 2.0
Predicted
18.8
Terminal-Bench 1.0
Predicted
10.9
USAMO 2025
Predicted
4.5
Video-MMU
Predicted
85.9
browsecomp
Predicted
58.1
BullshitBench
Predicted
11.8
/ 100
Aider Polyglot
Predicted
0.0
Apex Agents
Predicted
2.2
Arc Agi 2
Predicted
0.0
BIG-Bench Hard
Predicted
3.0
CAD-Eval
Predicted
3.0
Chess Puzzles
Predicted
0.1
CyBench
Predicted
0.1
DeepResearchBench
Predicted
0.3
FictionLiveBench
Predicted
0.3
Gdpval
Predicted
0.2
GSO
Predicted
0.0
HellaSwag
Predicted
10.3
Hle
Predicted
0.0
Lech Mazur Writing
Predicted
6.8
METR Time Horizons
Predicted
0.2
Posttrainbench
Predicted
0.0
SimpleQA Verified (Epoch)
Predicted
0.2
The Agent Company
Predicted
1.1
TriviaQA
Predicted
2.5
VPCT
Predicted
0.3
WinoGrande
Predicted
0.8
FrontierMath
Predicted
11.7
/ 100
GAIA Level 1
Predicted
14.1
GAIA Level 2
Predicted
5.6
GAIA Level 3
Predicted
0.0
GAIA
Predicted
8.7
/ 100
IFBench
Predicted
0.3
/ 100
LCR
Predicted
0.0
/ 100
LegalBench
Predicted
78.3
/ 100
LiveBench Coding
Predicted
64.3
/ 100
LiveBench Data Analysis
Predicted
39.1
/ 100
LiveBench Language
Predicted
48.4
/ 100
LiveBench Math
Predicted
56.8
/ 100
LiveBench Overall
Predicted
41.4
/ 100
LiveBench Reasoning
Predicted
33.8
/ 100
LongBench v2 Easy
Predicted
39.0
LongBench v2 Hard
Predicted
37.5
LongBench v2
Predicted
33.9
/ 100
MLE-bench
Predicted
11.9
/ 100
MMTU Table Understanding
Predicted
42.4
/ 100
MT-Bench
Predicted
8.2
/ 10
Open LLM Average
Predicted
41.3
/ 100
Open LLM: BBH
Predicted
66.2
/ 100
Open LLM: GPQA
Predicted
34.6
/ 100
Open LLM: IFEval
Predicted
76.0
/ 100
Open LLM: MATH Level 5
Predicted
42.5
/ 100
Open LLM: MMLU-PRO
Predicted
51.6
/ 100
Open LLM: MUSR
Predicted
44.2
/ 100
RE-Bench
Predicted
0.3
SimpleBench
Predicted
19.6
/ 100
simpleqa
Predicted
12.9
SWE-bench Lite
Predicted
10.6
/ 100
SWE-bench Verified
Predicted
29.8
/ 100
τ²-Bench
Predicted
0.2
/ 100
tau-bench Retail
Predicted
68.1
/ 100
Terminal-Bench Hard
Predicted
0.0
/ 100
Vectara Factual Consistency
Predicted
93.8
/ 100
Vectara Hallucination Rate
Predicted
6.2
/ 100
WebArena
Predicted
6.1
/ 100
WeirdML
Predicted
20.1
/ 100
BigCodeBench Complete
bigcodebench
55.1
/ 100
BigCodeBench Instruct
bigcodebench
43.5
/ 100
BALROG
epoch_ai
0.0
BoolQ
epoch_ai
0.9
Epoch Capabilities Index
epoch_ai
122.7
GeoBench
epoch_ai
0.0
GSM8K (Epoch)
epoch_ai
8.0
OTIS Mock AIME 2024–2025
epoch_ai
0.0
PIQA
epoch_ai
0.9
MathVista
mathvista
58.4
/ 100
MMMU
mmmu
56.1
/ 100
NoLiMa (NIAH)
nolima
84.7
/ 100
OCRBench v2
open-vlm-leaderboard
75.3
/ 100
Video-MME Long
videomme
68.8
Video-MME Medium
videomme
74.7
Video-MME
videomme
75.0
/ 100
Video-MME Short
videomme
79.8
WildBench
wildbench
44.1