AgMoDB
ModelsAgentsOrchestratorsEvalsCompositesVisualizeIndustry
AgMoDB by @mistakeknot
All Models

Gemini 2.5 Flash (Non-reasoning)

May 20, 2025Last synced Nov 22, 2026, 8:18 AM1049K context
Effort
  • No reasoning
  • Reasoning

Blended Price

$0.85/M

Input Price

$0.30/M

Output Price

$2.50/M

Speed

—

TTFT

—

Benchmark Scores

Intelligence Index
—
Coding Index
—
Math Index
—
MMLU Pro
80.9 / 100
GPQA Diamond
68.3 / 100
HLE
4.7 / 100
LiveCodeBench
49.5 / 100
SciCode
— / 100
MATH-500
93.2 / 100
AIME
50.0 / 30
AIME 2025
60.3 / 30
IFBench
39.0 / 100
LCR
49.9 / 100
Terminal-Bench Hard
12.1 / 100
τ²-Bench
14.9 / 100

Performance Radar

Gemini 2.5 Flash (Non-reasoning)
Field Average

Hidden, no data: Output Speed

External Benchmarks

ARC-AGI-1arc_agi
33.3 / 100
ARC-AGI-1 Cost per Taskarc_agi
0.0
ARC-AGI-2arc_agi
1.7 / 100
ARC-AGI-2 Cost per Taskarc_agi
0.1
ARC-AGI-1benchmark_matrix
33.3 / 100
ARC-AGI-2benchmark_matrix
2.5 / 100
AIME 2024benchmark_matrix
88.0
AIME 2025 (Matrix)benchmark_matrix
72.0
Arena-Hard Autobenchmark_matrix
83.9
BRUMO 2025benchmark_matrix
83.3
CMIMC 2025benchmark_matrix
50.6
Codeforces Ratingbenchmark_matrix
1995.0
CritPtbenchmark_matrix
1.1
GPQA Diamond (Matrix)benchmark_matrix
78.3
HLE (Matrix)benchmark_matrix
15.6
HMMT Feb 2025benchmark_matrix
64.2
HumanEvalbenchmark_matrix
90.2
IFEvalbenchmark_matrix
84.3
LiveCodeBench (Matrix)benchmark_matrix
63.9
MATH-500 (Matrix)benchmark_matrix
95.2
MMLUbenchmark_matrix
85.0
MMLU-Pro (Matrix)benchmark_matrix
81.1
SimpleQAbenchmark_matrix
28.1
SMT 2025benchmark_matrix
75.5
Terminal-Bench 2.0benchmark_matrix
16.9
Terminal-Bench 1.0benchmark_matrix
16.8
LiveBench Overallbenchmark_matrix
47.7 / 100
MMMUbenchmark_matrix
73.5 / 100
simpleqabenchmark_matrix
28.1
SWE-bench Verifiedbenchmark_matrix
63.8 / 100
AA-Omniscience AccuracyPredicted
40.3 / 100
AA-Omniscience Hallucination RatePredicted
95.7 / 100
Aider PolyglotPredicted
65.8 / 100
AlpacaEval 2.0 LCPredicted
57.2 / 100
AlpacaEval 2.0 RawPredicted
48.5 / 100
BigCodeBench CompletePredicted
56.7 / 100
BigCodeBench InstructPredicted
46.5 / 100
AA Intelligence Index (Matrix)Predicted
67.6
AA Long Context Reasoning (Matrix)Predicted
75.8
BrowseCompPredicted
59.1
GSM8KPredicted
93.9
HMMT Nov 2025Predicted
64.2
IFBench (Matrix)Predicted
47.5
IMO 2025Predicted
24.0
MathArena Apex 2025Predicted
0.9
MMMU-ProPredicted
81.4
MRCR v2Predicted
74.4
OSWorld (Unversioned Matrix Import)Predicted
39.2 / 100
SWE-bench ProPredicted
36.8
Tau-Bench Telecom (Matrix)Predicted
95.8
USAMO 2025Predicted
9.7
Video-MMUPredicted
82.7
browsecompPredicted
55.6
Aider PolyglotPredicted
0.0
Apex AgentsPredicted
1.8
Arc Agi 2Predicted
0.0
BIG-Bench HardPredicted
3.0
BoolQPredicted
0.8
CAD-EvalPredicted
4.3
Chess PuzzlesPredicted
0.2
CyBenchPredicted
0.6
DeepResearchBenchPredicted
0.3
FictionLiveBenchPredicted
0.5
GdpvalPredicted
0.2
GeoBenchPredicted
0.0
GSM8K (Epoch)Predicted
6.4
GSOPredicted
0.0
HellaSwagPredicted
0.6
HlePredicted
0.1
Lech Mazur WritingPredicted
7.6
METR Time HorizonsPredicted
2.0
OTIS Mock AIME 2024–2025Predicted
0.4
PIQAPredicted
0.8
PosttrainbenchPredicted
0.0
SimpleQA Verified (Epoch)Predicted
0.3
The Agent CompanyPredicted
1.0
TriviaQAPredicted
4.7
VPCTPredicted
0.4
WinoGrandePredicted
1.1
FrontierMathPredicted
13.3 / 100
GAIA Level 1Predicted
65.2
GAIA Level 2Predicted
47.9
GAIA Level 3Predicted
23.2
GAIAPredicted
49.3 / 100
LongBench v2 HardPredicted
46.0
LongBench v2Predicted
41.6 / 100
MathVistaPredicted
65.2 / 100
MedQA (USMLE)Predicted
90.5
MLE-bench (Original)Predicted
23.4 / 100
MMTU Table UnderstandingPredicted
57.3 / 100
MT-BenchPredicted
7.9 / 10
OCRBench v2Predicted
84.0 / 100
Open LLM AveragePredicted
13.3 / 100
Open LLM: BBHPredicted
31.6 / 100
Open LLM: GPQAPredicted
27.4 / 100
Open LLM: IFEvalPredicted
59.1 / 100
Open LLM: MATH Level 5Predicted
70.5 / 100
Open LLM: MMLU-PROPredicted
19.9 / 100
Open LLM: MUSRPredicted
36.5 / 100
RE-BenchPredicted
4.6
SWE-bench LitePredicted
37.6 / 100
tau-bench RetailPredicted
68.3 / 100
WebArenaPredicted
16.0 / 100
WildBenchPredicted
51.1
BFCL (Berkeley Function Calling)bfcl
56.2
BullshitBenchbullshitbench
19.0 / 100
Arena ELO: Creative Writingchatbot_arena
1397.0
Chatbot Arena ELOchatbot_arena
1417.0
arena_elo_visionchatbot_arena
1235.0
Ale Benchepoch_ai
661.9
Apex Agentsepoch_ai
1.1
BALROGepoch_ai
0.3
Critptepoch_ai
0.0
Dtbenchepoch_ai
0.8
Eci Scoresepoch_ai
142.1
Epoch Capabilities Indexepoch_ai
140.0
Forecastbenchepoch_ai
62.6
Lmcaepoch_ai
27.5
Processed Data For Eciepoch_ai
0.2
Spatialviz Benchepoch_ai
0.4
Vending Bench 2epoch_ai
548.8
FrontierMathfrontiermath
4.8 / 100
LegalBenchlegalbench
83.8 / 100
LiveBench Codinglivebench
66.0 / 100
LiveBench Data Analysislivebench
47.3 / 100
LiveBench Languagelivebench
62.3 / 100
LiveBench Mathlivebench
68.8 / 100
LiveBench Overalllivebench
47.7 / 100
LiveBench Reasoninglivebench
44.6 / 100
LongBench v2 Easylongbench2
62.1
MMMUmmmu
79.7 / 100
NoLiMa (NIAH)nolima
94.4 / 100
OpenRouter Token Volumeopenrouter_rankings
544000000000.0
OpenRouter Weekly Trendopenrouter_rankings
13.0
SimpleBenchsimplebench
41.2 / 100
SWE-bench Verifiedswebench
28.7 / 100
Vectara Factual Consistencyvectara_hallucination
92.2 / 100
Vectara Hallucination Ratevectara_hallucination
7.8 / 100
WeirdMLweirdml
41.0 / 100
SWE-rebenchswe_rebench

vcontinuous-leaderboard · tasks-created:2025-07-01:2025-11-01 · gemini-2.5-flash · harness swe-rebench-react@tools · 5 attempts · pass@1 · swe-rebench:standardized:128k-or-model-limit · provider gemini-2.5-flash__tools · record gemini-2.5-flash__tools:1751328000000:1761955200000

View run source

Source metadata
{
  "passAt5": 35.16483516483517,
  "developer": "google",
  "instanceType": "model",
  "contextPolicy": "128k unless the model supports less",
  "attemptsPerTask": 5,
  "totalTokenUsage": 0,
  "modelReleaseDate": "2025-06-17",
  "scoreStandardError": 0.41044547813716276,
  "cachedTokenPercentage": null,
  "modelReleaseTimestamp": 1750118400000,
  "standardContextTokens": 128000,
  "averageInstanceCostUsd": 0,
  "potentialContamination": false,
  "aggregateTaskRangeTimestamp": {
    "to": 1761955200000,
    "from": 1751328000000
  },
  "publishedTaskRangeTimestamp": {
    "to": 1761955200000,
    "from": 1751328000000
  }
}

Evidence observed 2025-11-01

19.9 / 100

How Gemini 2.5 Flash (Non-reasoning) Compares

Axes

Filters

$0.00 – $67.5
≥ 1.4

Providers

ai2ai21-labsalibabaanthropicarceeawsazurebaidu
openai
zai
meta
nvidia
xai
upstage
deepseek
alibaba
mistral
nous-research
aws
google
anthropic
xiaomi
stepfun
kimi
reflection
minimax
azure
inclusionai
reka-ai
cohere
bytedance_seed
inception
tencent
thinking-machines
Bubble size = Context Window
8191.00
2000000.00
Compare with other models