Models Agents EvalsIndustry

AgMoDB by @mistakeknot

OpenAI: GPT-3.5 Turbo Instruct | AgMoDB

OpenAI: GPT-3.5 Turbo Instruct

Last synced Apr 7, 2026, 2:04 PM4K context

Blended Price

$1.63/M

Input Price

$1.50/M

Output Price

$2.00/M

Speed

—

TTFT

—

Benchmark Scores

Intelligence Index

External Benchmarks

AA-Omniscience Accuracy

How OpenAI: GPT-3.5 Turbo Instruct Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

—

Coding Index

—

Math Index

—

MMLU Pro

— / 100

GPQA Diamond

— / 100

HLE

— / 100

LiveCodeBench

— / 100

SciCode

— / 100

MATH-500

— / 100

AIME

— / 30

AIME 2025

— / 30

IFBench

— / 100

LCR

— / 100

Terminal-Bench Hard

— / 100

τ²-Bench

— / 100

Predicted

40.6 / 100

AA-Omniscience Hallucination RatePredicted

95.1 / 100

Aider PolyglotPredicted

31.4 / 100

AIMEPredicted

0.3 / 30

AIME 2025Predicted

0.3 / 30

AlpacaEval 2.0 LCPredicted

36.3 / 100

AlpacaEval 2.0 RawPredicted

28.4 / 100

ARC-AGI-1Predicted

5.9 / 100

ARC-AGI-1 Cost per TaskPredicted

0.0

ARC-AGI-2Predicted

0.0 / 100

ARC-AGI-2 Cost per TaskPredicted

0.0

BFCL (Berkeley Function Calling)Predicted

39.0

BigCodeBench CompletePredicted

55.3 / 100

BigCodeBench InstructPredicted

45.3 / 100

AA Intelligence Index (Matrix)Predicted

66.5

AA Long Context Reasoning (Matrix)Predicted

70.7

AIME 2024Predicted

68.8

AIME 2025 (Matrix)Predicted

57.6

Arena-Hard AutoPredicted

64.6

BrowseCompPredicted

59.4

BRUMO 2025Predicted

81.7

CMIMC 2025Predicted

71.1

CritPtPredicted

0.2

GPQA Diamond (Matrix)Predicted

64.5

GSM8KPredicted

89.4

HLE (Matrix)Predicted

13.4

HMMT Feb 2025Predicted

48.6

HMMT Nov 2025Predicted

88.9

HumanEvalPredicted

84.8

IFBench (Matrix)Predicted

36.2

IFEvalPredicted

83.4

IMO 2025Predicted

12.7

LiveCodeBench (Matrix)Predicted

54.1

MATH-500 (Matrix)Predicted

94.1

MathArena Apex 2025Predicted

0.8

MMLUPredicted

83.4

MMLU-Pro (Matrix)Predicted

73.0

MMMU-ProPredicted

80.6

MRCR v2Predicted

74.8

OSWorldPredicted

40.7

SimpleQAPredicted

23.5

SMT 2025Predicted

78.8

SWE-bench ProPredicted

36.4

Tau-Bench Telecom (Matrix)Predicted

95.4

Terminal-Bench 2.0Predicted

20.6

Terminal-Bench 1.0Predicted

15.8

USAMO 2025Predicted

6.9

Video-MMUPredicted

86.2

browsecompPredicted

56.4

BullshitBenchPredicted

14.0 / 100

Aider PolyglotPredicted

0.0

Apex AgentsPredicted

2.2

Arc Agi 2Predicted

0.0

BALROGPredicted

0.0

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.9

CAD-EvalPredicted

5.6

Chess PuzzlesPredicted

0.1

CyBenchPredicted

0.1

DeepResearchBenchPredicted

0.3

FictionLiveBenchPredicted

0.4

GdpvalPredicted

0.2

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

8.4

GSOPredicted

0.0

HellaSwagPredicted

29.8

HlePredicted

0.1

Lech Mazur WritingPredicted

7.2

OTIS Mock AIME 2024–2025Predicted

0.2

PIQAPredicted

0.9

PosttrainbenchPredicted

0.0

SimpleQA Verified (Epoch)Predicted

0.2

The Agent CompanyPredicted

1.5

TriviaQAPredicted

3.4

VPCTPredicted

0.4

WinoGrandePredicted

0.8

FrontierMathPredicted

12.3 / 100

GAIA Level 1Predicted

42.9

GAIA Level 2Predicted

21.0

GAIA Level 3Predicted

1.0

GAIAPredicted

28.4 / 100

GPQA DiamondPredicted

0.5 / 100

HLEPredicted

0.0 / 100

IFBenchPredicted

0.4 / 100

LCRPredicted

0.0 / 100

LegalBenchPredicted

84.3 / 100

LiveBench CodingPredicted

65.1 / 100

LiveBench Data AnalysisPredicted

41.2 / 100

LiveBench LanguagePredicted

50.8 / 100

LiveBench MathPredicted

59.1 / 100

LiveBench OverallPredicted

43.9 / 100

LiveBench ReasoningPredicted

37.5 / 100

LiveCodeBenchPredicted

0.4 / 100

LongBench v2 EasyPredicted

45.4

LongBench v2 HardPredicted

42.0

LongBench v2Predicted

38.0 / 100

MATH-500Predicted

0.9 / 100

MathVistaPredicted

56.1 / 100

MedQA (USMLE)Predicted

80.6

MLE-benchPredicted

19.0 / 100

MMLU ProPredicted

0.7 / 100

MMMUPredicted

68.0 / 100

MMTU Table UnderstandingPredicted

52.0 / 100

MT-BenchPredicted

8.7 / 10

NoLiMa (NIAH)Predicted

92.7 / 100

OCRBench v2Predicted

80.7 / 100

Open LLM AveragePredicted

36.5 / 100

Open LLM: BBHPredicted

63.7 / 100

Open LLM: GPQAPredicted

33.9 / 100

Open LLM: IFEvalPredicted

67.9 / 100

Open LLM: MATH Level 5Predicted

33.9 / 100

Open LLM: MMLU-PROPredicted

48.6 / 100

Open LLM: MUSRPredicted

44.0 / 100

RE-BenchPredicted

1.1

SciCodePredicted

0.3 / 100

SimpleBenchPredicted

25.4 / 100

simpleqaPredicted

22.9

SWE-bench LitePredicted

18.9 / 100

SWE-bench VerifiedPredicted

40.8 / 100

τ²-BenchPredicted

0.1 / 100

tau-bench RetailPredicted

76.6 / 100

Terminal-Bench HardPredicted

0.0 / 100

Vectara Factual ConsistencyPredicted

93.3 / 100

Vectara Hallucination RatePredicted

6.7 / 100

WebArenaPredicted

5.4 / 100

WeirdMLPredicted

27.0 / 100

WildBenchPredicted

50.4

METR Time Horizonsepoch_ai

0.2

Training Computeepoch_ai

2.578e+24