Benchmark Heatmap

Compare models across all benchmark scores at a glance. Colors are normalized per column (red = low, green = high).

Top

Sort by

Model	AgMoBench	AgMo Trust	AgMo Pred.	Reasoning	Coding	Math	Agentic	Robust.	AA Intel.	AA Coding	AA Math	MMLU Pro	GPQA	HLE	LiveCode	SciCode	MATH-500	AIME	AIME 25	IFBench	LCR	TB Hard	τ²-Bench	GDP-Val AA	HMMT Nov 2…	IFEval	LiveCodeBe…	SimpleQA V…	BIG-Bench …	BoolQ	CAD-Eval	Chatbot Ar…	CyBench	DeepResear…	FictionLiv…	SWE-Bench …	GDPval	Open LLM: …	SWE-Bench …	SEAL Tool …	Epoch Capa…	Hle	LongBench …	RE-Bench	GAIA	GSO	METR Time …	VPCT	WebDev Arena	LiveBench …	MMLU	SimpleQA	LAMBADA	tau-bench …	MT-Bench	tau-bench …	Aider Poly…	TruthfulQA	WebArena	Chess Puzz…	Parameter …	OTIS Mock …	NoLiMa (NI…	Training C…	OSWorld (E…	BullshitBe…	SWE-bench …	AA-Omnisci…	Open LLM: …	ARC-AGI-2	Open LLM: …	Open LLM: …	MMMU	Video-MME	BrowseComp	Arena ELO:…	FORTRESS	Propensity…	MASK	PRBench Fi…	PRBench Le…	MCP Atlas	MultiChall…	EnigmaEval	IFBench (M…	Open LLM: …	Open LLM: …	AA-Omnisci…	OmniDocBen…	IDP Core	IDP OmniDoc	OCRBench v2	ARC-AGI-1	MMTU Table…	IDP Overall	IDP OlmOCR	MedQA (USM…	Video-MME …	Video-MME …	PIQA	BFCL (Berk…	TriviaQA	LiveBench …	WinoGrande	MLE-bench	WeirdML	HuggingFac…	EQ-Bench 3	AA-Omnisci…	BRUMO 2025	HuggingFac…	Vectara Fa…	Aider Poly…	WildBench	Vectara Ha…	Chatbot Ar…	Codeforces…	CritPt	GSM8K	HMMT Feb 2…	HumanEval	MathVision	MRCR v2	OSWorld	SWE-bench …	Tau-Bench …	USAMO 2025	Video-MMU	AA Intelli…	AA Long Co…	SimpleBench	MathVista	AIME 2024	BigCodeBen…	BigCodeBen…	AIME 2025 …	AIME 2026	Arena-Hard…	GPQA Diamo…	OpenRouter…	LiveBench …	LiveBench …	ARC-AGI-1 …	ARC-AGI-2 …	LiveBench …	LongBench v2	LegalBench	FrontierMath	AlpacaEval…	AlpacaEval…	LiveBench …	HLE (Matrix)	IMO 2025	MATH-500 (…	MathArena …	SciCode (M…	OpenRouter…	Terminal-B…	BigCodeBench	CMIMC 2025	MMLU-Pro (…	MMMU-Pro	SMT 2025	Terminal-B…	GSM8K (Epo…	HellaSwag	Lech Mazur…	The Agent …	Video-MME …	GAIA Level 1	GAIA Level 2	GAIA Level 3	Apex Agents	Arc Agi 2	LongBench …	Gdpval	SWE-bench …	Open LLM A…	AIME 2025	MMLU Pro	τ²-Bench	Browsecomp	Simpleqa	LCR	AIME	Terminal-B…	IFBench	LiveCodeBe…	MATH-500	GPQA Diamond	HLE	SciCode
Gemini 3.1 Pro Preview	77.6	90.0	91.3	96.9	87.0	95.5	99.1	89.3	57.2	55.5	—	—	0.9	0.4	0.9	0.6	—	0.3	—	0.8	0.7	0.5	1.0	—	93.3	89.2	82.0	0.8	3.0	0.6	2.3	1493.0	1.1	0.5	0.7	46.1	—	53.9	—	—	156.7	0.5	57.0	100.0	70.2	0.7	57.3	0.8	1446.5	79.9	92.6	72.1	—	—	7.8	90.5	0.2	—	4.3	0.6	—	1.0	93.3	—	—	37.0	80.6	32.9	24.6	77.1	49.2	27.4	87.5	—	85.9	1455.0	—	—	—	—	—	73.9	71.4	19.8	73.4	39.8	33.3	96.8	—	—	—	86.0	98.0	73.8	—	—	96.4	—	—	0.8	56.9	27.6	84.0	1.6	67.1	72.1	—	—	55.3	99.8	—	89.6	85.6	34.5	10.4	1490.0	2700.0	17.7	84.3	97.9	95.0	69.8	84.9	72.0	54.2	99.0	69.5	94.0	57.0	76.8	79.6	61.2	98.0	37.4	29.2	100.0	97.0	74.5	94.3	293000000000.0	91.0	85.4	0.5	1.0	78.5	25.3	87.4	40.0	14.3	9.5	76.5	44.4	46.9	98.5	33.5	58.9	44.0	68.5	—	38.4	89.5	80.5	95.5	56.0	1.8	0.0	8.8	56.4	—	83.8	67.0	87.9	3.4	0.8	28.8	0.6	65.7	18.3	0.9	0.9	1.0	85.9	72.1	0.7	0.3	—	0.8	0.9	0.9	0.9	0.4	0.6
Claude Opus 4.6 (Non-reasoning, High Effort)	75.0	84.5	87.9	84.6	97.7	92.5	76.7	95.4	46.5	47.6	—	—	0.8	0.2	0.7	0.5	—	0.1	—	0.4	0.6	0.5	0.8	1606.0	37.7	94.0	76.0	0.4	3.0	0.7	60.7	1500.0	0.9	0.5	0.9	51.9	—	49.3	47.1	—	155.0	0.2	59.1	100.0	51.6	0.3	69.9	0.4	1542.7	78.2	90.8	72.0	—	—	7.9	91.9	0.2	—	7.1	0.2	—	0.9	92.0	—	—	87.0	75.6	13.5	26.3	68.8	46.7	27.4	76.5	—	84.0	1549.0	13.0	—	96.3	53.3	52.3	75.8	—	—	71.3	37.9	29.1	97.8	—	—	—	77.8	93.0	70.1	—	—	95.4	—	—	0.8	50.5	10.9	77.2	1.2	63.1	65.9	—	—	45.1	99.7	—	87.8	81.6	34.9	12.2	1502.0	2650.0	12.6	85.6	15.9	95.0	—	93.0	72.7	55.6	98.2	29.9	85.6	53.0	76.8	67.6	55.2	75.5	37.3	29.2	100.0	—	59.7	91.3	1020000000000.0	91.7	82.4	1.9	3.6	57.6	36.9	85.3	40.0	27.3	17.0	75.8	40.0	43.6	93.0	10.3	—	1.0	62.9	—	50.9	82.0	77.3	94.3	39.0	2.4	0.0	8.6	2.5	—	69.0	39.9	26.4	3.4	0.7	40.3	0.7	49.5	15.1	0.8	0.8	0.8	84.0	72.0	0.6	0.1	—	0.4	0.7	0.8	0.8	0.2	0.5
Claude Sonnet 4.6 (Non-reasoning, High Effort)	74.0	84.5	86.2	78.6	95.7	87.7	89.9	93.0	44.4	46.4	—	—	0.8	0.1	0.7	0.5	—	0.1	—	0.4	0.6	0.5	0.8	1633.0	93.5	92.0	74.0	0.4	3.0	0.7	2.9	—	0.8	0.5	0.9	—	—	60.3	—	—	152.9	0.3	49.7	100.0	46.0	0.2	36.7	0.6	1510.6	71.5	90.0	63.8	—	—	7.8	89.0	0.1	—	11.7	0.3	—	0.6	91.9	—	—	91.0	79.6	12.4	28.0	60.4	47.2	27.7	74.2	—	78.6	1523.0	—	—	—	—	—	69.4	—	—	56.5	39.5	29.3	97.5	—	—	—	85.7	86.5	69.3	—	—	92.1	—	—	0.9	52.8	15.9	76.0	1.1	62.7	66.1	—	—	40.0	99.5	—	89.4	79.1	36.5	10.6	—	2010.0	10.4	86.2	92.8	93.0	—	82.0	72.5	48.2	97.0	24.8	83.4	51.0	75.4	59.4	60.3	97.0	39.0	30.7	97.0	—	60.2	74.1	1070000000000.0	91.4	78.0	1.2	2.7	77.3	23.0	66.1	35.0	31.8	22.7	76.3	38.0	41.0	96.5	3.9	—	6.0	59.1	—	93.2	80.0	74.5	93.2	41.8	2.5	0.0	8.5	2.3	—	63.6	33.7	13.5	3.4	1.2	22.5	0.5	43.2	15.4	0.7	0.8	0.8	78.0	68.0	0.6	0.1	—	0.4	0.7	0.8	0.8	0.1	0.5
Claude Sonnet 4.6 (Non-reasoning, Low Effort)	73.3	83.5	85.7	78.5	92.5	87.7	89.9	93.0	42.6	43.0	—	—	0.8	0.1	0.7	0.4	—	0.1	—	0.4	0.6	0.4	0.8	1633.0	93.3	92.0	74.0	0.3	3.0	0.7	2.9	—	0.8	0.5	0.9	—	—	60.4	—	—	153.0	0.2	49.8	100.0	46.3	0.2	36.0	0.6	1510.6	70.6	90.0	68.0	—	—	7.8	89.0	0.1	—	11.7	0.1	—	0.9	92.0	—	—	91.0	79.6	12.4	28.4	60.4	47.5	27.8	74.2	—	78.0	1521.0	—	—	—	—	—	—	—	—	56.3	39.5	29.6	97.5	—	—	—	85.8	86.5	64.4	—	—	—	—	—	0.9	52.8	15.3	74.9	1.1	61.2	55.1	—	—	40.0	99.4	—	89.4	78.8	37.0	10.6	—	2010.0	9.2	86.2	92.4	93.0	—	82.0	72.5	48.2	97.0	24.1	83.4	51.0	75.3	58.5	60.3	96.9	39.8	31.3	97.0	—	60.4	74.1	972000000000.0	91.2	77.3	1.2	2.7	77.0	23.1	67.4	35.0	41.9	32.6	76.0	38.0	40.4	96.5	3.7	—	22.0	59.1	—	92.8	80.0	74.5	92.9	40.8	2.5	0.0	8.5	2.3	—	63.8	34.5	14.0	3.3	0.6	22.6	0.5	42.8	15.6	0.7	0.8	0.8	78.0	68.0	0.6	0.1	—	0.4	0.7	0.8	0.8	0.1	0.4
Claude Opus 4.5 (Reasoning)	72.0	86.3	87.7	86.2	93.9	72.1	76.4	96.3	49.7	47.8	91.3	0.9	0.9	0.3	0.9	0.5	—	0.4	0.9	0.6	0.7	0.5	0.9	—	95.6	90.0	68.0	0.4	3.0	0.7	2.7	1474.0	0.8	0.5	0.9	—	—	27.9	—	—	149.7	0.1	67.4	97.8	62.6	0.3	49.4	0.4	4468.0	76.0	90.8	72.0	—	—	8.2	88.9	0.1	—	12.6	0.1	—	0.8	93.7	—	66.3	90.0	74.4	—	24.2	37.6	39.6	27.3	80.7	—	67.8	1489.0	9.6	—	92.5	—	—	—	—	—	67.9	38.4	21.6	96.3	—	—	—	82.5	80.0	69.5	—	—	—	—	—	0.8	77.5	14.6	78.1	1.2	56.6	63.7	—	—	40.7	99.0	—	89.1	81.8	40.9	10.9	1468.0	2070.0	0.3	87.1	92.9	95.1	—	88.8	66.3	45.9	98.2	25.7	68.4	62.7	75.0	62.0	61.5	90.0	53.4	43.1	92.8	—	59.7	87.0	157000000000.0	80.6	74.1	1.5	2.4	62.7	41.1	84.6	21.0	69.9	67.8	75.4	37.6	38.7	85.0	1.9	—	14.0	57.8	—	96.5	80.0	80.9	91.9	39.0	2.2	0.0	8.6	56.9	—	77.9	60.9	68.1	3.1	0.1	45.1	0.6	52.4	10.6	—	—	0.9	67.8	72.0	0.7	0.4	—	0.6	0.9	0.9	0.9	0.3	0.5
Grok 4	71.9	85.0	85.3	78.1	90.7	85.4	90.6	88.2	41.5	40.5	92.7	0.9	0.9	0.2	0.8	0.5	1.0	0.9	0.9	0.5	0.7	0.4	0.7	—	93.3	91.0	82.0	0.5	3.0	0.7	2.6	1491.0	0.4	0.5	1.0	—	—	8.9	—	—	147.4	0.2	60.1	72.5	30.9	0.0	0.7	0.6	—	39.7	94.0	48.0	—	—	8.6	85.6	59.6	—	13.6	0.3	3000000000000.0	0.8	91.9	5.0000000000001e+26	—	56.0	79.0	15.3	40.2	65.1	50.9	29.1	75.0	—	62.3	—	—	—	—	—	—	—	—	—	60.0	40.8	32.6	95.1	—	—	—	87.6	89.5	64.6	—	—	92.5	—	—	0.8	63.0	9.2	25.6	1.1	37.6	45.7	—	1496.0	41.4	97.5	—	88.8	79.6	46.2	11.2	1465.0	2650.0	1.1	96.8	90.0	95.0	—	73.9	52.0	46.5	96.8	61.9	87.6	73.0	68.0	60.5	72.4	94.0	56.1	45.8	94.0	—	89.7	91.0	—	45.5	42.0	0.3	0.9	43.5	47.0	90.9	38.0	45.0	34.6	58.5	44.4	11.9	98.5	5.2	—	—	23.1	—	84.4	85.3	81.0	84.6	39.0	1.7	0.3	8.1	1.2	—	34.9	47.9	38.4	2.7	0.2	51.7	0.2	71.5	17.6	—	—	0.7	58.7	55.0	0.7	0.9	—	0.5	0.8	—	0.9	0.2	0.5
Gemini 3 Pro Preview (high)	71.1	86.8	87.2	91.7	81.8	71.8	89.3	89.3	48.4	46.5	95.7	0.9	0.9	0.4	0.9	0.6	—	0.4	1.0	0.7	0.7	0.4	0.9	—	93.3	90.0	79.7	0.7	3.0	0.6	2.6	1486.0	0.8	0.5	1.0	—	—	36.0	—	—	153.4	0.4	57.7	92.9	36.5	0.2	54.1	0.9	9824.0	73.4	91.8	72.1	—	—	8.2	88.5	0.2	—	12.2	0.3	—	0.9	93.9	—	—	48.0	69.6	—	27.3	54.0	49.6	27.8	87.5	—	85.9	1438.0	—	—	—	—	—	—	—	—	69.7	40.0	32.7	96.5	90.2	—	—	83.0	75.0	70.5	—	—	96.0	—	—	0.8	72.5	21.3	77.4	1.3	64.4	71.2	—	—	55.9	98.3	—	86.4	84.8	38.3	13.6	1501.0	2512.0	9.1	87.5	97.5	93.0	—	77.0	55.0	43.3	99.3	35.1	87.6	66.6	76.4	76.4	61.7	97.0	60.8	61.9	95.0	—	90.5	91.9	141000000000.0	81.8	84.6	0.5	30.6	74.4	41.9	87.0	19.0	16.0	10.7	74.6	37.5	43.0	97.3	23.4	56.1	20.0	56.9	—	90.0	89.8	81.0	93.4	46.4	1.9	0.0	8.8	32.8	—	48.1	34.5	38.5	3.0	0.3	45.9	0.5	63.1	17.6	—	—	0.9	85.9	72.1	0.7	0.4	—	0.7	0.9	0.9	0.9	0.4	0.6
GPT-5.2 (xhigh)	70.4	88.1	86.4	83.9	92.4	97.1	73.1	74.5	51.3	48.7	99.0	0.9	0.9	0.4	0.9	0.5	—	0.9	1.0	0.8	0.7	0.5	0.8	—	95.8	95.0	80.0	0.5	3.0	0.6	2.1	1482.0	0.8	0.5	1.0	—	—	42.6	23.8	—	153.7	0.3	62.4	81.7	33.5	0.1	38.3	0.6	1641.0	48.9	88.0	58.0	—	—	8.3	88.0	0.1	—	4.8	0.4	—	0.9	95.3	—	—	38.0	72.8	-1.0	27.7	72.9	53.1	28.6	86.7	—	77.9	1472.0	—	34.4	—	—	—	—	—	—	69.5	41.0	36.3	95.8	—	—	—	87.1	94.5	73.5	—	—	94.1	—	—	0.8	55.9	16.7	42.8	1.3	56.7	72.2	—	—	43.8	98.3	—	89.2	85.4	44.5	10.8	1440.0	2800.0	11.6	97.5	99.4	95.0	—	70.0	38.2	55.6	98.7	32.2	90.5	70.0	75.7	45.8	62.9	100.0	57.5	49.1	100.0	—	91.3	93.2	165000000000.0	58.3	50.0	11.4	39.0	47.7	46.8	87.0	40.3	31.6	22.2	76.5	35.2	38.7	99.4	13.5	54.6	9.0	54.0	—	91.3	86.7	86.5	92.0	47.2	2.1	0.0	8.7	1.7	—	36.5	50.0	39.6	3.5	0.0	51.4	0.4	68.3	20.1	—	—	0.8	77.9	58.0	0.7	0.9	—	0.8	0.9	1.0	0.9	0.4	0.5
Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort)	69.7	80.0	77.8	91.5	94.6	87.7	89.9	52.3	51.7	50.9	—	—	0.9	0.3	0.7	0.5	—	0.2	—	0.6	0.7	0.5	0.8	1633.0	92.1	87.6	48.5	0.3	3.0	0.7	3.1	—	0.7	0.5	0.8	—	—	62.4	—	—	153.0	0.2	49.4	98.6	43.6	0.0	31.1	0.5	1510.6	62.4	90.0	41.0	—	—	7.8	89.0	0.1	—	11.9	0.1	—	0.9	92.5	—	—	30.0	79.6	12.4	32.1	60.4	50.4	28.6	74.4	—	75.9	1521.0	—	—	—	—	—	—	—	—	42.3	40.3	32.2	96.9	—	—	—	85.1	86.5	61.2	—	—	—	—	—	0.9	52.1	9.8	63.7	1.1	45.9	55.0	—	1533.0	40.0	91.4	—	89.4	74.7	41.8	10.6	—	2010.0	2.7	96.2	15.9	88.0	—	82.0	42.0	48.2	97.0	7.0	85.9	51.0	74.7	47.9	60.7	43.4	45.4	36.2	97.0	—	51.6	74.1	1040000000000.0	88.5	69.5	1.2	2.7	73.8	37.9	75.5	35.0	70.7	68.3	72.6	5.8	35.3	96.5	2.0	—	7.0	59.1	—	88.2	80.0	74.5	89.6	36.4	3.3	0.0	8.4	2.1	—	60.9	43.7	10.3	2.9	0.6	41.7	0.5	36.0	17.7	0.6	0.8	0.8	78.0	15.9	0.7	0.2	—	0.6	0.7	0.9	0.9	0.3	0.5
Gemini 2.5 Pro	69.6	75.7	73.5	76.5	89.3	55.8	61.0	57.6	34.6	31.9	87.7	0.9	0.8	0.2	0.8	0.4	1.0	0.9	0.9	0.5	0.7	0.3	0.5	—	66.7	90.8	70.4	0.6	3.0	0.7	1.4	—	0.3	0.3	0.6	—	—	6.7	—	68.8	146.7	0.2	63.3	39.9	55.1	0.0	23.6	0.4	3505.0	58.3	89.8	52.9	—	—	7.9	80.6	0.0	—	14.7	0.2	—	0.8	94.7	—	—	20.0	53.6	—	46.1	4.9	56.1	27.5	84.0	—	83.2	—	—	—	—	—	—	—	—	—	52.3	37.3	40.0	95.6	88.0	—	—	86.2	37.0	66.5	—	—	93.1	—	—	0.8	55.4	7.4	70.8	0.9	59.6	54.0	—	1546.0	39.0	90.0	—	93.0	83.1	50.5	7.0	1437.0	2001.0	2.0	96.0	82.5	94.1	—	83.1	39.8	38.5	96.5	24.0	84.8	70.0	72.2	51.6	70.2	92.0	64.5	62.9	86.7	—	90.8	84.0	—	68.3	75.5	0.5	0.8	51.6	45.6	84.3	10.0	65.9	26.1	75.7	18.8	31.6	97.3	0.5	—	—	32.6	—	58.1	85.6	82.1	84.9	25.3	2.8	0.1	8.6	4.2	—	71.7	50.0	38.5	1.9	0.0	50.3	0.3	51.7	25.4	—	—	0.5	57.1	52.9	0.7	0.9	—	0.5	0.8	—	0.8	0.2	0.4
Claude Opus 4.5 (Non-reasoning)	68.9	81.1	82.8	78.5	89.7	61.3	81.8	96.3	43.1	42.9	62.7	0.9	0.8	0.1	0.7	0.5	—	0.3	0.6	0.4	0.7	0.4	0.9	—	95.6	90.0	68.0	0.4	3.0	0.7	2.8	1474.0	0.8	0.5	0.9	45.9	—	28.1	23.4	—	149.9	0.1	66.6	97.8	56.5	0.3	49.4	0.4	4468.0	76.0	90.8	72.0	—	—	8.2	88.9	0.1	—	12.6	0.1	—	0.8	93.2	—	66.3	90.0	79.2	—	25.1	37.6	39.8	27.3	80.7	—	67.8	1489.0	13.6	—	—	—	—	—	—	—	67.1	38.4	21.7	96.3	—	—	—	81.2	80.0	69.0	—	—	93.2	—	—	0.8	77.5	13.9	78.0	1.2	55.9	63.7	—	—	40.7	99.0	—	89.1	80.3	40.3	10.9	1468.0	2070.0	0.3	86.8	92.9	95.1	—	88.8	66.3	45.9	98.2	23.9	68.4	62.0	75.0	62.0	61.1	90.0	52.9	42.8	92.8	—	59.7	87.0	161000000000.0	80.6	74.1	1.5	2.4	62.6	39.7	84.6	21.0	69.8	67.7	75.4	37.6	38.5	85.0	2.0	—	29.0	57.8	—	96.5	80.0	80.6	91.8	39.0	2.4	0.0	8.6	56.9	—	73.0	51.5	44.9	3.1	0.1	43.5	0.6	47.9	10.7	—	—	0.9	67.8	72.0	0.7	0.3	—	0.4	0.7	0.9	0.8	0.1	0.5
Claude Opus 4.6 (Adaptive Reasoning, Max Effort)	68.7	79.3	76.5	92.2	97.6	67.1	86.9	60.3	53.0	48.1	—	—	0.9	0.4	0.8	0.5	—	0.4	—	0.5	0.7	0.5	0.9	1606.0	38.8	89.7	47.4	0.4	3.0	0.6	60.7	1502.0	0.9	0.5	0.9	—	—	11.4	—	—	143.7	0.2	60.5	100.0	60.8	0.3	69.9	0.4	1542.7	75.0	90.8	42.9	—	—	7.9	91.9	0.1	—	0.7	0.2	—	0.9	93.6	—	—	34.0	75.6	13.5	35.5	68.8	36.3	28.6	76.5	—	80.0	1548.0	—	—	—	—	—	—	—	—	65.9	37.8	19.1	97.4	—	—	—	82.3	93.0	73.2	—	—	—	—	—	0.8	53.4	13.9	73.1	1.2	63.1	78.0	—	—	45.1	98.9	—	87.8	81.1	41.2	12.2	1502.0	1886.0	0.3	96.9	15.9	95.0	—	93.0	38.2	35.8	98.2	24.5	86.2	53.0	75.0	67.6	57.9	75.5	45.3	36.0	100.0	—	59.7	91.3	1020000000000.0	89.2	79.3	1.9	3.6	54.4	40.8	85.3	10.0	27.3	17.0	74.3	7.1	38.2	94.4	1.8	—	11.0	43.2	—	49.4	86.6	77.3	91.6	39.0	5.0	0.0	8.6	2.7	—	76.5	58.6	61.9	3.4	0.7	44.8	0.6	50.6	9.4	0.9	0.9	0.9	84.0	22.8	0.7	0.4	—	0.5	0.8	0.9	0.9	0.4	0.5
GPT-5.2 (medium)	67.5	85.2	83.3	79.3	91.2	96.7	67.3	69.3	46.6	44.2	96.7	0.9	0.9	0.2	0.9	0.5	—	0.8	1.0	0.7	0.6	0.4	0.7	—	95.8	95.0	80.0	0.5	3.0	0.7	2.2	1482.0	0.7	0.5	1.0	—	—	42.7	—	—	153.8	0.3	60.9	81.7	32.3	0.1	38.3	0.6	1641.0	48.9	88.0	58.0	—	—	8.3	88.0	0.1	—	4.7	0.4	—	0.9	95.1	—	—	27.0	65.0	-1.0	29.4	72.9	53.2	28.6	86.7	—	77.9	1472.0	—	—	—	—	—	—	—	—	67.8	41.0	36.5	95.8	—	—	—	86.4	94.5	70.1	—	—	—	—	—	0.8	55.9	15.9	42.8	1.2	55.8	60.7	—	—	43.8	98.3	—	89.2	84.8	44.0	10.8	1440.0	2800.0	11.6	97.2	99.4	95.0	—	70.0	38.2	55.6	98.7	30.4	90.5	70.0	75.7	45.8	62.6	100.0	57.3	48.9	100.0	—	89.8	93.2	193000000000.0	58.3	50.0	11.4	39.0	47.7	45.7	86.5	40.3	31.6	22.1	76.5	35.2	38.4	99.4	13.5	54.6	16.0	54.0	—	91.3	86.7	86.5	92.0	46.7	2.4	0.0	8.7	1.6	—	35.8	48.5	39.1	3.5	0.0	50.2	0.4	65.0	20.3	—	—	0.7	77.9	58.0	0.6	0.8	—	0.7	0.9	1.0	0.9	0.2	0.5
GPT-5.1 (high)	67.4	85.7	84.3	90.2	95.4	85.1	60.9	64.2	47.7	44.7	94.0	0.9	0.9	0.3	0.9	0.4	—	0.7	0.9	0.7	0.8	0.5	0.8	—	91.7	92.5	82.0	0.5	3.0	0.6	2.5	—	0.7	0.5	0.9	—	—	10.1	—	—	149.7	0.3	58.6	96.0	49.5	0.0	16.3	0.6	—	72.0	90.0	55.4	—	—	7.9	88.2	2.0	—	12.6	0.2	—	1.4	91.6	—	—	25.0	76.3	—	28.6	17.6	51.5	28.4	85.4	—	64.7	—	—	—	—	48.0	49.3	—	—	—	62.2	40.6	34.1	96.3	—	—	—	86.7	72.8	69.5	—	—	96.4	—	—	0.8	58.5	14.9	78.8	1.2	45.2	60.8	—	—	40.6	93.3	—	87.9	83.6	43.1	12.1	1464.0	—	6.2	89.8	89.7	94.4	—	77.1	52.0	45.0	98.0	30.3	88.5	64.4	75.0	53.2	72.7	99.1	48.1	38.4	94.0	—	87.1	88.1	—	86.9	79.3	0.7	1.2	69.6	28.6	85.7	31.0	50.0	41.3	72.5	32.0	38.1	99.0	1.0	—	—	47.6	—	91.9	87.5	85.4	91.0	41.6	2.3	0.0	8.6	33.7	—	64.6	48.4	45.3	2.7	0.0	28.8	0.4	74.4	18.5	—	—	0.8	60.0	55.0	0.8	0.7	—	0.7	0.9	1.0	0.9	0.3	0.4
Kimi K2.5 (Reasoning)	64.6	80.0	81.1	88.0	76.8	83.8	64.5	70.7	46.8	39.5	—	—	0.9	0.3	0.8	0.5	—	0.4	—	0.7	0.7	0.3	1.0	—	89.2	90.0	85.0	0.5	3.0	0.6	2.7	—	0.6	0.5	0.9	—	—	2.7	—	—	148.2	0.2	55.8	98.0	34.0	0.0	40.8	0.6	—	69.1	92.0	45.0	—	—	7.8	88.0	0.2	—	0.7	0.3	—	1.0	90.0	—	63.3	52.0	70.8	-8.1	22.5	11.8	49.7	27.7	84.0	—	74.9	1442.0	—	—	—	—	—	—	—	—	67.4	39.8	30.0	96.3	89.3	—	—	86.3	65.3	56.6	—	—	94.4	—	—	0.8	55.2	31.9	76.0	1.4	60.1	45.6	745208.0	—	43.4	98.3	34.0	85.8	82.3	41.3	14.2	—	2350.0	5.6	95.9	95.4	95.0	84.2	77.8	62.0	47.2	96.2	26.4	86.6	63.0	75.2	46.8	70.6	96.1	45.6	36.2	96.0	—	89.0	87.6	636000000000.0	84.9	77.7	0.1	0.3	61.4	41.7	83.6	28.0	36.4	26.7	77.9	50.2	38.7	98.0	8.8	—	28.0	43.2	—	91.3	87.1	78.5	90.6	39.9	2.4	0.0	8.6	23.9	—	46.3	31.8	32.8	2.5	0.1	40.5	0.4	79.5	14.6	0.9	0.9	1.0	74.9	45.0	0.7	0.4	—	0.7	0.8	0.9	0.9	0.3	0.5
Grok 4.1 Fast (Reasoning)	64.3	78.3	75.1	70.3	87.2	88.0	92.6	52.9	38.6	30.9	89.3	0.9	0.9	0.2	0.8	0.4	—	0.9	0.9	0.5	0.7	0.2	0.9	—	93.3	91.0	82.0	0.3	3.0	0.7	2.7	1464.0	0.4	0.4	0.8	—	—	7.2	—	—	—	0.2	59.6	79.6	40.3	0.1	1.6	0.5	3721.0	33.5	90.3	55.0	—	—	8.0	81.4	0.1	—	13.8	0.2	—	1.2	91.2	—	—	19.0	79.0	-28.7	32.7	42.0	51.4	29.2	83.3	—	61.4	—	—	—	—	—	—	—	—	—	58.6	40.9	33.1	94.9	—	—	—	87.6	42.7	65.6	—	—	—	—	—	0.8	69.6	8.5	23.4	0.9	52.7	57.2	—	—	42.5	97.5	—	80.8	80.5	50.3	19.2	1483.0	2650.0	5.0	84.3	92.7	95.0	—	75.6	52.0	39.0	96.7	43.9	87.6	72.8	72.5	56.0	70.0	98.4	56.7	46.4	94.0	—	92.1	91.0	488000000000.0	38.9	50.0	0.2	0.3	40.6	50.5	87.6	38.0	33.1	25.6	54.3	44.4	16.4	98.5	5.2	—	2.0	38.6	—	84.4	85.3	81.0	84.6	38.6	3.4	0.0	8.4	1.2	—	52.7	41.0	41.2	2.6	0.0	55.5	0.3	78.1	18.0	—	—	0.9	57.6	55.0	0.7	0.9	—	0.5	0.8	1.0	0.9	0.2	0.4
GPT-5 (high)	60.4	77.4	76.4	76.3	90.3	75.6	48.6	62.0	44.6	36.0	94.3	0.9	0.9	0.3	0.8	0.4	1.0	1.0	0.9	0.7	0.8	0.3	0.8	—	89.2	90.0	84.5	0.4	3.0	0.7	1.8	—	0.5	0.5	0.9	—	—	4.6	—	—	150.0	0.3	59.4	95.7	52.8	0.0	41.3	0.4	—	60.0	91.0	48.0	—	—	8.3	86.4	0.1	—	13.0	0.2	—	1.3	94.7	—	—	21.0	75.6	—	29.0	0.0	50.7	28.8	74.4	—	59.2	—	—	—	—	51.3	49.0	—	63.2	—	61.1	40.5	34.5	95.8	—	—	—	86.7	6.0	69.6	—	—	96.3	—	—	0.8	54.2	10.7	63.1	1.1	39.6	60.7	—	1586.0	38.9	91.7	—	84.9	81.3	47.6	15.1	1460.0	2537.0	5.7	88.5	88.3	94.0	—	77.4	40.0	41.8	97.0	22.4	75.9	68.0	75.6	56.7	71.3	94.6	35.3	27.1	94.6	—	88.6	88.4	—	72.4	70.0	0.0	0.1	48.0	45.9	86.0	25.2	55.2	46.8	78.6	35.2	38.1	99.4	1.0	—	—	35.2	—	90.0	87.0	82.0	92.0	41.3	0.7	0.0	8.6	3.6	—	67.9	53.1	47.9	2.6	0.2	50.5	0.3	75.4	20.3	—	—	0.8	54.9	55.0	0.8	1.0	—	0.7	0.8	—	0.9	0.3	0.4
GPT-5 (medium)	60.2	78.2	75.9	83.9	87.3	74.4	48.6	56.4	42.0	39.0	91.7	0.9	0.8	0.2	0.7	0.4	1.0	0.9	0.9	0.7	0.7	0.4	0.9	—	89.2	90.0	84.5	0.4	3.0	0.6	1.7	—	0.5	0.5	0.9	—	—	18.0	—	—	150.0	0.3	59.4	95.7	53.0	0.0	42.6	0.4	—	60.0	91.0	49.6	—	—	8.3	87.0	0.1	—	12.8	0.2	—	1.1	94.6	—	—	18.0	75.6	—	27.9	18.3	49.0	28.5	74.4	—	60.2	—	—	—	—	—	—	—	—	—	59.6	40.3	30.7	95.9	—	—	—	86.8	70.2	69.1	—	—	—	—	—	0.8	54.3	12.4	63.1	1.2	39.6	60.4	—	1586.0	38.9	91.7	—	84.9	81.3	45.9	15.1	1460.0	2537.0	5.7	88.6	88.3	94.0	—	77.7	40.0	41.8	97.0	24.9	75.9	68.0	75.6	56.7	72.0	94.6	34.5	26.3	94.6	—	88.5	88.4	—	72.4	70.0	4.8	7.1	48.0	45.3	86.0	25.2	54.5	46.3	78.6	35.2	38.1	99.4	1.0	—	—	35.2	—	90.0	87.0	81.9	92.0	41.3	0.4	0.0	8.7	3.6	—	68.0	52.9	48.0	2.6	0.2	49.9	0.4	76.2	16.0	—	—	0.9	54.9	55.0	0.7	0.9	—	0.7	0.7	—	0.8	0.2	0.4
GPT-5.2 (Non-reasoning)	59.9	75.6	74.4	63.2	79.7	80.9	67.3	69.3	33.6	34.7	51.0	0.8	0.7	0.1	0.7	0.4	—	0.6	0.5	0.5	0.4	0.3	0.5	—	95.8	95.0	80.0	0.5	3.0	0.7	2.5	1482.0	0.6	0.5	1.0	—	—	43.0	—	—	153.8	0.3	57.9	81.7	29.2	0.1	38.3	0.6	1641.0	48.9	88.0	58.0	—	—	8.3	88.0	0.1	—	4.7	0.4	—	0.9	94.4	—	—	27.0	65.0	-1.0	32.7	72.9	53.4	28.6	86.7	—	75.5	1472.0	—	—	—	—	—	—	—	—	64.6	40.9	36.7	95.7	—	—	—	84.7	94.5	69.3	—	—	—	—	—	0.8	55.9	14.5	42.8	1.2	54.5	60.7	—	—	43.8	98.3	—	89.2	83.2	43.0	10.8	1440.0	2800.0	11.6	96.5	99.4	95.0	—	70.0	38.2	55.6	98.7	27.0	90.5	70.0	75.7	45.8	62.1	100.0	56.6	48.4	100.0	—	86.2	93.2	180000000000.0	58.3	50.0	11.4	39.0	47.7	43.5	85.3	40.3	31.4	22.1	76.5	35.2	38.0	99.4	13.5	54.6	9.0	54.0	—	91.3	86.7	86.5	92.0	45.8	2.7	0.0	8.7	1.4	—	33.8	44.5	36.1	3.5	0.0	47.8	0.4	58.0	20.6	—	—	0.5	77.9	58.0	0.4	0.6	—	0.5	0.7	0.9	0.7	0.1	0.4
Kimi K2.5 (Non-reasoning)	59.8	74.0	76.5	77.2	64.3	83.8	64.5	70.7	37.3	25.8	—	—	0.8	0.1	0.7	0.4	—	0.3	—	0.4	0.6	0.2	0.8	—	89.2	90.0	85.0	0.5	3.0	0.7	3.0	—	0.6	0.5	0.9	—	—	2.7	—	—	148.0	0.2	53.3	97.9	30.8	0.0	40.0	0.6	—	69.1	92.0	45.0	—	—	7.8	88.1	0.1	—	0.6	0.3	—	0.7	89.7	—	63.3	52.0	70.8	-8.1	22.5	11.8	49.7	27.7	84.0	—	74.9	1442.0	—	—	—	—	—	—	—	—	66.3	39.8	30.0	96.2	—	—	—	85.6	65.3	55.9	—	—	—	—	—	0.8	52.0	31.6	76.0	1.4	59.8	45.6	482783.0	—	43.5	98.3	66.0	85.8	80.4	40.3	14.2	—	2350.0	5.5	95.1	95.4	95.0	84.2	77.8	62.0	47.7	96.2	24.0	86.6	62.1	75.2	46.8	66.9	96.1	44.1	35.0	96.0	—	87.2	87.6	558000000000.0	84.9	77.7	0.1	0.3	61.4	39.8	82.2	28.0	36.3	26.6	77.9	50.2	38.5	98.0	8.8	—	3.0	43.2	—	91.3	87.1	78.5	90.6	39.2	3.0	0.0	8.6	23.8	—	43.7	26.8	21.0	2.5	0.1	39.7	0.4	77.1	14.6	0.8	0.8	0.8	74.9	45.0	0.6	0.3	—	0.4	0.7	0.9	0.8	0.1	0.4
GPT-5.3 Codex (xhigh)	59.5	87.3	87.1	96.5	99.2	92.8	—	65.3	54.0	53.1	—	—	0.9	0.4	0.8	0.5	—	0.3	—	0.8	0.7	0.5	0.9	—	96.0	92.0	85.0	0.6	3.0	0.6	2.4	—	0.8	0.5	1.0	—	—	3.7	—	—	—	0.4	77.9	79.4	68.2	0.2	54.7	0.7	—	72.8	94.0	67.7	—	—	8.3	90.4	0.2	—	12.3	0.3	—	1.3	88.5	—	—	24.0	56.8	9.9	26.8	82.1	38.7	26.9	84.0	—	78.5	—	—	—	—	—	—	—	—	—	63.4	38.5	23.5	96.5	—	—	—	84.6	91.7	75.0	—	—	—	—	—	0.9	57.0	20.7	80.2	1.4	62.7	79.3	—	—	51.8	99.6	—	86.1	89.1	37.8	13.9	—	—	14.4	99.0	96.4	93.0	—	81.5	64.7	56.8	98.7	33.8	86.1	66.4	76.7	67.5	72.9	99.3	41.5	32.6	94.0	—	83.4	81.0	—	87.8	80.1	1.5	3.5	62.7	41.1	75.2	35.3	21.9	17.1	78.2	20.0	42.9	96.0	8.3	—	—	64.7	—	37.6	86.7	80.8	97.6	48.5	2.5	0.0	8.7	37.2	—	82.2	66.6	84.1	3.3	0.1	72.5	0.6	60.5	12.3	0.9	0.9	0.9	78.2	59.8	0.7	0.3	—	0.8	0.8	0.9	0.9	0.4	0.5
DeepSeek V3.2 Speciale	59.3	81.4	82.4	89.1	94.0	94.3	75.3	—	29.4	37.9	96.7	0.9	0.9	0.3	0.9	0.4	—	0.3	1.0	0.6	0.6	0.3	0.0	—	93.3	88.0	88.7	0.5	3.0	0.7	1.3	—	0.5	0.5	0.9	—	—	5.0	—	—	—	0.3	54.6	97.3	29.2	0.1	16.4	0.3	—	67.9	90.3	55.7	—	—	7.9	88.3	0.1	—	12.1	0.2	—	0.8	88.9	—	—	40.7	76.0	—	34.0	37.3	52.9	28.4	82.1	—	75.0	—	—	—	—	—	—	—	—	—	68.5	40.7	36.2	97.5	—	—	—	82.1	79.7	65.0	—	—	—	—	—	0.7	53.7	14.9	71.8	0.9	56.4	46.7	—	—	43.2	99.2	—	88.0	81.0	40.4	12.1	—	2701.0	7.6	89.9	99.2	91.5	—	76.4	38.0	40.5	98.3	64.5	84.2	62.3	81.5	59.2	70.3	96.0	26.9	20.4	96.0	—	80.8	85.7	—	88.1	77.8	0.7	1.4	64.3	40.6	83.5	29.2	24.5	19.1	66.0	30.6	83.3	98.0	9.4	—	—	54.4	—	94.4	87.5	80.8	89.2	43.0	3.0	0.0	8.4	2.7	—	39.7	26.6	26.4	3.0	0.0	44.6	0.5	70.1	20.4	—	—	0.0	74.3	52.0	0.6	0.3	—	0.6	0.9	1.0	0.9	0.3	0.4
Gemini 3 Flash Preview (Non-reasoning)	58.6	75.7	73.0	77.3	75.9	56.0	75.2	62.3	35.0	37.8	55.7	0.9	0.8	0.1	0.8	0.5	—	0.3	0.6	0.6	0.5	0.3	0.4	—	93.3	88.2	90.8	0.7	3.0	0.7	2.7	1474.0	0.7	0.5	0.9	—	—	3.7	—	—	150.9	0.3	55.5	96.0	25.7	0.1	17.0	0.7	3053.0	72.4	91.8	60.0	—	—	7.9	82.0	0.2	—	12.8	0.4	—	0.9	93.6	—	—	10.0	75.8	11.6	27.1	33.6	47.7	27.9	87.6	—	75.0	1437.0	—	—	—	—	—	—	—	—	85.5	39.8	29.8	96.3	90.4	—	—	85.4	84.7	67.8	—	—	95.8	—	—	0.8	22.3	16.5	74.5	1.3	62.7	65.2	—	—	45.5	100.0	—	86.5	82.7	39.8	13.5	1473.0	2100.0	7.7	88.8	97.8	94.8	—	75.2	50.0	34.6	98.4	58.4	86.9	62.1	75.6	61.1	61.5	93.0	60.8	61.3	90.4	—	88.8	90.4	985000000000.0	84.2	84.6	0.2	0.2	74.8	28.8	86.9	30.0	27.9	19.2	73.9	33.7	40.1	98.3	15.6	—	2.0	51.7	—	90.6	88.6	81.2	92.9	43.9	2.4	0.0	8.7	31.6	—	31.7	25.1	29.5	3.3	0.0	38.6	0.4	55.0	15.5	—	—	0.4	75.0	60.0	0.5	0.3	—	0.6	0.8	0.9	0.8	0.1	0.5
o3	58.3	76.5	73.1	86.5	87.0	60.3	38.0	61.0	38.4	38.4	88.3	0.9	0.8	0.2	0.8	0.4	1.0	0.9	0.9	0.7	0.7	0.4	0.8	—	94.2	92.1	75.8	0.5	3.0	0.7	4.0	—	0.4	0.5	0.8	—	—	1.0	—	—	147.2	0.2	57.1	72.3	21.9	0.1	30.0	0.5	—	50.2	93.3	48.6	—	—	8.3	86.9	13.8	—	1.5	0.2	—	0.8	94.4	—	9.1	26.0	58.4	—	15.1	6.5	29.4	25.8	82.9	—	49.7	—	—	10.5	—	—	—	—	—	13.1	69.3	36.2	11.6	97.1	—	—	—	85.0	60.8	69.1	—	—	96.1	—	—	0.8	63.0	48.1	62.9	0.8	31.6	52.4	—	1665.0	40.9	95.8	—	89.6	76.9	45.6	10.4	—	2706.0	1.4	96.1	77.5	88.4	—	77.1	48.7	43.5	97.6	21.9	86.5	65.3	69.0	53.1	59.7	96.7	59.9	55.9	88.9	—	85.9	87.7	—	62.0	68.4	0.5	0.8	50.2	43.7	85.5	10.0	76.9	69.1	76.0	19.8	16.7	99.2	2.7	—	—	40.3	—	79.4	85.9	75.0	87.7	30.2	0.3	0.0	8.4	2.9	—	36.6	18.2	6.1	2.7	0.0	48.0	0.3	68.6	4.3	—	—	0.8	49.7	49.4	0.7	0.9	—	0.7	0.8	—	0.8	0.2	0.4
Qwen3.5 397B A17B (Reasoning)	57.8	85.3	82.1	96.6	91.8	96.0	—	60.8	45.0	41.3	—	—	0.9	0.3	0.8	0.4	—	0.5	—	0.8	0.7	0.4	1.0	—	92.7	92.6	83.6	0.5	3.0	0.6	2.6	—	0.6	0.5	0.9	—	—	5.9	—	—	—	0.3	56.9	99.7	68.4	0.1	17.4	0.6	—	67.5	88.6	43.6	—	—	7.9	88.0	0.2	—	12.3	0.2	—	1.1	91.1	—	—	78.0	76.4	-29.8	32.0	42.6	43.9	28.4	85.0	—	73.8	—	—	—	—	—	—	—	—	—	76.5	39.8	28.0	97.5	—	—	—	88.1	81.3	68.0	—	—	—	—	—	0.9	56.6	15.4	71.0	1.5	57.3	56.8	—	—	44.1	97.9	—	88.0	85.7	41.6	12.0	—	2200.0	6.1	89.7	94.2	92.0	90.3	80.1	54.8	47.1	98.2	27.7	86.3	63.3	75.2	60.8	71.7	94.0	46.1	36.6	95.0	91.3	84.7	88.4	—	80.6	74.1	0.7	1.6	62.7	42.5	81.1	28.3	25.1	19.6	74.4	32.0	40.2	98.0	4.7	—	—	51.4	—	91.4	87.8	81.2	92.0	41.5	2.5	0.0	8.6	3.0	—	82.2	37.1	85.1	2.9	0.0	46.6	0.4	73.3	15.5	0.9	0.9	1.0	72.6	35.0	0.7	0.5	—	0.8	0.8	0.9	0.9	0.3	0.4
GPT-5 (low)	57.6	75.2	73.0	78.3	83.1	69.6	48.6	56.4	39.2	30.7	83.0	0.9	0.8	0.2	0.8	0.4	1.0	0.8	0.8	0.7	0.6	0.3	0.8	—	89.2	90.0	84.5	0.4	3.0	0.7	1.8	—	0.5	0.5	0.9	—	—	18.0	—	—	150.0	0.3	58.1	95.7	51.5	0.0	42.5	0.4	—	60.0	91.0	49.5	—	—	8.3	87.1	0.1	—	12.7	0.2	—	1.1	94.5	—	—	18.0	75.6	—	28.3	18.3	48.9	28.4	74.4	—	60.6	—	—	—	—	—	—	—	—	—	59.2	40.2	30.6	95.9	—	—	—	86.5	70.2	68.8	—	—	—	—	—	0.8	53.7	12.3	63.1	1.1	39.6	60.4	—	1586.0	38.9	91.7	—	84.9	81.3	45.1	15.1	1460.0	2537.0	5.7	88.4	88.3	94.0	—	77.7	40.0	41.8	97.0	24.0	75.8	68.0	75.6	56.7	69.8	94.6	34.1	25.9	94.6	—	87.8	88.4	—	72.4	70.0	4.8	7.1	48.0	44.2	86.0	25.2	54.3	46.2	78.6	35.2	38.1	99.4	1.0	—	—	35.2	—	90.0	87.0	81.7	92.0	41.3	0.3	0.0	8.6	5.2	—	67.1	51.0	46.2	2.7	0.2	48.7	0.4	75.1	16.0	—	—	0.8	54.9	55.0	0.6	0.8	—	0.7	0.8	—	0.8	0.2	0.4
GPT-4.1	55.5	53.3	53.0	51.0	66.3	45.5	44.3	44.1	26.3	21.8	34.7	0.8	0.7	0.0	0.5	0.4	0.9	0.4	0.3	0.4	0.6	0.1	0.5	—	92.9	87.4	44.7	0.4	3.0	0.8	7.3	—	0.2	0.3	0.5	—	—	42.5	—	—	137.5	0.1	55.0	0.0	69.7	0.0	0.4	0.4	—	46.0	90.2	42.3	—	—	8.9	74.8	0.0	—	18.5	0.1	—	0.4	97.0	—	—	14.0	2.8	—	63.9	0.4	26.1	24.2	74.8	—	72.6	—	—	—	—	—	—	—	—	—	43.2	29.9	19.9	95.2	—	74.7	79.9	83.4	5.5	51.4	68.0	49.4	91.2	—	—	0.8	54.0	3.6	35.1	0.8	30.2	39.0	—	1519.0	38.6	73.3	—	94.4	78.2	53.6	5.6	—	1807.0	0.2	92.8	19.4	92.0	—	80.0	32.4	32.3	94.8	9.3	86.7	68.9	68.7	27.0	66.0	46.5	41.4	32.2	46.4	—	61.5	66.3	—	56.5	48.5	0.0	0.1	43.2	42.4	90.1	10.9	35.3	30.1	73.8	3.7	4.8	92.4	0.4	—	—	23.3	—	69.1	81.8	81.6	77.9	30.3	16.7	7.9	8.2	1.9	—	86.8	70.9	30.8	1.8	0.0	46.9	0.1	2.7	14.6	—	—	0.5	50.7	41.6	0.6	0.4	—	0.4	0.5	—	0.7	0.0	0.4
Gemini 3 Pro Preview (low)	55.4	86.1	84.7	87.9	94.3	54.9	86.4	—	41.3	39.4	86.7	0.9	0.9	0.3	0.9	0.5	—	0.8	0.9	0.5	0.7	0.3	0.7	—	93.3	93.0	87.8	0.7	3.0	0.7	2.3	—	0.8	0.5	1.0	—	—	18.1	17.9	—	—	0.4	58.3	100.0	72.8	0.2	54.1	0.9	9824.0	73.4	91.3	63.5	—	—	7.9	89.8	0.3	—	0.4	0.3	—	0.9	94.1	—	—	48.0	69.6	—	23.8	31.1	45.0	27.4	85.6	—	76.9	—	—	—	—	—	—	70.8	65.7	18.2	75.7	39.3	27.0	96.5	—	—	—	83.6	75.0	72.7	—	—	—	—	—	0.8	72.5	20.3	77.4	1.0	64.4	69.9	—	—	47.1	99.5	—	86.4	90.2	39.2	13.6	—	—	12.3	96.8	96.5	94.7	—	81.2	58.6	49.8	98.5	53.0	87.1	71.1	76.2	76.4	70.7	99.4	61.3	62.3	99.9	—	86.1	92.4	139000000000.0	81.8	84.6	0.5	0.8	74.4	42.6	83.8	19.0	68.5	66.5	74.6	43.6	48.4	98.8	7.1	—	17.0	59.3	—	91.4	87.8	81.2	93.5	48.1	3.2	0.0	8.6	32.9	—	85.4	74.2	92.7	3.0	0.3	46.6	0.5	71.6	13.4	—	—	0.7	76.3	59.8	0.7	0.8	—	0.5	0.9	1.0	0.9	0.3	0.5
Qwen3.5 397B A17B (Non-reasoning)	55.3	81.6	78.8	86.1	89.4	96.0	—	60.8	40.1	37.4	—	—	0.9	0.2	0.8	0.4	—	0.5	—	0.5	0.6	0.4	0.8	—	92.2	92.6	83.6	0.5	3.0	0.7	2.9	—	0.5	0.4	0.8	—	—	8.0	—	—	—	0.2	55.6	98.7	64.0	0.0	10.6	0.6	—	63.9	88.6	35.0	—	—	7.9	86.5	0.1	—	12.4	0.2	—	0.9	91.1	—	—	78.0	76.4	-29.8	36.9	17.1	47.1	29.3	85.0	—	71.4	—	—	—	—	—	—	—	—	—	76.5	40.5	30.9	97.2	—	—	—	88.1	69.5	66.0	—	—	—	—	—	0.9	54.5	12.4	66.1	1.5	50.5	53.6	—	—	43.4	97.6	—	89.0	80.9	43.2	11.0	—	2200.0	3.6	89.4	91.5	92.0	90.3	79.3	52.1	45.2	97.9	23.2	86.3	64.0	74.5	55.4	70.9	94.0	47.9	38.3	95.0	91.3	83.1	88.4	—	77.7	70.8	0.4	0.9	59.3	42.2	82.3	24.9	26.9	20.9	73.0	32.0	34.5	98.0	3.5	—	—	35.7	—	89.3	87.8	81.2	90.6	36.7	3.0	0.0	8.4	2.7	—	79.0	35.1	73.6	2.2	0.0	46.3	0.4	71.1	18.0	0.9	0.9	0.8	69.9	35.0	0.6	0.5	—	0.5	0.8	0.9	0.9	0.2	0.4
Kimi K2 Thinking	53.2	78.7	79.0	84.3	89.8	91.5	45.7	—	40.9	34.8	94.7	0.8	0.8	0.2	0.9	0.4	—	0.8	0.9	0.7	0.7	0.3	0.9	—	89.2	91.5	82.6	0.3	3.0	0.7	2.8	—	0.5	0.5	0.8	—	—	2.7	—	—	145.5	0.2	57.9	91.5	48.3	0.0	0.6	0.5	7336.0	61.6	90.3	35.0	—	—	8.6	83.4	0.1	—	2.5	0.2	—	0.8	91.6	—	—	43.0	63.4	—	22.5	4.5	49.7	27.7	82.7	—	60.2	—	—	—	—	—	—	—	—	—	58.3	39.8	30.0	95.8	—	—	—	85.1	12.0	56.8	—	—	92.6	—	—	0.8	56.4	29.8	63.5	0.9	40.4	42.8	—	—	24.2	93.3	—	90.4	80.8	47.7	9.6	—	2150.0	4.0	96.2	89.4	92.0	—	77.3	44.4	41.2	97.2	8.1	86.7	66.7	73.2	39.6	70.8	94.0	53.4	43.3	94.5	—	86.9	85.7	—	81.1	66.5	0.2	0.4	52.3	44.9	87.0	24.6	59.9	52.9	67.4	44.9	50.6	97.0	0.0	—	—	35.7	—	91.9	84.6	79.8	91.0	36.4	3.0	0.0	8.6	4.0	—	63.7	48.0	43.6	1.6	0.1	49.4	0.3	72.7	14.6	—	—	0.9	60.2	35.0	0.7	0.8	—	0.7	0.9	1.0	0.8	0.2	0.4

Low

High(normalized per column)Predicted