Blended Price
$8.00/M
Input Price
$4.00/M
Output Price
$20.00/M
Speed
76 tok/s
TTFT
31.08s
Hidden, no data: AgMoBench Overall, AgMoBench Reasoning, AgMoBench Coding, AgMoBench Math, AgMoBench Agentic, AgMoBench Robustness
* Shared benchmarks shown in their place: ARC-AGI-2
Axes
Filters
Providers
v3 · public-demo · Gemini 4 Carbon (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:google-gemini-4-carbon-medium
{
"provider": "Google",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "google-gemini-4-carbon",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the standard harness. Partial dataset coverage: scores use full catalog denominators; costs include recorded usage only, excluding unrecorded attempts.",
"modelsEtag": "W/\"ec09fbed9f211f59ec54cca2227c3309\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"5814b0938ba4a54ba31da46fe17d4380\"",
"upstreamModelId": "google-gemini-4-carbon-medium",
"environmentCount": 25,
"modelReleaseDate": "2026-11-10T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 7179.739444,
"providerModelIdPublished": false
}Evidence observed 2026-11-20
v3 · public-demo · Gemini 4 Carbon - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:google-gemini-4-carbon-medium-provider-adapter
{
"provider": "Google",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "google-gemini-4-carbon-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness. Partial dataset coverage: scores use full catalog denominators; costs include recorded usage only, excluding unrecorded attempts.",
"modelsEtag": "W/\"ec09fbed9f211f59ec54cca2227c3309\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"5814b0938ba4a54ba31da46fe17d4380\"",
"upstreamModelId": "google-gemini-4-carbon-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-11-10T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 4559.504952,
"providerModelIdPublished": false
}Evidence observed 2026-11-20
v3 · public-demo · Gemini 4 Carbon - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:google-gemini-4-carbon-medium-provider-adapter
{
"provider": "Google",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "google-gemini-4-carbon-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness. Partial dataset coverage: scores use full catalog denominators; costs include recorded usage only, excluding unrecorded attempts.",
"modelsEtag": "W/\"d8dfdc9958a2e1502b54603b03fbc557\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"aaa10807f3dcaae3ce6c15be7539e733\"",
"upstreamModelId": "google-gemini-4-carbon-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-11-10T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 4559.504952,
"providerModelIdPublished": false
}Evidence observed 2026-11-20
v3 · public-demo · Gemini 4 Carbon (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:google-gemini-4-carbon-medium
{
"provider": "Google",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "google-gemini-4-carbon",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the standard harness. Partial dataset coverage: scores use full catalog denominators; costs include recorded usage only, excluding unrecorded attempts.",
"modelsEtag": "W/\"d8dfdc9958a2e1502b54603b03fbc557\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"aaa10807f3dcaae3ce6c15be7539e733\"",
"upstreamModelId": "google-gemini-4-carbon-medium",
"environmentCount": 25,
"modelReleaseDate": "2026-11-10T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 7179.739444,
"providerModelIdPublished": false
}Evidence observed 2026-11-20
v3 · public-demo · Gemini 4 Carbon - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:google-gemini-4-carbon-medium-provider-adapter
{
"provider": "Google",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "google-gemini-4-carbon-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness. Partial dataset coverage: scores use full catalog denominators; costs include recorded usage only, excluding unrecorded attempts.",
"modelsEtag": "W/\"f4d8307b32b2fefe010860bedd0c5dd8\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"ef15ebd7644a875688eda094d716da9a\"",
"upstreamModelId": "google-gemini-4-carbon-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-11-10T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 4559.504952,
"providerModelIdPublished": false
}Evidence observed 2026-11-18
v3 · public-demo · Gemini 4 Carbon (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:google-gemini-4-carbon-medium
{
"provider": "Google",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "google-gemini-4-carbon",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the standard harness. Partial dataset coverage: scores use full catalog denominators; costs include recorded usage only, excluding unrecorded attempts.",
"modelsEtag": "W/\"f4d8307b32b2fefe010860bedd0c5dd8\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"ef15ebd7644a875688eda094d716da9a\"",
"upstreamModelId": "google-gemini-4-carbon-medium",
"environmentCount": 25,
"modelReleaseDate": "2026-11-10T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 7179.739444,
"providerModelIdPublished": false
}Evidence observed 2026-11-18
v3 · public-demo · Gemini 4 Carbon - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:google-gemini-4-carbon-medium-provider-adapter
{
"provider": "Google",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "google-gemini-4-carbon-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness. Partial dataset coverage: scores use full catalog denominators; costs include recorded usage only, excluding unrecorded attempts.",
"modelsEtag": "W/\"f4d8307b32b2fefe010860bedd0c5dd8\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"ef15ebd7644a875688eda094d716da9a\"",
"upstreamModelId": "google-gemini-4-carbon-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-11-10T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 4559.504952,
"providerModelIdPublished": false
}Evidence observed 2026-11-17
v3 · public-demo · Gemini 4 Carbon (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:google-gemini-4-carbon-medium
{
"provider": "Google",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "google-gemini-4-carbon",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the standard harness. Partial dataset coverage: scores use full catalog denominators; costs include recorded usage only, excluding unrecorded attempts.",
"modelsEtag": "W/\"f4d8307b32b2fefe010860bedd0c5dd8\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"ef15ebd7644a875688eda094d716da9a\"",
"upstreamModelId": "google-gemini-4-carbon-medium",
"environmentCount": 25,
"modelReleaseDate": "2026-11-10T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 7179.739444,
"providerModelIdPublished": false
}Evidence observed 2026-11-17
v3 · public-demo · Gemini 4 Carbon - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:google-gemini-4-carbon-medium-provider-adapter
{
"provider": "Google",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "google-gemini-4-carbon-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness. Partial dataset coverage: scores use full catalog denominators; costs include recorded usage only, excluding unrecorded attempts.",
"modelsEtag": "W/\"69aae253e532553a920bf4deb50ca495\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"5206202f381a21893de82dcc2db93ae9\"",
"upstreamModelId": "google-gemini-4-carbon-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-11-10T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 4559.504952,
"providerModelIdPublished": false
}Evidence observed 2026-11-16
v3 · public-demo · Gemini 4 Carbon (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:google-gemini-4-carbon-medium
{
"provider": "Google",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "google-gemini-4-carbon",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the standard harness. Partial dataset coverage: scores use full catalog denominators; costs include recorded usage only, excluding unrecorded attempts.",
"modelsEtag": "W/\"69aae253e532553a920bf4deb50ca495\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"5206202f381a21893de82dcc2db93ae9\"",
"upstreamModelId": "google-gemini-4-carbon-medium",
"environmentCount": 25,
"modelReleaseDate": "2026-11-10T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 7179.739444,
"providerModelIdPublished": false
}Evidence observed 2026-11-16
v3 · public-demo · Gemini 4 Carbon - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:google-gemini-4-carbon-medium-provider-adapter
{
"provider": "Google",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "google-gemini-4-carbon-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness. Partial dataset coverage: scores use full catalog denominators; costs include recorded usage only, excluding unrecorded attempts.",
"modelsEtag": "W/\"513aaaa353972ca0baa9c95cb95e04dd\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"169653a17d103c8dbca682167ffccaa6\"",
"upstreamModelId": "google-gemini-4-carbon-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-11-10T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 4559.504952,
"providerModelIdPublished": false
}Evidence observed 2026-11-10
v3 · public-demo · Gemini 4 Carbon (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:google-gemini-4-carbon-medium
{
"provider": "Google",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "google-gemini-4-carbon",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the standard harness. Partial dataset coverage: scores use full catalog denominators; costs include recorded usage only, excluding unrecorded attempts.",
"modelsEtag": "W/\"513aaaa353972ca0baa9c95cb95e04dd\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"169653a17d103c8dbca682167ffccaa6\"",
"upstreamModelId": "google-gemini-4-carbon-medium",
"environmentCount": 25,
"modelReleaseDate": "2026-11-10T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 7179.739444,
"providerModelIdPublished": false
}Evidence observed 2026-11-10