Closed-weight OpenAI reasoning model for agentic, coding, and research workloads, with text and image input and text output.
Blended Price
$20.00/M
Input Price
$10.00/M
Output Price
$50.00/M
Speed
49 tok/s
TTFT
234.63s
v3 · public-demo · GPT-6 Astra - Provider Adapter (Low) · effort low · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-low-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'low' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"8ea4d2292a0a8c759aa7e80a2041122d\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"94fd3d68aacca744ff3c39f63a187685\"",
"upstreamModelId": "openai-gpt-6-astra-low-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 21297.922310000005,
"providerModelIdPublished": false
}Evidence observed 2026-11-06
v3 · public-demo · GPT-6 Astra - Provider Adapter (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'none' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"8ea4d2292a0a8c759aa7e80a2041122d\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"94fd3d68aacca744ff3c39f63a187685\"",
"upstreamModelId": "openai-gpt-6-astra-none-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 23456.663940000002,
"providerModelIdPublished": false
}Evidence observed 2026-11-06
v3 · public-demo · GPT-6 Astra - Provider Adapter (High) · effort high · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-high-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'high' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"8ea4d2292a0a8c759aa7e80a2041122d\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"94fd3d68aacca744ff3c39f63a187685\"",
"upstreamModelId": "openai-gpt-6-astra-high-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18816.63138,
"providerModelIdPublished": false
}Evidence observed 2026-11-06
v3 · public-demo · GPT-6 Astra (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'none' reasoning effort.",
"modelsEtag": "W/\"8ea4d2292a0a8c759aa7e80a2041122d\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"94fd3d68aacca744ff3c39f63a187685\"",
"upstreamModelId": "openai-gpt-6-astra-none",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 49791.11317000001,
"providerModelIdPublished": false
}Evidence observed 2026-11-06
v3 · public-demo · GPT-6 Astra (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'max' reasoning effort.",
"modelsEtag": "W/\"8ea4d2292a0a8c759aa7e80a2041122d\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"94fd3d68aacca744ff3c39f63a187685\"",
"upstreamModelId": "openai-gpt-6-astra-max",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 26097.501720000007,
"providerModelIdPublished": false
}Evidence observed 2026-11-06
v3 · public-demo · GPT-6 Astra - Provider Adapter (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'max' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"8ea4d2292a0a8c759aa7e80a2041122d\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"94fd3d68aacca744ff3c39f63a187685\"",
"upstreamModelId": "openai-gpt-6-astra-max-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 17331.95327,
"providerModelIdPublished": false
}Evidence observed 2026-11-06
v3 · public-demo · GPT-6 Astra - Provider Adapter (XHigh) · effort xhigh · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-xhigh-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'xhigh' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"8ea4d2292a0a8c759aa7e80a2041122d\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"94fd3d68aacca744ff3c39f63a187685\"",
"upstreamModelId": "openai-gpt-6-astra-xhigh-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18147.191119999996,
"providerModelIdPublished": false
}Evidence observed 2026-11-06
v3 · public-demo · GPT-6 Astra - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-medium-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"8ea4d2292a0a8c759aa7e80a2041122d\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"94fd3d68aacca744ff3c39f63a187685\"",
"upstreamModelId": "openai-gpt-6-astra-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 19284.776630000004,
"providerModelIdPublished": false
}Evidence observed 2026-11-06
v3 · public-demo · GPT-6 Astra - Provider Adapter (High) · effort high · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-high-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'high' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"c4baed683b2f33c40537f2338682475f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"48d1fd5bf96ae9583213f6699f12f2cc\"",
"upstreamModelId": "openai-gpt-6-astra-high-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18816.63138,
"providerModelIdPublished": false
}Evidence observed 2026-11-04
v3 · public-demo · GPT-6 Astra - Provider Adapter (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'max' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"c4baed683b2f33c40537f2338682475f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"48d1fd5bf96ae9583213f6699f12f2cc\"",
"upstreamModelId": "openai-gpt-6-astra-max-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 17331.95327,
"providerModelIdPublished": false
}Evidence observed 2026-11-04
v3 · public-demo · GPT-6 Astra (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'max' reasoning effort.",
"modelsEtag": "W/\"c4baed683b2f33c40537f2338682475f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"48d1fd5bf96ae9583213f6699f12f2cc\"",
"upstreamModelId": "openai-gpt-6-astra-max",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 26097.501720000007,
"providerModelIdPublished": false
}Evidence observed 2026-11-04
v3 · public-demo · GPT-6 Astra (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'none' reasoning effort.",
"modelsEtag": "W/\"c4baed683b2f33c40537f2338682475f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"48d1fd5bf96ae9583213f6699f12f2cc\"",
"upstreamModelId": "openai-gpt-6-astra-none",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 49791.11317000001,
"providerModelIdPublished": false
}Evidence observed 2026-11-04
v3 · public-demo · GPT-6 Astra - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-medium-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"c4baed683b2f33c40537f2338682475f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"48d1fd5bf96ae9583213f6699f12f2cc\"",
"upstreamModelId": "openai-gpt-6-astra-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 19284.776630000004,
"providerModelIdPublished": false
}Evidence observed 2026-11-04
v3 · public-demo · GPT-6 Astra - Provider Adapter (XHigh) · effort xhigh · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-xhigh-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'xhigh' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"c4baed683b2f33c40537f2338682475f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"48d1fd5bf96ae9583213f6699f12f2cc\"",
"upstreamModelId": "openai-gpt-6-astra-xhigh-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18147.191119999996,
"providerModelIdPublished": false
}Evidence observed 2026-11-04
v3 · public-demo · GPT-6 Astra - Provider Adapter (Low) · effort low · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-low-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'low' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"c4baed683b2f33c40537f2338682475f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"48d1fd5bf96ae9583213f6699f12f2cc\"",
"upstreamModelId": "openai-gpt-6-astra-low-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 21297.922310000005,
"providerModelIdPublished": false
}Evidence observed 2026-11-04
v3 · public-demo · GPT-6 Astra - Provider Adapter (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'none' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"c4baed683b2f33c40537f2338682475f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"48d1fd5bf96ae9583213f6699f12f2cc\"",
"upstreamModelId": "openai-gpt-6-astra-none-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 23456.663940000002,
"providerModelIdPublished": false
}Evidence observed 2026-11-04
v3 · public-demo · GPT-6 Astra - Provider Adapter (XHigh) · effort xhigh · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-xhigh-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'xhigh' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"c4baed683b2f33c40537f2338682475f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"48d1fd5bf96ae9583213f6699f12f2cc\"",
"upstreamModelId": "openai-gpt-6-astra-xhigh-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18147.191119999996,
"providerModelIdPublished": false
}Evidence observed 2026-11-02
v3 · public-demo · GPT-6 Astra (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'none' reasoning effort.",
"modelsEtag": "W/\"c4baed683b2f33c40537f2338682475f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"48d1fd5bf96ae9583213f6699f12f2cc\"",
"upstreamModelId": "openai-gpt-6-astra-none",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 49791.11317000001,
"providerModelIdPublished": false
}Evidence observed 2026-11-02
v3 · public-demo · GPT-6 Astra - Provider Adapter (Low) · effort low · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-low-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'low' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"c4baed683b2f33c40537f2338682475f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"48d1fd5bf96ae9583213f6699f12f2cc\"",
"upstreamModelId": "openai-gpt-6-astra-low-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 21297.922310000005,
"providerModelIdPublished": false
}Evidence observed 2026-11-02
v3 · public-demo · GPT-6 Astra - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-medium-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"c4baed683b2f33c40537f2338682475f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"48d1fd5bf96ae9583213f6699f12f2cc\"",
"upstreamModelId": "openai-gpt-6-astra-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 19284.776630000004,
"providerModelIdPublished": false
}Evidence observed 2026-11-02
v3 · public-demo · GPT-6 Astra - Provider Adapter (High) · effort high · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-high-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'high' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"c4baed683b2f33c40537f2338682475f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"48d1fd5bf96ae9583213f6699f12f2cc\"",
"upstreamModelId": "openai-gpt-6-astra-high-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18816.63138,
"providerModelIdPublished": false
}Evidence observed 2026-11-02
v3 · public-demo · GPT-6 Astra (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'max' reasoning effort.",
"modelsEtag": "W/\"c4baed683b2f33c40537f2338682475f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"48d1fd5bf96ae9583213f6699f12f2cc\"",
"upstreamModelId": "openai-gpt-6-astra-max",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 26097.501720000007,
"providerModelIdPublished": false
}Evidence observed 2026-11-02
v3 · public-demo · GPT-6 Astra - Provider Adapter (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'max' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"c4baed683b2f33c40537f2338682475f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"48d1fd5bf96ae9583213f6699f12f2cc\"",
"upstreamModelId": "openai-gpt-6-astra-max-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 17331.95327,
"providerModelIdPublished": false
}Evidence observed 2026-11-02
v3 · public-demo · GPT-6 Astra - Provider Adapter (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'none' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"c4baed683b2f33c40537f2338682475f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"48d1fd5bf96ae9583213f6699f12f2cc\"",
"upstreamModelId": "openai-gpt-6-astra-none-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 23456.663940000002,
"providerModelIdPublished": false
}Evidence observed 2026-11-02
v3 · public-demo · GPT-6 Astra - Provider Adapter (Low) · effort low · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-low-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'low' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"8fc20a5217998d26c40ad2306d648194\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"095b2fa20aac96121092dab07e18cc8e\"",
"upstreamModelId": "openai-gpt-6-astra-low-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 21297.922310000005,
"providerModelIdPublished": false
}Evidence observed 2026-10-28
v3 · public-demo · GPT-6 Astra - Provider Adapter (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'max' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"8fc20a5217998d26c40ad2306d648194\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"095b2fa20aac96121092dab07e18cc8e\"",
"upstreamModelId": "openai-gpt-6-astra-max-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 17331.95327,
"providerModelIdPublished": false
}Evidence observed 2026-10-28
v3 · public-demo · GPT-6 Astra - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-medium-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"8fc20a5217998d26c40ad2306d648194\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"095b2fa20aac96121092dab07e18cc8e\"",
"upstreamModelId": "openai-gpt-6-astra-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 19284.776630000004,
"providerModelIdPublished": false
}Evidence observed 2026-10-28
v3 · public-demo · GPT-6 Astra - Provider Adapter (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'none' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"8fc20a5217998d26c40ad2306d648194\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"095b2fa20aac96121092dab07e18cc8e\"",
"upstreamModelId": "openai-gpt-6-astra-none-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 23456.663940000002,
"providerModelIdPublished": false
}Evidence observed 2026-10-28
v3 · public-demo · GPT-6 Astra - Provider Adapter (High) · effort high · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-high-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'high' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"8fc20a5217998d26c40ad2306d648194\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"095b2fa20aac96121092dab07e18cc8e\"",
"upstreamModelId": "openai-gpt-6-astra-high-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18816.63138,
"providerModelIdPublished": false
}Evidence observed 2026-10-28
v3 · public-demo · GPT-6 Astra (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'none' reasoning effort.",
"modelsEtag": "W/\"8fc20a5217998d26c40ad2306d648194\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"095b2fa20aac96121092dab07e18cc8e\"",
"upstreamModelId": "openai-gpt-6-astra-none",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 49791.11317000001,
"providerModelIdPublished": false
}Evidence observed 2026-10-28
v3 · public-demo · GPT-6 Astra - Provider Adapter (XHigh) · effort xhigh · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-xhigh-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'xhigh' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"8fc20a5217998d26c40ad2306d648194\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"095b2fa20aac96121092dab07e18cc8e\"",
"upstreamModelId": "openai-gpt-6-astra-xhigh-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18147.191119999996,
"providerModelIdPublished": false
}Evidence observed 2026-10-28
v3 · public-demo · GPT-6 Astra (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'max' reasoning effort.",
"modelsEtag": "W/\"8fc20a5217998d26c40ad2306d648194\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"095b2fa20aac96121092dab07e18cc8e\"",
"upstreamModelId": "openai-gpt-6-astra-max",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 26097.501720000007,
"providerModelIdPublished": false
}Evidence observed 2026-10-28
v3 · public-demo · GPT-6 Astra (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'max' reasoning effort.",
"modelsEtag": "W/\"400b32b66e8c1b37fc50ff586b033048\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"9314d4bea0d9d001c69a11614dc8d93c\"",
"upstreamModelId": "openai-gpt-6-astra-max",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 26097.501720000007,
"providerModelIdPublished": false
}Evidence observed 2026-10-21
v3 · public-demo · GPT-6 Astra - Provider Adapter (Low) · effort low · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-low-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'low' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"400b32b66e8c1b37fc50ff586b033048\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"9314d4bea0d9d001c69a11614dc8d93c\"",
"upstreamModelId": "openai-gpt-6-astra-low-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 21297.922310000005,
"providerModelIdPublished": false
}Evidence observed 2026-10-21
v3 · public-demo · GPT-6 Astra - Provider Adapter (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'max' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"400b32b66e8c1b37fc50ff586b033048\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"9314d4bea0d9d001c69a11614dc8d93c\"",
"upstreamModelId": "openai-gpt-6-astra-max-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 17331.95327,
"providerModelIdPublished": false
}Evidence observed 2026-10-21
v3 · public-demo · GPT-6 Astra - Provider Adapter (XHigh) · effort xhigh · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-xhigh-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'xhigh' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"400b32b66e8c1b37fc50ff586b033048\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"9314d4bea0d9d001c69a11614dc8d93c\"",
"upstreamModelId": "openai-gpt-6-astra-xhigh-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18147.191119999996,
"providerModelIdPublished": false
}Evidence observed 2026-10-21
v3 · public-demo · GPT-6 Astra - Provider Adapter (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'none' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"400b32b66e8c1b37fc50ff586b033048\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"9314d4bea0d9d001c69a11614dc8d93c\"",
"upstreamModelId": "openai-gpt-6-astra-none-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 23456.663940000002,
"providerModelIdPublished": false
}Evidence observed 2026-10-21
v3 · public-demo · GPT-6 Astra - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-medium-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"400b32b66e8c1b37fc50ff586b033048\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"9314d4bea0d9d001c69a11614dc8d93c\"",
"upstreamModelId": "openai-gpt-6-astra-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 19284.776630000004,
"providerModelIdPublished": false
}Evidence observed 2026-10-21
v3 · public-demo · GPT-6 Astra - Provider Adapter (High) · effort high · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-high-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'high' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"400b32b66e8c1b37fc50ff586b033048\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"9314d4bea0d9d001c69a11614dc8d93c\"",
"upstreamModelId": "openai-gpt-6-astra-high-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18816.63138,
"providerModelIdPublished": false
}Evidence observed 2026-10-21
v3 · public-demo · GPT-6 Astra (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'none' reasoning effort.",
"modelsEtag": "W/\"400b32b66e8c1b37fc50ff586b033048\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"9314d4bea0d9d001c69a11614dc8d93c\"",
"upstreamModelId": "openai-gpt-6-astra-none",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 49791.11317000001,
"providerModelIdPublished": false
}Evidence observed 2026-10-21
v3 · public-demo · GPT-6 Astra (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'none' reasoning effort.",
"modelsEtag": "W/\"2ab08f641c16bcf3c7a59c38b35fa2e3\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"b4ed41aee6b00420557f098bd05f4165\"",
"upstreamModelId": "openai-gpt-6-astra-none",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 49791.11317000001,
"providerModelIdPublished": false
}Evidence observed 2026-10-19
v3 · public-demo · GPT-6 Astra - Provider Adapter (Low) · effort low · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-low-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'low' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"2ab08f641c16bcf3c7a59c38b35fa2e3\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"b4ed41aee6b00420557f098bd05f4165\"",
"upstreamModelId": "openai-gpt-6-astra-low-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 21297.922310000005,
"providerModelIdPublished": false
}Evidence observed 2026-10-19
v3 · public-demo · GPT-6 Astra - Provider Adapter (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'none' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"2ab08f641c16bcf3c7a59c38b35fa2e3\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"b4ed41aee6b00420557f098bd05f4165\"",
"upstreamModelId": "openai-gpt-6-astra-none-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 23456.663940000002,
"providerModelIdPublished": false
}Evidence observed 2026-10-19
v3 · public-demo · GPT-6 Astra - Provider Adapter (XHigh) · effort xhigh · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-xhigh-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'xhigh' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"2ab08f641c16bcf3c7a59c38b35fa2e3\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"b4ed41aee6b00420557f098bd05f4165\"",
"upstreamModelId": "openai-gpt-6-astra-xhigh-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18147.191119999996,
"providerModelIdPublished": false
}Evidence observed 2026-10-19
v3 · public-demo · GPT-6 Astra - Provider Adapter (High) · effort high · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-high-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'high' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"2ab08f641c16bcf3c7a59c38b35fa2e3\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"b4ed41aee6b00420557f098bd05f4165\"",
"upstreamModelId": "openai-gpt-6-astra-high-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18816.63138,
"providerModelIdPublished": false
}Evidence observed 2026-10-19
v3 · public-demo · GPT-6 Astra - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-medium-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"2ab08f641c16bcf3c7a59c38b35fa2e3\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"b4ed41aee6b00420557f098bd05f4165\"",
"upstreamModelId": "openai-gpt-6-astra-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 19284.776630000004,
"providerModelIdPublished": false
}Evidence observed 2026-10-19
v3 · public-demo · GPT-6 Astra (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'max' reasoning effort.",
"modelsEtag": "W/\"2ab08f641c16bcf3c7a59c38b35fa2e3\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"b4ed41aee6b00420557f098bd05f4165\"",
"upstreamModelId": "openai-gpt-6-astra-max",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 26097.501720000007,
"providerModelIdPublished": false
}Evidence observed 2026-10-19
v3 · public-demo · GPT-6 Astra - Provider Adapter (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'max' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"2ab08f641c16bcf3c7a59c38b35fa2e3\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"b4ed41aee6b00420557f098bd05f4165\"",
"upstreamModelId": "openai-gpt-6-astra-max-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 17331.95327,
"providerModelIdPublished": false
}Evidence observed 2026-10-19
v3 · public-demo · GPT-6 Astra - Provider Adapter (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'none' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"8cf5cb76df0b13c1684b346a2012df83\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"c6e9a78d12dc070d7dab18a1f667a410\"",
"upstreamModelId": "openai-gpt-6-astra-none-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 23456.663940000002,
"providerModelIdPublished": false
}Evidence observed 2026-10-15
v3 · public-demo · GPT-6 Astra - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-medium-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"8cf5cb76df0b13c1684b346a2012df83\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"c6e9a78d12dc070d7dab18a1f667a410\"",
"upstreamModelId": "openai-gpt-6-astra-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 19284.776630000004,
"providerModelIdPublished": false
}Evidence observed 2026-10-15
v3 · public-demo · GPT-6 Astra - Provider Adapter (High) · effort high · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-high-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'high' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"8cf5cb76df0b13c1684b346a2012df83\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"c6e9a78d12dc070d7dab18a1f667a410\"",
"upstreamModelId": "openai-gpt-6-astra-high-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18816.63138,
"providerModelIdPublished": false
}Evidence observed 2026-10-15
v3 · public-demo · GPT-6 Astra (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'none' reasoning effort.",
"modelsEtag": "W/\"8cf5cb76df0b13c1684b346a2012df83\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"c6e9a78d12dc070d7dab18a1f667a410\"",
"upstreamModelId": "openai-gpt-6-astra-none",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 49791.11317000001,
"providerModelIdPublished": false
}Evidence observed 2026-10-15
v3 · public-demo · GPT-6 Astra (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'max' reasoning effort.",
"modelsEtag": "W/\"8cf5cb76df0b13c1684b346a2012df83\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"c6e9a78d12dc070d7dab18a1f667a410\"",
"upstreamModelId": "openai-gpt-6-astra-max",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 26097.501720000007,
"providerModelIdPublished": false
}Evidence observed 2026-10-15
v3 · public-demo · GPT-6 Astra - Provider Adapter (XHigh) · effort xhigh · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-xhigh-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'xhigh' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"8cf5cb76df0b13c1684b346a2012df83\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"c6e9a78d12dc070d7dab18a1f667a410\"",
"upstreamModelId": "openai-gpt-6-astra-xhigh-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18147.191119999996,
"providerModelIdPublished": false
}Evidence observed 2026-10-15
v3 · public-demo · GPT-6 Astra - Provider Adapter (Low) · effort low · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-low-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'low' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"8cf5cb76df0b13c1684b346a2012df83\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"c6e9a78d12dc070d7dab18a1f667a410\"",
"upstreamModelId": "openai-gpt-6-astra-low-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 21297.922310000005,
"providerModelIdPublished": false
}Evidence observed 2026-10-15
v3 · public-demo · GPT-6 Astra - Provider Adapter (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'max' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"8cf5cb76df0b13c1684b346a2012df83\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"c6e9a78d12dc070d7dab18a1f667a410\"",
"upstreamModelId": "openai-gpt-6-astra-max-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 17331.95327,
"providerModelIdPublished": false
}Evidence observed 2026-10-15
v3 · public-demo · GPT-6 Astra - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-medium-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"57cc4a7689e563a0ffb7d275eb3a889b\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"19d71f8c9a2056c0be4bb4fd4a75a325\"",
"upstreamModelId": "openai-gpt-6-astra-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 19284.776630000004,
"providerModelIdPublished": false
}Evidence observed 2026-10-14
v3 · public-demo · GPT-6 Astra - Provider Adapter (Low) · effort low · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-low-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'low' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"57cc4a7689e563a0ffb7d275eb3a889b\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"19d71f8c9a2056c0be4bb4fd4a75a325\"",
"upstreamModelId": "openai-gpt-6-astra-low-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 21297.922310000005,
"providerModelIdPublished": false
}Evidence observed 2026-10-14
v3 · public-demo · GPT-6 Astra - Provider Adapter (High) · effort high · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-high-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'high' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"57cc4a7689e563a0ffb7d275eb3a889b\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"19d71f8c9a2056c0be4bb4fd4a75a325\"",
"upstreamModelId": "openai-gpt-6-astra-high-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18816.63138,
"providerModelIdPublished": false
}Evidence observed 2026-10-14
v3 · public-demo · GPT-6 Astra - Provider Adapter (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'max' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"57cc4a7689e563a0ffb7d275eb3a889b\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"19d71f8c9a2056c0be4bb4fd4a75a325\"",
"upstreamModelId": "openai-gpt-6-astra-max-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 17331.95327,
"providerModelIdPublished": false
}Evidence observed 2026-10-14
v3 · public-demo · GPT-6 Astra (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'max' reasoning effort.",
"modelsEtag": "W/\"57cc4a7689e563a0ffb7d275eb3a889b\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"19d71f8c9a2056c0be4bb4fd4a75a325\"",
"upstreamModelId": "openai-gpt-6-astra-max",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 26097.501720000007,
"providerModelIdPublished": false
}Evidence observed 2026-10-14
v3 · public-demo · GPT-6 Astra - Provider Adapter (XHigh) · effort xhigh · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-xhigh-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'xhigh' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"57cc4a7689e563a0ffb7d275eb3a889b\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"19d71f8c9a2056c0be4bb4fd4a75a325\"",
"upstreamModelId": "openai-gpt-6-astra-xhigh-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18147.191119999996,
"providerModelIdPublished": false
}Evidence observed 2026-10-14
v3 · public-demo · GPT-6 Astra - Provider Adapter (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'none' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"57cc4a7689e563a0ffb7d275eb3a889b\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"19d71f8c9a2056c0be4bb4fd4a75a325\"",
"upstreamModelId": "openai-gpt-6-astra-none-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 23456.663940000002,
"providerModelIdPublished": false
}Evidence observed 2026-10-14
v3 · public-demo · GPT-6 Astra (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'none' reasoning effort.",
"modelsEtag": "W/\"57cc4a7689e563a0ffb7d275eb3a889b\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"19d71f8c9a2056c0be4bb4fd4a75a325\"",
"upstreamModelId": "openai-gpt-6-astra-none",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 49791.11317000001,
"providerModelIdPublished": false
}Evidence observed 2026-10-14
v3 · public-demo · GPT-6 Astra - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-medium-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"57cc4a7689e563a0ffb7d275eb3a889b\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"19d71f8c9a2056c0be4bb4fd4a75a325\"",
"upstreamModelId": "openai-gpt-6-astra-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 19284.776630000004,
"providerModelIdPublished": false
}Evidence observed 2026-10-14
v3 · public-demo · GPT-6 Astra - Provider Adapter (High) · effort high · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-high-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'high' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"57cc4a7689e563a0ffb7d275eb3a889b\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"19d71f8c9a2056c0be4bb4fd4a75a325\"",
"upstreamModelId": "openai-gpt-6-astra-high-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18816.63138,
"providerModelIdPublished": false
}Evidence observed 2026-10-14
v3 · public-demo · GPT-6 Astra - Provider Adapter (XHigh) · effort xhigh · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-xhigh-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'xhigh' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"57cc4a7689e563a0ffb7d275eb3a889b\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"19d71f8c9a2056c0be4bb4fd4a75a325\"",
"upstreamModelId": "openai-gpt-6-astra-xhigh-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18147.191119999996,
"providerModelIdPublished": false
}Evidence observed 2026-10-14
v3 · public-demo · GPT-6 Astra - Provider Adapter (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'max' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"57cc4a7689e563a0ffb7d275eb3a889b\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"19d71f8c9a2056c0be4bb4fd4a75a325\"",
"upstreamModelId": "openai-gpt-6-astra-max-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 17331.95327,
"providerModelIdPublished": false
}Evidence observed 2026-10-14
v3 · public-demo · GPT-6 Astra (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'max' reasoning effort.",
"modelsEtag": "W/\"57cc4a7689e563a0ffb7d275eb3a889b\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"19d71f8c9a2056c0be4bb4fd4a75a325\"",
"upstreamModelId": "openai-gpt-6-astra-max",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 26097.501720000007,
"providerModelIdPublished": false
}Evidence observed 2026-10-14
v3 · public-demo · GPT-6 Astra - Provider Adapter (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'none' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"57cc4a7689e563a0ffb7d275eb3a889b\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"19d71f8c9a2056c0be4bb4fd4a75a325\"",
"upstreamModelId": "openai-gpt-6-astra-none-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 23456.663940000002,
"providerModelIdPublished": false
}Evidence observed 2026-10-14
v3 · public-demo · GPT-6 Astra (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'none' reasoning effort.",
"modelsEtag": "W/\"57cc4a7689e563a0ffb7d275eb3a889b\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"19d71f8c9a2056c0be4bb4fd4a75a325\"",
"upstreamModelId": "openai-gpt-6-astra-none",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 49791.11317000001,
"providerModelIdPublished": false
}Evidence observed 2026-10-14
v3 · public-demo · GPT-6 Astra - Provider Adapter (Low) · effort low · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-low-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'low' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"57cc4a7689e563a0ffb7d275eb3a889b\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"19d71f8c9a2056c0be4bb4fd4a75a325\"",
"upstreamModelId": "openai-gpt-6-astra-low-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 21297.922310000005,
"providerModelIdPublished": false
}Evidence observed 2026-10-14
v3 · public-demo · GPT-6 Astra - Provider Adapter (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'max' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"e7f673a6db195dac7f2956e3b1651145\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"4d3b46c6ffe9404ca1c0ebcfb5938883\"",
"upstreamModelId": "openai-gpt-6-astra-max-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 17331.95327,
"providerModelIdPublished": false
}Evidence observed 2026-10-13
v3 · public-demo · GPT-6 Astra - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-medium-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"e7f673a6db195dac7f2956e3b1651145\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"4d3b46c6ffe9404ca1c0ebcfb5938883\"",
"upstreamModelId": "openai-gpt-6-astra-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 19284.776630000004,
"providerModelIdPublished": false
}Evidence observed 2026-10-13
v3 · public-demo · GPT-6 Astra (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'max' reasoning effort.",
"modelsEtag": "W/\"e7f673a6db195dac7f2956e3b1651145\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"4d3b46c6ffe9404ca1c0ebcfb5938883\"",
"upstreamModelId": "openai-gpt-6-astra-max",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 26097.501720000007,
"providerModelIdPublished": false
}Evidence observed 2026-10-13
v3 · public-demo · GPT-6 Astra - Provider Adapter (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'none' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"e7f673a6db195dac7f2956e3b1651145\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"4d3b46c6ffe9404ca1c0ebcfb5938883\"",
"upstreamModelId": "openai-gpt-6-astra-none-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 23456.663940000002,
"providerModelIdPublished": false
}Evidence observed 2026-10-13
v3 · public-demo · GPT-6 Astra (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'none' reasoning effort.",
"modelsEtag": "W/\"e7f673a6db195dac7f2956e3b1651145\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"4d3b46c6ffe9404ca1c0ebcfb5938883\"",
"upstreamModelId": "openai-gpt-6-astra-none",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 49791.11317000001,
"providerModelIdPublished": false
}Evidence observed 2026-10-13
v3 · public-demo · GPT-6 Astra - Provider Adapter (High) · effort high · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-high-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'high' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"e7f673a6db195dac7f2956e3b1651145\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"4d3b46c6ffe9404ca1c0ebcfb5938883\"",
"upstreamModelId": "openai-gpt-6-astra-high-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18816.63138,
"providerModelIdPublished": false
}Evidence observed 2026-10-13
v3 · public-demo · GPT-6 Astra - Provider Adapter (Low) · effort low · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-low-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'low' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"e7f673a6db195dac7f2956e3b1651145\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"4d3b46c6ffe9404ca1c0ebcfb5938883\"",
"upstreamModelId": "openai-gpt-6-astra-low-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 21297.922310000005,
"providerModelIdPublished": false
}Evidence observed 2026-10-13
v3 · public-demo · GPT-6 Astra - Provider Adapter (XHigh) · effort xhigh · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-xhigh-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'xhigh' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"e7f673a6db195dac7f2956e3b1651145\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"4d3b46c6ffe9404ca1c0ebcfb5938883\"",
"upstreamModelId": "openai-gpt-6-astra-xhigh-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18147.191119999996,
"providerModelIdPublished": false
}Evidence observed 2026-10-13
v3 · public-demo · GPT-6 Astra (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'none' reasoning effort.",
"modelsEtag": "W/\"b57a26ca4df83acaa40eadb6632c7c61\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"ee35c9dbbb033dc7de85467eedb85d54\"",
"upstreamModelId": "openai-gpt-6-astra-none",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 49791.11317000001,
"providerModelIdPublished": false
}Evidence observed 2026-10-06
v3 · public-demo · GPT-6 Astra - Provider Adapter (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'max' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"b57a26ca4df83acaa40eadb6632c7c61\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"ee35c9dbbb033dc7de85467eedb85d54\"",
"upstreamModelId": "openai-gpt-6-astra-max-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 17331.95327,
"providerModelIdPublished": false
}Evidence observed 2026-10-06
v3 · public-demo · GPT-6 Astra - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-medium-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"b57a26ca4df83acaa40eadb6632c7c61\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"ee35c9dbbb033dc7de85467eedb85d54\"",
"upstreamModelId": "openai-gpt-6-astra-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 19284.776630000004,
"providerModelIdPublished": false
}Evidence observed 2026-10-06
v3 · public-demo · GPT-6 Astra - Provider Adapter (Low) · effort low · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-low-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'low' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"b57a26ca4df83acaa40eadb6632c7c61\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"ee35c9dbbb033dc7de85467eedb85d54\"",
"upstreamModelId": "openai-gpt-6-astra-low-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 21297.922310000005,
"providerModelIdPublished": false
}Evidence observed 2026-10-06
v3 · public-demo · GPT-6 Astra - Provider Adapter (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'none' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"b57a26ca4df83acaa40eadb6632c7c61\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"ee35c9dbbb033dc7de85467eedb85d54\"",
"upstreamModelId": "openai-gpt-6-astra-none-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 23456.663940000002,
"providerModelIdPublished": false
}Evidence observed 2026-10-06
v3 · public-demo · GPT-6 Astra (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'max' reasoning effort.",
"modelsEtag": "W/\"b57a26ca4df83acaa40eadb6632c7c61\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"ee35c9dbbb033dc7de85467eedb85d54\"",
"upstreamModelId": "openai-gpt-6-astra-max",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 26097.501720000007,
"providerModelIdPublished": false
}Evidence observed 2026-10-06
v3 · public-demo · GPT-6 Astra - Provider Adapter (XHigh) · effort xhigh · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-xhigh-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'xhigh' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"b57a26ca4df83acaa40eadb6632c7c61\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"ee35c9dbbb033dc7de85467eedb85d54\"",
"upstreamModelId": "openai-gpt-6-astra-xhigh-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18147.191119999996,
"providerModelIdPublished": false
}Evidence observed 2026-10-06
v3 · public-demo · GPT-6 Astra - Provider Adapter (High) · effort high · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-high-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'high' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"b57a26ca4df83acaa40eadb6632c7c61\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"ee35c9dbbb033dc7de85467eedb85d54\"",
"upstreamModelId": "openai-gpt-6-astra-high-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18816.63138,
"providerModelIdPublished": false
}Evidence observed 2026-10-06
v3 · public-demo · GPT-6 Astra (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'none' reasoning effort.",
"modelsEtag": "W/\"b52a6e82589fb2c719168d69aa0bb015\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"f187ceaff4d7f6156e77c1f1254aafc8\"",
"upstreamModelId": "openai-gpt-6-astra-none",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 49791.11317000001,
"providerModelIdPublished": false
}Evidence observed 2026-10-02
v3 · public-demo · GPT-6 Astra (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'max' reasoning effort.",
"modelsEtag": "W/\"b52a6e82589fb2c719168d69aa0bb015\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"f187ceaff4d7f6156e77c1f1254aafc8\"",
"upstreamModelId": "openai-gpt-6-astra-max",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 26097.501720000007,
"providerModelIdPublished": false
}Evidence observed 2026-10-02
v3 · public-demo · GPT-6 Astra - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-medium-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"b52a6e82589fb2c719168d69aa0bb015\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"f187ceaff4d7f6156e77c1f1254aafc8\"",
"upstreamModelId": "openai-gpt-6-astra-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 19284.776630000004,
"providerModelIdPublished": false
}Evidence observed 2026-10-02
v3 · public-demo · GPT-6 Astra - Provider Adapter (XHigh) · effort xhigh · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-xhigh-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'xhigh' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"b52a6e82589fb2c719168d69aa0bb015\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"f187ceaff4d7f6156e77c1f1254aafc8\"",
"upstreamModelId": "openai-gpt-6-astra-xhigh-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18147.191119999996,
"providerModelIdPublished": false
}Evidence observed 2026-10-02
v3 · public-demo · GPT-6 Astra - Provider Adapter (High) · effort high · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-high-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'high' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"b52a6e82589fb2c719168d69aa0bb015\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"f187ceaff4d7f6156e77c1f1254aafc8\"",
"upstreamModelId": "openai-gpt-6-astra-high-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18816.63138,
"providerModelIdPublished": false
}Evidence observed 2026-10-02
v3 · public-demo · GPT-6 Astra - Provider Adapter (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'none' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"b52a6e82589fb2c719168d69aa0bb015\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"f187ceaff4d7f6156e77c1f1254aafc8\"",
"upstreamModelId": "openai-gpt-6-astra-none-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 23456.663940000002,
"providerModelIdPublished": false
}Evidence observed 2026-10-02
v3 · public-demo · GPT-6 Astra - Provider Adapter (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'max' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"b52a6e82589fb2c719168d69aa0bb015\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"f187ceaff4d7f6156e77c1f1254aafc8\"",
"upstreamModelId": "openai-gpt-6-astra-max-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 17331.95327,
"providerModelIdPublished": false
}Evidence observed 2026-10-02
v3 · public-demo · GPT-6 Astra - Provider Adapter (Low) · effort low · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-low-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'low' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"b52a6e82589fb2c719168d69aa0bb015\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"f187ceaff4d7f6156e77c1f1254aafc8\"",
"upstreamModelId": "openai-gpt-6-astra-low-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 21297.922310000005,
"providerModelIdPublished": false
}Evidence observed 2026-10-02
v3 · public-demo · GPT-6 Astra - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-medium-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"b52a6e82589fb2c719168d69aa0bb015\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"f187ceaff4d7f6156e77c1f1254aafc8\"",
"upstreamModelId": "openai-gpt-6-astra-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 19284.776630000004,
"providerModelIdPublished": false
}Evidence observed 2026-10-01
v3 · public-demo · GPT-6 Astra - Provider Adapter (XHigh) · effort xhigh · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-xhigh-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'xhigh' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"b52a6e82589fb2c719168d69aa0bb015\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"f187ceaff4d7f6156e77c1f1254aafc8\"",
"upstreamModelId": "openai-gpt-6-astra-xhigh-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18147.191119999996,
"providerModelIdPublished": false
}Evidence observed 2026-10-01
v3 · public-demo · GPT-6 Astra - Provider Adapter (Low) · effort low · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-low-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'low' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"b52a6e82589fb2c719168d69aa0bb015\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"f187ceaff4d7f6156e77c1f1254aafc8\"",
"upstreamModelId": "openai-gpt-6-astra-low-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 21297.922310000005,
"providerModelIdPublished": false
}Evidence observed 2026-10-01
v3 · public-demo · GPT-6 Astra - Provider Adapter (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'max' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"b52a6e82589fb2c719168d69aa0bb015\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"f187ceaff4d7f6156e77c1f1254aafc8\"",
"upstreamModelId": "openai-gpt-6-astra-max-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 17331.95327,
"providerModelIdPublished": false
}Evidence observed 2026-10-01
v3 · public-demo · GPT-6 Astra - Provider Adapter (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'none' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"b52a6e82589fb2c719168d69aa0bb015\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"f187ceaff4d7f6156e77c1f1254aafc8\"",
"upstreamModelId": "openai-gpt-6-astra-none-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 23456.663940000002,
"providerModelIdPublished": false
}Evidence observed 2026-10-01
v3 · public-demo · GPT-6 Astra (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'max' reasoning effort.",
"modelsEtag": "W/\"b52a6e82589fb2c719168d69aa0bb015\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"f187ceaff4d7f6156e77c1f1254aafc8\"",
"upstreamModelId": "openai-gpt-6-astra-max",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 26097.501720000007,
"providerModelIdPublished": false
}Evidence observed 2026-10-01
v3 · public-demo · GPT-6 Astra - Provider Adapter (High) · effort high · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-high-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'high' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"b52a6e82589fb2c719168d69aa0bb015\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"f187ceaff4d7f6156e77c1f1254aafc8\"",
"upstreamModelId": "openai-gpt-6-astra-high-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18816.63138,
"providerModelIdPublished": false
}Evidence observed 2026-10-01
v3 · public-demo · GPT-6 Astra (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'none' reasoning effort.",
"modelsEtag": "W/\"b52a6e82589fb2c719168d69aa0bb015\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"f187ceaff4d7f6156e77c1f1254aafc8\"",
"upstreamModelId": "openai-gpt-6-astra-none",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 49791.11317000001,
"providerModelIdPublished": false
}Evidence observed 2026-10-01
v3 · public-demo · GPT-6 Astra - Provider Adapter (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'none' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"8bfe2e142f29acec39df406a6631f81a\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"92bfaa47028eae49163960f4c5a298a0\"",
"upstreamModelId": "openai-gpt-6-astra-none-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 23456.663940000002,
"providerModelIdPublished": false
}Evidence observed 2026-09-30
v3 · public-demo · GPT-6 Astra - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-medium-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"8bfe2e142f29acec39df406a6631f81a\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"92bfaa47028eae49163960f4c5a298a0\"",
"upstreamModelId": "openai-gpt-6-astra-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 19284.776630000004,
"providerModelIdPublished": false
}Evidence observed 2026-09-30
v3 · public-demo · GPT-6 Astra - Provider Adapter (XHigh) · effort xhigh · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-xhigh-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'xhigh' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"8bfe2e142f29acec39df406a6631f81a\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"92bfaa47028eae49163960f4c5a298a0\"",
"upstreamModelId": "openai-gpt-6-astra-xhigh-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18147.191119999996,
"providerModelIdPublished": false
}Evidence observed 2026-09-30
v3 · public-demo · GPT-6 Astra (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'none' reasoning effort.",
"modelsEtag": "W/\"8bfe2e142f29acec39df406a6631f81a\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"92bfaa47028eae49163960f4c5a298a0\"",
"upstreamModelId": "openai-gpt-6-astra-none",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 49791.11317000001,
"providerModelIdPublished": false
}Evidence observed 2026-09-30
v3 · public-demo · GPT-6 Astra - Provider Adapter (Low) · effort low · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-low-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'low' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"8bfe2e142f29acec39df406a6631f81a\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"92bfaa47028eae49163960f4c5a298a0\"",
"upstreamModelId": "openai-gpt-6-astra-low-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 21297.922310000005,
"providerModelIdPublished": false
}Evidence observed 2026-09-30
v3 · public-demo · GPT-6 Astra - Provider Adapter (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'max' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"8bfe2e142f29acec39df406a6631f81a\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"92bfaa47028eae49163960f4c5a298a0\"",
"upstreamModelId": "openai-gpt-6-astra-max-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 17331.95327,
"providerModelIdPublished": false
}Evidence observed 2026-09-30
v3 · public-demo · GPT-6 Astra (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'max' reasoning effort.",
"modelsEtag": "W/\"8bfe2e142f29acec39df406a6631f81a\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"92bfaa47028eae49163960f4c5a298a0\"",
"upstreamModelId": "openai-gpt-6-astra-max",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 26097.501720000007,
"providerModelIdPublished": false
}Evidence observed 2026-09-30
v3 · public-demo · GPT-6 Astra - Provider Adapter (High) · effort high · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-high-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'high' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"8bfe2e142f29acec39df406a6631f81a\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"92bfaa47028eae49163960f4c5a298a0\"",
"upstreamModelId": "openai-gpt-6-astra-high-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18816.63138,
"providerModelIdPublished": false
}Evidence observed 2026-09-30
v3 · public-demo · GPT-6 Astra - Provider Adapter (High) · effort high · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-high-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'high' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"16793624264c3bdded076b4e26af5a90\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"e7fb37556a7353e7da435c4c7b78ca50\"",
"upstreamModelId": "openai-gpt-6-astra-high-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18816.63138,
"providerModelIdPublished": false
}Evidence observed 2026-09-29
v3 · public-demo · GPT-6 Astra - Provider Adapter (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'none' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"16793624264c3bdded076b4e26af5a90\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"e7fb37556a7353e7da435c4c7b78ca50\"",
"upstreamModelId": "openai-gpt-6-astra-none-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 23456.663940000002,
"providerModelIdPublished": false
}Evidence observed 2026-09-29
v3 · public-demo · GPT-6 Astra - Provider Adapter (Low) · effort low · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-low-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'low' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"16793624264c3bdded076b4e26af5a90\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"e7fb37556a7353e7da435c4c7b78ca50\"",
"upstreamModelId": "openai-gpt-6-astra-low-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 21297.922310000005,
"providerModelIdPublished": false
}Evidence observed 2026-09-29
v3 · public-demo · GPT-6 Astra (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'max' reasoning effort.",
"modelsEtag": "W/\"16793624264c3bdded076b4e26af5a90\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"e7fb37556a7353e7da435c4c7b78ca50\"",
"upstreamModelId": "openai-gpt-6-astra-max",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 26097.501720000007,
"providerModelIdPublished": false
}Evidence observed 2026-09-29
v3 · public-demo · GPT-6 Astra - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-medium-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"16793624264c3bdded076b4e26af5a90\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"e7fb37556a7353e7da435c4c7b78ca50\"",
"upstreamModelId": "openai-gpt-6-astra-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 19284.776630000004,
"providerModelIdPublished": false
}Evidence observed 2026-09-29
v3 · public-demo · GPT-6 Astra - Provider Adapter (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'max' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"16793624264c3bdded076b4e26af5a90\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"e7fb37556a7353e7da435c4c7b78ca50\"",
"upstreamModelId": "openai-gpt-6-astra-max-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 17331.95327,
"providerModelIdPublished": false
}Evidence observed 2026-09-29
v3 · public-demo · GPT-6 Astra (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'none' reasoning effort.",
"modelsEtag": "W/\"16793624264c3bdded076b4e26af5a90\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"e7fb37556a7353e7da435c4c7b78ca50\"",
"upstreamModelId": "openai-gpt-6-astra-none",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 49791.11317000001,
"providerModelIdPublished": false
}Evidence observed 2026-09-29
v3 · public-demo · GPT-6 Astra - Provider Adapter (XHigh) · effort xhigh · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-xhigh-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'xhigh' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"16793624264c3bdded076b4e26af5a90\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"e7fb37556a7353e7da435c4c7b78ca50\"",
"upstreamModelId": "openai-gpt-6-astra-xhigh-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18147.191119999996,
"providerModelIdPublished": false
}Evidence observed 2026-09-29
v3 · public-demo · GPT-6 Astra - Provider Adapter (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'none' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"284ac3aff89a7d8a3aca179ee1e5dd61\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"6e0849a05a2c572b1050e5900a372e2b\"",
"upstreamModelId": "openai-gpt-6-astra-none-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 23456.663940000002,
"providerModelIdPublished": false
}Evidence observed 2026-09-28
v3 · public-demo · GPT-6 Astra - Provider Adapter (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'max' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"284ac3aff89a7d8a3aca179ee1e5dd61\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"6e0849a05a2c572b1050e5900a372e2b\"",
"upstreamModelId": "openai-gpt-6-astra-max-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 17331.95327,
"providerModelIdPublished": false
}Evidence observed 2026-09-28
v3 · public-demo · GPT-6 Astra - Provider Adapter (High) · effort high · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-high-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'high' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"284ac3aff89a7d8a3aca179ee1e5dd61\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"6e0849a05a2c572b1050e5900a372e2b\"",
"upstreamModelId": "openai-gpt-6-astra-high-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18816.63138,
"providerModelIdPublished": false
}Evidence observed 2026-09-28
v3 · public-demo · GPT-6 Astra (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'max' reasoning effort.",
"modelsEtag": "W/\"284ac3aff89a7d8a3aca179ee1e5dd61\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"6e0849a05a2c572b1050e5900a372e2b\"",
"upstreamModelId": "openai-gpt-6-astra-max",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 26097.501720000007,
"providerModelIdPublished": false
}Evidence observed 2026-09-28
v3 · public-demo · GPT-6 Astra - Provider Adapter (Low) · effort low · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-low-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'low' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"284ac3aff89a7d8a3aca179ee1e5dd61\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"6e0849a05a2c572b1050e5900a372e2b\"",
"upstreamModelId": "openai-gpt-6-astra-low-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 21297.922310000005,
"providerModelIdPublished": false
}Evidence observed 2026-09-28
v3 · public-demo · GPT-6 Astra - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-medium-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"284ac3aff89a7d8a3aca179ee1e5dd61\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"6e0849a05a2c572b1050e5900a372e2b\"",
"upstreamModelId": "openai-gpt-6-astra-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 19284.776630000004,
"providerModelIdPublished": false
}Evidence observed 2026-09-28
v3 · public-demo · GPT-6 Astra - Provider Adapter (XHigh) · effort xhigh · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-xhigh-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'xhigh' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"284ac3aff89a7d8a3aca179ee1e5dd61\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"6e0849a05a2c572b1050e5900a372e2b\"",
"upstreamModelId": "openai-gpt-6-astra-xhigh-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18147.191119999996,
"providerModelIdPublished": false
}Evidence observed 2026-09-28
v3 · public-demo · GPT-6 Astra (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'none' reasoning effort.",
"modelsEtag": "W/\"284ac3aff89a7d8a3aca179ee1e5dd61\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"6e0849a05a2c572b1050e5900a372e2b\"",
"upstreamModelId": "openai-gpt-6-astra-none",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 49791.11317000001,
"providerModelIdPublished": false
}Evidence observed 2026-09-28
v3 · public-demo · GPT-6 Astra - Provider Adapter (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'max' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"397d7634d348db2ae8df5180db7b475d\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"882404aedf04dbdde2b6c0d731212a4f\"",
"upstreamModelId": "openai-gpt-6-astra-max-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 17331.95327,
"providerModelIdPublished": false
}Evidence observed 2026-09-24
v3 · public-demo · GPT-6 Astra - Provider Adapter (XHigh) · effort xhigh · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-xhigh-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'xhigh' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"397d7634d348db2ae8df5180db7b475d\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"882404aedf04dbdde2b6c0d731212a4f\"",
"upstreamModelId": "openai-gpt-6-astra-xhigh-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18147.191119999996,
"providerModelIdPublished": false
}Evidence observed 2026-09-24
v3 · public-demo · GPT-6 Astra (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'none' reasoning effort.",
"modelsEtag": "W/\"397d7634d348db2ae8df5180db7b475d\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"882404aedf04dbdde2b6c0d731212a4f\"",
"upstreamModelId": "openai-gpt-6-astra-none",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 49791.11317000001,
"providerModelIdPublished": false
}Evidence observed 2026-09-24
v3 · public-demo · GPT-6 Astra (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'max' reasoning effort.",
"modelsEtag": "W/\"397d7634d348db2ae8df5180db7b475d\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"882404aedf04dbdde2b6c0d731212a4f\"",
"upstreamModelId": "openai-gpt-6-astra-max",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 26097.501720000007,
"providerModelIdPublished": false
}Evidence observed 2026-09-24
v3 · public-demo · GPT-6 Astra - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-medium-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"397d7634d348db2ae8df5180db7b475d\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"882404aedf04dbdde2b6c0d731212a4f\"",
"upstreamModelId": "openai-gpt-6-astra-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 19284.776630000004,
"providerModelIdPublished": false
}Evidence observed 2026-09-24
v3 · public-demo · GPT-6 Astra - Provider Adapter (Low) · effort low · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-low-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'low' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"397d7634d348db2ae8df5180db7b475d\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"882404aedf04dbdde2b6c0d731212a4f\"",
"upstreamModelId": "openai-gpt-6-astra-low-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 21297.922310000005,
"providerModelIdPublished": false
}Evidence observed 2026-09-24
v3 · public-demo · GPT-6 Astra - Provider Adapter (High) · effort high · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-high-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'high' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"397d7634d348db2ae8df5180db7b475d\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"882404aedf04dbdde2b6c0d731212a4f\"",
"upstreamModelId": "openai-gpt-6-astra-high-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18816.63138,
"providerModelIdPublished": false
}Evidence observed 2026-09-24
v3 · public-demo · GPT-6 Astra - Provider Adapter (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'none' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"397d7634d348db2ae8df5180db7b475d\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"882404aedf04dbdde2b6c0d731212a4f\"",
"upstreamModelId": "openai-gpt-6-astra-none-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 23456.663940000002,
"providerModelIdPublished": false
}Evidence observed 2026-09-24
v3 · public-demo · GPT-6 Astra - Provider Adapter (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'max' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"58c953e3f78e2282d0259b52304c8ef8\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"ef004f05f102510151398f73e966a509\"",
"upstreamModelId": "openai-gpt-6-astra-max-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 17331.95327,
"providerModelIdPublished": false
}Evidence observed 2026-09-22
v3 · public-demo · GPT-6 Astra - Provider Adapter (XHigh) · effort xhigh · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-xhigh-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'xhigh' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"58c953e3f78e2282d0259b52304c8ef8\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"ef004f05f102510151398f73e966a509\"",
"upstreamModelId": "openai-gpt-6-astra-xhigh-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18147.191119999996,
"providerModelIdPublished": false
}Evidence observed 2026-09-22
v3 · public-demo · GPT-6 Astra - Provider Adapter (Low) · effort low · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-low-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'low' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"58c953e3f78e2282d0259b52304c8ef8\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"ef004f05f102510151398f73e966a509\"",
"upstreamModelId": "openai-gpt-6-astra-low-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 21297.922310000005,
"providerModelIdPublished": false
}Evidence observed 2026-09-22
v3 · public-demo · GPT-6 Astra - Provider Adapter (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'none' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"58c953e3f78e2282d0259b52304c8ef8\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"ef004f05f102510151398f73e966a509\"",
"upstreamModelId": "openai-gpt-6-astra-none-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 23456.663940000002,
"providerModelIdPublished": false
}Evidence observed 2026-09-22
v3 · public-demo · GPT-6 Astra - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-medium-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"58c953e3f78e2282d0259b52304c8ef8\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"ef004f05f102510151398f73e966a509\"",
"upstreamModelId": "openai-gpt-6-astra-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 19284.776630000004,
"providerModelIdPublished": false
}Evidence observed 2026-09-22
v3 · public-demo · GPT-6 Astra (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'none' reasoning effort.",
"modelsEtag": "W/\"58c953e3f78e2282d0259b52304c8ef8\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"ef004f05f102510151398f73e966a509\"",
"upstreamModelId": "openai-gpt-6-astra-none",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 49791.11317000001,
"providerModelIdPublished": false
}Evidence observed 2026-09-22
v3 · public-demo · GPT-6 Astra - Provider Adapter (High) · effort high · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-high-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'high' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"58c953e3f78e2282d0259b52304c8ef8\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"ef004f05f102510151398f73e966a509\"",
"upstreamModelId": "openai-gpt-6-astra-high-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18816.63138,
"providerModelIdPublished": false
}Evidence observed 2026-09-22
v3 · public-demo · GPT-6 Astra (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'max' reasoning effort.",
"modelsEtag": "W/\"58c953e3f78e2282d0259b52304c8ef8\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"ef004f05f102510151398f73e966a509\"",
"upstreamModelId": "openai-gpt-6-astra-max",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 26097.501720000007,
"providerModelIdPublished": false
}Evidence observed 2026-09-22
v3 · public-demo · GPT-6 Astra - Provider Adapter (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'none' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"2f3beadbd513a221b41d3816ff651f54\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"f1d0d3b7e367e4a7909882624b1caca0\"",
"upstreamModelId": "openai-gpt-6-astra-none-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 23456.663940000002,
"providerModelIdPublished": false
}Evidence observed 2026-09-22
v3 · public-demo · GPT-6 Astra - Provider Adapter (Low) · effort low · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-low-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'low' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"2f3beadbd513a221b41d3816ff651f54\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"f1d0d3b7e367e4a7909882624b1caca0\"",
"upstreamModelId": "openai-gpt-6-astra-low-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 21297.922310000005,
"providerModelIdPublished": false
}Evidence observed 2026-09-22
v3 · public-demo · GPT-6 Astra - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-medium-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"2f3beadbd513a221b41d3816ff651f54\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"f1d0d3b7e367e4a7909882624b1caca0\"",
"upstreamModelId": "openai-gpt-6-astra-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 19284.776630000004,
"providerModelIdPublished": false
}Evidence observed 2026-09-22
v3 · public-demo · GPT-6 Astra - Provider Adapter (High) · effort high · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-high-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'high' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"2f3beadbd513a221b41d3816ff651f54\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"f1d0d3b7e367e4a7909882624b1caca0\"",
"upstreamModelId": "openai-gpt-6-astra-high-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18816.63138,
"providerModelIdPublished": false
}Evidence observed 2026-09-22
v3 · public-demo · GPT-6 Astra - Provider Adapter (XHigh) · effort xhigh · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-xhigh-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'xhigh' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"2f3beadbd513a221b41d3816ff651f54\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"f1d0d3b7e367e4a7909882624b1caca0\"",
"upstreamModelId": "openai-gpt-6-astra-xhigh-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18147.191119999996,
"providerModelIdPublished": false
}Evidence observed 2026-09-22
v3 · public-demo · GPT-6 Astra - Provider Adapter (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'max' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"2f3beadbd513a221b41d3816ff651f54\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"f1d0d3b7e367e4a7909882624b1caca0\"",
"upstreamModelId": "openai-gpt-6-astra-max-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 17331.95327,
"providerModelIdPublished": false
}Evidence observed 2026-09-22
v3 · public-demo · GPT-6 Astra (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'none' reasoning effort.",
"modelsEtag": "W/\"2f3beadbd513a221b41d3816ff651f54\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"f1d0d3b7e367e4a7909882624b1caca0\"",
"upstreamModelId": "openai-gpt-6-astra-none",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 49791.11317000001,
"providerModelIdPublished": false
}Evidence observed 2026-09-22
v3 · public-demo · GPT-6 Astra (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'max' reasoning effort.",
"modelsEtag": "W/\"2f3beadbd513a221b41d3816ff651f54\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"f1d0d3b7e367e4a7909882624b1caca0\"",
"upstreamModelId": "openai-gpt-6-astra-max",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 26097.501720000007,
"providerModelIdPublished": false
}Evidence observed 2026-09-22
v3 · public-demo · GPT-6 Astra - Provider Adapter (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'max' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"c985e4804ffc840374d9852c6b60005c\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"0a820529c69911b0c1a63d8b2d3dbf0f\"",
"upstreamModelId": "openai-gpt-6-astra-max-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 17331.95327,
"providerModelIdPublished": false
}Evidence observed 2026-09-21
v3 · public-demo · GPT-6 Astra (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'max' reasoning effort.",
"modelsEtag": "W/\"c985e4804ffc840374d9852c6b60005c\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"0a820529c69911b0c1a63d8b2d3dbf0f\"",
"upstreamModelId": "openai-gpt-6-astra-max",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 26097.501720000007,
"providerModelIdPublished": false
}Evidence observed 2026-09-21
v3 · public-demo · GPT-6 Astra - Provider Adapter (XHigh) · effort xhigh · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-xhigh-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'xhigh' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"c985e4804ffc840374d9852c6b60005c\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"0a820529c69911b0c1a63d8b2d3dbf0f\"",
"upstreamModelId": "openai-gpt-6-astra-xhigh-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18147.191119999996,
"providerModelIdPublished": false
}Evidence observed 2026-09-21
v3 · public-demo · GPT-6 Astra - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-medium-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"c985e4804ffc840374d9852c6b60005c\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"0a820529c69911b0c1a63d8b2d3dbf0f\"",
"upstreamModelId": "openai-gpt-6-astra-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 19284.776630000004,
"providerModelIdPublished": false
}Evidence observed 2026-09-21
v3 · public-demo · GPT-6 Astra - Provider Adapter (High) · effort high · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-high-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'high' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"c985e4804ffc840374d9852c6b60005c\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"0a820529c69911b0c1a63d8b2d3dbf0f\"",
"upstreamModelId": "openai-gpt-6-astra-high-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18816.63138,
"providerModelIdPublished": false
}Evidence observed 2026-09-21
v3 · public-demo · GPT-6 Astra - Provider Adapter (Low) · effort low · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-low-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'low' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"c985e4804ffc840374d9852c6b60005c\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"0a820529c69911b0c1a63d8b2d3dbf0f\"",
"upstreamModelId": "openai-gpt-6-astra-low-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 21297.922310000005,
"providerModelIdPublished": false
}Evidence observed 2026-09-21
v3 · public-demo · GPT-6 Astra (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'none' reasoning effort.",
"modelsEtag": "W/\"c985e4804ffc840374d9852c6b60005c\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"0a820529c69911b0c1a63d8b2d3dbf0f\"",
"upstreamModelId": "openai-gpt-6-astra-none",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 49791.11317000001,
"providerModelIdPublished": false
}Evidence observed 2026-09-21
v3 · public-demo · GPT-6 Astra - Provider Adapter (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'none' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"c985e4804ffc840374d9852c6b60005c\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"0a820529c69911b0c1a63d8b2d3dbf0f\"",
"upstreamModelId": "openai-gpt-6-astra-none-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 23456.663940000002,
"providerModelIdPublished": false
}Evidence observed 2026-09-21
v3 · public-demo · GPT-6 Astra - Provider Adapter (High) · effort high · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-high-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'high' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"a8dc9c600e07efa11ca8fb622181783f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"946807139d47f4bc368591b95885dfb4\"",
"upstreamModelId": "openai-gpt-6-astra-high-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18816.63138,
"providerModelIdPublished": false
}Evidence observed 2026-09-04
v3 · public-demo · GPT-6 Astra (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'max' reasoning effort.",
"modelsEtag": "W/\"a8dc9c600e07efa11ca8fb622181783f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"946807139d47f4bc368591b95885dfb4\"",
"upstreamModelId": "openai-gpt-6-astra-max",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 26097.501720000007,
"providerModelIdPublished": false
}Evidence observed 2026-09-04
v3 · public-demo · GPT-6 Astra - Provider Adapter (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'max' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"a8dc9c600e07efa11ca8fb622181783f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"946807139d47f4bc368591b95885dfb4\"",
"upstreamModelId": "openai-gpt-6-astra-max-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 17331.95327,
"providerModelIdPublished": false
}Evidence observed 2026-09-04
v3 · public-demo · GPT-6 Astra - Provider Adapter (Low) · effort low · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-low-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'low' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"a8dc9c600e07efa11ca8fb622181783f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"946807139d47f4bc368591b95885dfb4\"",
"upstreamModelId": "openai-gpt-6-astra-low-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 21297.922310000005,
"providerModelIdPublished": false
}Evidence observed 2026-09-04
v3 · public-demo · GPT-6 Astra - Provider Adapter (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'none' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"a8dc9c600e07efa11ca8fb622181783f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"946807139d47f4bc368591b95885dfb4\"",
"upstreamModelId": "openai-gpt-6-astra-none-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 23456.663940000002,
"providerModelIdPublished": false
}Evidence observed 2026-09-04
v3 · public-demo · GPT-6 Astra - Provider Adapter (XHigh) · effort xhigh · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-xhigh-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'xhigh' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"a8dc9c600e07efa11ca8fb622181783f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"946807139d47f4bc368591b95885dfb4\"",
"upstreamModelId": "openai-gpt-6-astra-xhigh-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 18147.191119999996,
"providerModelIdPublished": false
}Evidence observed 2026-09-04
v3 · public-demo · GPT-6 Astra - Provider Adapter (Medium) · effort medium · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-medium-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'medium' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"a8dc9c600e07efa11ca8fb622181783f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"946807139d47f4bc368591b95885dfb4\"",
"upstreamModelId": "openai-gpt-6-astra-medium-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 19284.776630000004,
"providerModelIdPublished": false
}Evidence observed 2026-09-04
v3 · public-demo · GPT-6 Astra (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'none' reasoning effort.",
"modelsEtag": "W/\"a8dc9c600e07efa11ca8fb622181783f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"946807139d47f4bc368591b95885dfb4\"",
"upstreamModelId": "openai-gpt-6-astra-none",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 49791.11317000001,
"providerModelIdPublished": false
}Evidence observed 2026-09-04
v3 · public-demo · GPT-6 Astra (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'max' reasoning effort.",
"modelsEtag": "W/\"a8dc9c600e07efa11ca8fb622181783f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"946807139d47f4bc368591b95885dfb4\"",
"upstreamModelId": "openai-gpt-6-astra-max",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 26097.501720000007,
"providerModelIdPublished": false
}Evidence observed 2026-09-03
v3 · public-demo · GPT-6 Astra - Provider Adapter (Max) · effort max · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-max-provider-adapter
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra-provider-adapter",
"modelNotes": "Evaluation conducted with 'max' reasoning effort using the provider adapter harness.",
"modelsEtag": "W/\"a8dc9c600e07efa11ca8fb622181783f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"946807139d47f4bc368591b95885dfb4\"",
"upstreamModelId": "openai-gpt-6-astra-max-provider-adapter",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 17331.95327,
"providerModelIdPublished": false
}Evidence observed 2026-09-03
v3 · public-demo · GPT-6 Astra (None) · 1 attempt · 5x-human-baseline-median-per-level · arc-agi-3:public-demo · record v3_Semi_Private:openai-gpt-6-astra-none
{
"provider": "OpenAI",
"modelType": "CoT",
"modelsUrl": "https://arcprize.org/media/data/models.json",
"modelGroup": "openai-gpt-6-astra",
"modelNotes": "Evaluation conducted with 'none' reasoning effort.",
"modelsEtag": "W/\"a8dc9c600e07efa11ca8fb622181783f\"",
"scoreMetric": "relative-human-action-efficiency",
"evaluationsUrl": "https://arcprize.org/media/data/evaluations.json",
"evaluationsEtag": "W/\"946807139d47f4bc368591b95885dfb4\"",
"upstreamModelId": "openai-gpt-6-astra-none",
"environmentCount": 25,
"modelReleaseDate": "2026-09-02T00:00:00.000Z",
"upstreamDatasetId": "v3_Semi_Private",
"actionBudgetPolicy": "5x-human-baseline-median-per-level",
"technicalReportUrl": "https://arcprize.org/media/ARC_AGI_3_Technical_Report.pdf",
"catalogMatchAliases": [],
"agentHarnessPublished": false,
"verificationAuthority": "ARC Prize Foundation",
"upstreamRunIdPublished": false,
"actualEvaluationCostUsd": 49791.11317000001,
"providerModelIdPublished": false
}Evidence observed 2026-09-03
Axes
Filters
Providers