Models / GPT-6 Astra

OpenAI

GPT-6 Astra

129 published results from 11 sources. Each card shows where the number comes from and what it does not measure. The overall leaderboard combines them; here each stands alone.

Provider
OpenAI
Sources
11
Our benchmarks
3
Price per million tokens
$10.00 in · $50.00 out
OpenRouter list price, 1 Oct 2026 · 1,050,000-token context

Measured by Spring Prompt

Measured by Spring Prompt · BulletBench
$0.28
Cost per game · rank 9 of 10
Unit
US dollars, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
29 Sep 2026
Not shown
Not your cost: prices are those charged on the run date.
Measured by Spring Prompt · BulletBench
37.5%
Games lost on time · rank 5 of 10
Unit
% of games, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
29 Sep 2026
Not shown
Not a business skill: chess against an engine on a real clock, used here as a speed-under-pressure signal.
Measured by Spring Prompt · BulletBench
0.0%
Invalid moves · rank 1 of 10
Unit
% of moves, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
29 Sep 2026
Not shown
Not a business skill: chess against an engine on a real clock, used here as a speed-under-pressure signal.
Measured by Spring Prompt · BulletBench
839
Ladder Elo · rank 1 of 10
Unit
ladder Elo, higher is better
Range
595 to 1,072
Sample
8 games
Configuration
GPT-6 Astra, provider default reasoning
Measured
29 Sep 2026
Not shown
Not a business skill: chess against an engine on a real clock, used here as a speed-under-pressure signal.
Measured by Spring Prompt · BulletBench
5.6 s
Median move time · rank 6 of 10
Unit
milliseconds, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
29 Sep 2026
Not shown
Not general response speed: replies are one short move.
Measured by Spring Prompt · BulletBench
$0.0943
Cost per game · rank 23 of 24
Unit
US dollars, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
1 Oct 2026
Not shown
Not your cost: prices are those charged on the run date.
Measured by Spring Prompt · BulletBench
$0.10
Cost per game · rank 24 of 24
Unit
US dollars, lower is better
Configuration
GPT-6 Astra (low reasoning), low reasoning
Measured
1 Oct 2026
Not shown
Not your cost: prices are those charged on the run date.
Measured by Spring Prompt · BulletBench
83.3%
Games lost on time · rank 20 of 24
Unit
% of games, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
1 Oct 2026
Not shown
Not a business skill: chess against an engine on a real clock, used here as a speed-under-pressure signal.
Measured by Spring Prompt · BulletBench
75.0%
Games lost on time · rank 19 of 24
Unit
% of games, lower is better
Configuration
GPT-6 Astra (low reasoning), low reasoning
Measured
1 Oct 2026
Not shown
Not a business skill: chess against an engine on a real clock, used here as a speed-under-pressure signal.
Measured by Spring Prompt · BulletBench
0.0%
Invalid moves · rank 1 of 24
Unit
% of moves, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
1 Oct 2026
Not shown
Not a business skill: chess against an engine on a real clock, used here as a speed-under-pressure signal.
Measured by Spring Prompt · BulletBench
0.0%
Invalid moves · rank 1 of 24
Unit
% of moves, lower is better
Configuration
GPT-6 Astra (low reasoning), low reasoning
Measured
1 Oct 2026
Not shown
Not a business skill: chess against an engine on a real clock, used here as a speed-under-pressure signal.
Measured by Spring Prompt · BulletBench
197
Ladder Elo · rank 5 of 24
Unit
ladder Elo, higher is better
Range
0 to 439
Sample
12 games
Configuration
GPT-6 Astra, provider default reasoning
Measured
1 Oct 2026
Not shown
Not a business skill: chess against an engine on a real clock, used here as a speed-under-pressure signal.
Measured by Spring Prompt · BulletBench
323
Ladder Elo · rank 5 of 24
Unit
ladder Elo, higher is better
Range
0 to 528
Sample
12 games
Configuration
GPT-6 Astra (low reasoning), low reasoning
Measured
1 Oct 2026
Not shown
Not a business skill: chess against an engine on a real clock, used here as a speed-under-pressure signal.
Measured by Spring Prompt · BulletBench
3.0 s
Median move time · rank 21 of 24
Unit
milliseconds, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
1 Oct 2026
Not shown
Not general response speed: replies are one short move.
Measured by Spring Prompt · BulletBench
2.3 s
Median move time · rank 18 of 24
Unit
milliseconds, lower is better
Configuration
GPT-6 Astra (low reasoning), low reasoning
Measured
1 Oct 2026
Not shown
Not general response speed: replies are one short move.
Measured by Spring Prompt · CatalogBench
0.0%
Channel rules broken · rank 1 of 18
Unit
% of products, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
0.0%
Claims to check · rank 1 of 18
Unit
% of products, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
98.9%
Content quality · rank 1 of 18
Unit
% of checks, higher is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
0.0%
Failed outputs · rank 1 of 18
Unit
% of products, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not a provider outage: provider errors are retried before a product counts as failed.
Measured by Spring Prompt · CatalogBench
0.0%
Missing UK information · rank 1 of 18
Unit
% of products, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
5.4%
Not findable · rank 9 of 18
Unit
% of products, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
73.2%
Publish-ready listings · rank 2 of 18
Unit
% of products, higher is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
69.6%
Reliably publish-ready · rank 1 of 18
Unit
% of products, higher is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
2.4%
Unsupported claims · rank 1 of 18
Unit
% of products, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
0.05
Unsupported claims · rank 1 of 18
Unit
claims per product, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
20.2%
Wrong attributes · rank 12 of 18
Unit
% of products, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
1.8%
Wrong category or variant · rank 3 of 18
Unit
% of products, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
100.0%
Channel compliance · rank 1 of 18
Unit
% of products, higher is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
0.0%
Channel rules broken · rank 1 of 18
Unit
% of products, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
0.0%
Claims to check · rank 1 of 18
Unit
% of products, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
100.0%
Conflicts caught · rank 1 of 18
Unit
% of conflicts, higher is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
98.5%
Content quality · rank 2 of 18
Unit
% of checks, higher is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
$0.0371
Cost per product · rank 15 of 18
Unit
US dollars, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your cost: prices are those charged through OpenRouter on the run date.
Measured by Spring Prompt · CatalogBench
98.5%
Decision accuracy · rank 2 of 18
Unit
% of decisions, higher is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
0.0%
Failed outputs · rank 1 of 18
Unit
% of products, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not a provider outage: provider errors are retried before a product counts as failed.
Measured by Spring Prompt · CatalogBench
94.2%
Field accuracy · rank 6 of 18
Unit
% of missing fields, higher is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
1.9%
Invented values · rank 12 of 18
Unit
% of filled values, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
0.0%
Missing UK information · rank 1 of 18
Unit
% of products, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
6.0%
Not findable · rank 10 of 18
Unit
% of products, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
77.4%
Publish-ready listings · rank 2 of 18
Unit
% of products, higher is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
75.0%
Reliably publish-ready · rank 1 of 18
Unit
% of products, higher is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
1.2%
Unsupported claims · rank 2 of 18
Unit
% of products, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
0.02
Unsupported claims · rank 2 of 18
Unit
claims per product, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
17.3%
Wrong attributes · rank 10 of 18
Unit
% of products, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
1.8%
Wrong category or variant · rank 2 of 18
Unit
% of products, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · ROASBench
68.6
Audience score · rank 2 of 17
Unit
score out of 100, higher is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
29 Sep 2026
Not shown
Not real ad performance: the market is a deterministic simulation of one invented skincare brand.
Measured by Spring Prompt · ROASBench
57.5
Business score · rank 1 of 17
Unit
score out of 100, higher is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
29 Sep 2026
Not shown
Not real ad performance: the market is a deterministic simulation of one invented skincare brand.
Measured by Spring Prompt · ROASBench
44.7
Consistency score · rank 1 of 17
Unit
score out of 100, higher is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
29 Sep 2026
Not shown
Not real ad performance: the market is a deterministic simulation of one invented skincare brand.
Measured by Spring Prompt · ROASBench
$599,139
Contribution profit · rank 7 of 17
Unit
simulated US dollars, higher is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
29 Sep 2026
Not shown
Not real ad performance: the market is a deterministic simulation of one invented skincare brand.
Measured by Spring Prompt · ROASBench
$1.23
Cost of a run · rank 16 of 17
Unit
US dollars, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
29 Sep 2026
Not shown
Not your cost: prices are those charged through OpenRouter on the run date.
Measured by Spring Prompt · ROASBench
0
Months over budget · rank 1 of 17
Unit
months of 12, lower is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
29 Sep 2026
Not shown
Not real ad performance: the market is a deterministic simulation of one invented skincare brand.
Measured by Spring Prompt · ROASBench
56.6
Overall score · rank 1 of 17
Unit
score out of 100, higher is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
29 Sep 2026
Not shown
Not real ad performance: the market is a deterministic simulation of one invented skincare brand.
Measured by Spring Prompt · ROASBench
54.9
Planning score · rank 3 of 17
Unit
score out of 100, higher is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
29 Sep 2026
Not shown
Not real ad performance: the market is a deterministic simulation of one invented skincare brand.
Measured by Spring Prompt · ROASBench
$0.67
Return on ad spend · rank 3 of 17
Unit
profit per $1 spent, higher is better
Configuration
GPT-6 Astra, provider default reasoning
Measured
29 Sep 2026
Not shown
Not real ad performance: the market is a deterministic simulation of one invented skincare brand.

Reported by others

Reported by APEX-Agents
64.7%
Tasks passed · rank 7 of 39
Unit
% of tasks, higher is better
Configuration
GPT-6 Astra
Measured
1 Oct 2026
Not shown
Not your firm's documents or tools; graded by rubric, not by a client.
Reported by Arena (formerly LMArena)
0.13
Confirmed task success · rank 1 of 46
Unit
IPS effect estimate, higher is better
Range
0.09 to 0.16
Sample
5966 observations
Configuration
GPT-6 Astra
Measured
28 Sep 2026
Not shown
Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
Reported by Arena (formerly LMArena)
0.34
Praise over complaint · rank 1 of 46
Unit
IPS effect estimate, higher is better
Range
0.25 to 0.43
Sample
1537 observations
Configuration
GPT-6 Astra
Measured
28 Sep 2026
Not shown
Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
Reported by Arena (formerly LMArena)
-0.01
Steerability · rank 11 of 46
Unit
IPS effect estimate, higher is better
Range
-0.06 to 0.04
Sample
3817 observations
Configuration
GPT-6 Astra
Measured
28 Sep 2026
Not shown
Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
Reported by Arena (formerly LMArena)
0.00
Tool grounding · rank 1 of 46
Unit
IPS effect estimate, higher is better
Range
0.00 to 0.00
Sample
828887 observations
Configuration
GPT-6 Astra
Measured
28 Sep 2026
Not shown
Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
Reported by Arena (formerly LMArena)
1,473
Overall · rank 5 of 44
Unit
Arena rating, higher is better
Range
1,458 to 1,487
Sample
1621 votes
Configuration
GPT-6 Astra (max)
Measured
13 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
Reported by Arena (formerly LMArena)
1,465
Overall · rank 22 of 177
Unit
Arena rating, higher is better
Range
1,458 to 1,471
Sample
6910 votes
Configuration
GPT-6 Astra (max)
Measured
25 Sep 2026
Not shown
Not an error rate: claims that cannot be checked on the web are skipped, and preference still carries most of the weight.
Reported by Arena (formerly LMArena)
1,483
Business, management and finance · rank 2 of 402
Unit
Arena rating, higher is better
Range
1,466 to 1,499
Sample
1343 votes
Configuration
GPT-6 Astra (max)
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
Reported by Arena (formerly LMArena)
1,453
Creative writing · rank 12 of 407
Unit
Arena rating, higher is better
Range
1,437 to 1,470
Sample
1484 votes
Configuration
GPT-6 Astra (max)
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
Reported by Arena (formerly LMArena)
1,510
Expert prompts · rank 4 of 359
Unit
Arena rating, higher is better
Range
1,488 to 1,532
Sample
729 votes
Configuration
GPT-6 Astra (max)
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
Reported by Arena (formerly LMArena)
1,473
Instruction following · rank 9 of 409
Unit
Arena rating, higher is better
Range
1,461 to 1,486
Sample
2284 votes
Configuration
GPT-6 Astra (max)
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
Reported by Arena (formerly LMArena)
1,478
Overall · rank 13 of 409
Unit
Arena rating, higher is better
Range
1,470 to 1,485
Sample
7185 votes
Configuration
GPT-6 Astra (max)
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
Reported by Arena (formerly LMArena)
1,469
Writing, literature and language · rank 8 of 408
Unit
Arena rating, higher is better
Range
1,455 to 1,483
Sample
1929 votes
Configuration
GPT-6 Astra (max)
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
Reported by Artificial Analysis
77.1
Artificial Analysis Coding Index · rank 8 of 151
Unit
index score, higher is better
Configuration
GPT-6 Astra (high reasoning)
Measured
1 Oct 2026
Not shown
Not your codebase or tools.
Reported by Artificial Analysis
75.7
Artificial Analysis Coding Index · rank 26 of 151
Unit
index score, higher is better
Configuration
GPT-6 Astra (low reasoning)
Measured
1 Oct 2026
Not shown
Not your codebase or tools.
Reported by Artificial Analysis
76.9
Artificial Analysis Coding Index · rank 11 of 151
Unit
index score, higher is better
Configuration
GPT-6 Astra (max)
Measured
1 Oct 2026
Not shown
Not your codebase or tools.
Reported by Artificial Analysis
76.7
Artificial Analysis Coding Index · rank 13 of 151
Unit
index score, higher is better
Configuration
GPT-6 Astra (medium reasoning)
Measured
1 Oct 2026
Not shown
Not your codebase or tools.
Reported by Artificial Analysis
75.9
Artificial Analysis Coding Index · rank 23 of 151
Unit
index score, higher is better
Configuration
GPT-6 Astra (xhigh reasoning)
Measured
1 Oct 2026
Not shown
Not your codebase or tools.
Reported by Artificial Analysis
50.9
Artificial Analysis Intelligence Index · rank 15 of 314
Unit
index score, higher is better
Configuration
GPT-6 Astra (high reasoning)
Measured
1 Oct 2026
Not shown
Not business work, and a blend: read the parts for any one task.
Reported by Artificial Analysis
45.8
Artificial Analysis Intelligence Index · rank 31 of 314
Unit
index score, higher is better
Configuration
GPT-6 Astra (low reasoning)
Measured
1 Oct 2026
Not shown
Not business work, and a blend: read the parts for any one task.
Reported by Artificial Analysis
52.7
Artificial Analysis Intelligence Index · rank 7 of 314
Unit
index score, higher is better
Configuration
GPT-6 Astra (max)
Measured
1 Oct 2026
Not shown
Not business work, and a blend: read the parts for any one task.
Reported by Artificial Analysis
49.6
Artificial Analysis Intelligence Index · rank 19 of 314
Unit
index score, higher is better
Configuration
GPT-6 Astra (medium reasoning)
Measured
1 Oct 2026
Not shown
Not business work, and a blend: read the parts for any one task.
Reported by Artificial Analysis
52.4
Artificial Analysis Intelligence Index · rank 9 of 314
Unit
index score, higher is better
Configuration
GPT-6 Astra (xhigh reasoning)
Measured
1 Oct 2026
Not shown
Not business work, and a blend: read the parts for any one task.
Reported by Artificial Analysis
94.9%
GPQA Diamond · rank 4 of 276
Unit
% of questions, higher is better
Configuration
GPT-6 Astra (high reasoning)
Measured
1 Oct 2026
Not shown
Not applied work; multiple-choice science questions.
Reported by Artificial Analysis
93.1%
GPQA Diamond · rank 24 of 276
Unit
% of questions, higher is better
Configuration
GPT-6 Astra (low reasoning)
Measured
1 Oct 2026
Not shown
Not applied work; multiple-choice science questions.
Reported by Artificial Analysis
96.1%
GPQA Diamond · rank 2 of 276
Unit
% of questions, higher is better
Configuration
GPT-6 Astra (max)
Measured
1 Oct 2026
Not shown
Not applied work; multiple-choice science questions.
Reported by Artificial Analysis
93.9%
GPQA Diamond · rank 10 of 276
Unit
% of questions, higher is better
Configuration
GPT-6 Astra (medium reasoning)
Measured
1 Oct 2026
Not shown
Not applied work; multiple-choice science questions.
Reported by Artificial Analysis
96.3%
GPQA Diamond · rank 1 of 276
Unit
% of questions, higher is better
Configuration
GPT-6 Astra (xhigh reasoning)
Measured
1 Oct 2026
Not shown
Not applied work; multiple-choice science questions.
Reported by Artificial Analysis
53.1%
Humanity's Last Exam · rank 16 of 314
Unit
% of questions, higher is better
Configuration
GPT-6 Astra (high reasoning)
Measured
1 Oct 2026
Not shown
Not everyday work; academic questions at the edge of expertise.
Reported by Artificial Analysis
49.2%
Humanity's Last Exam · rank 26 of 314
Unit
% of questions, higher is better
Configuration
GPT-6 Astra (low reasoning)
Measured
1 Oct 2026
Not shown
Not everyday work; academic questions at the edge of expertise.
Reported by Artificial Analysis
54.7%
Humanity's Last Exam · rank 11 of 314
Unit
% of questions, higher is better
Configuration
GPT-6 Astra (max)
Measured
1 Oct 2026
Not shown
Not everyday work; academic questions at the edge of expertise.
Reported by Artificial Analysis
52.7%
Humanity's Last Exam · rank 19 of 314
Unit
% of questions, higher is better
Configuration
GPT-6 Astra (medium reasoning)
Measured
1 Oct 2026
Not shown
Not everyday work; academic questions at the edge of expertise.
Reported by Artificial Analysis
54.6%
Humanity's Last Exam · rank 13 of 314
Unit
% of questions, higher is better
Configuration
GPT-6 Astra (xhigh reasoning)
Measured
1 Oct 2026
Not shown
Not everyday work; academic questions at the edge of expertise.
Reported by Artificial Analysis
80.0%
Long-context reasoning (AA-LCR) · rank 65 of 309
Unit
% of questions, higher is better
Configuration
GPT-6 Astra (high reasoning)
Measured
1 Oct 2026
Not shown
Not retrieval over your own document store.
Reported by Artificial Analysis
80.0%
Long-context reasoning (AA-LCR) · rank 65 of 309
Unit
% of questions, higher is better
Configuration
GPT-6 Astra (low reasoning)
Measured
1 Oct 2026
Not shown
Not retrieval over your own document store.
Reported by Artificial Analysis
80.7%
Long-context reasoning (AA-LCR) · rank 53 of 309
Unit
% of questions, higher is better
Configuration
GPT-6 Astra (max)
Measured
1 Oct 2026
Not shown
Not retrieval over your own document store.
Reported by Artificial Analysis
79.7%
Long-context reasoning (AA-LCR) · rank 73 of 309
Unit
% of questions, higher is better
Configuration
GPT-6 Astra (medium reasoning)
Measured
1 Oct 2026
Not shown
Not retrieval over your own document store.
Reported by Artificial Analysis
80.0%
Long-context reasoning (AA-LCR) · rank 65 of 309
Unit
% of questions, higher is better
Configuration
GPT-6 Astra (xhigh reasoning)
Measured
1 Oct 2026
Not shown
Not retrieval over your own document store.
Reported by Artificial Analysis
55.4%
SciCode · rank 44 of 153
Unit
% of problems, higher is better
Configuration
GPT-6 Astra (high reasoning)
Measured
1 Oct 2026
Not shown
Not general software engineering.
Reported by Artificial Analysis
54.1%
SciCode · rank 59 of 153
Unit
% of problems, higher is better
Configuration
GPT-6 Astra (low reasoning)
Measured
1 Oct 2026
Not shown
Not general software engineering.
Reported by Artificial Analysis
56.5%
SciCode · rank 31 of 153
Unit
% of problems, higher is better
Configuration
GPT-6 Astra (max)
Measured
1 Oct 2026
Not shown
Not general software engineering.
Reported by Artificial Analysis
54.2%
SciCode · rank 57 of 153
Unit
% of problems, higher is better
Configuration
GPT-6 Astra (medium reasoning)
Measured
1 Oct 2026
Not shown
Not general software engineering.
Reported by Artificial Analysis
55.7%
SciCode · rank 40 of 153
Unit
% of problems, higher is better
Configuration
GPT-6 Astra (xhigh reasoning)
Measured
1 Oct 2026
Not shown
Not general software engineering.
Reported by Artificial Analysis
89.9%
Terminal-Bench 2.1 · rank 3 of 151
Unit
% of tasks, higher is better
Configuration
GPT-6 Astra (high reasoning)
Measured
1 Oct 2026
Not shown
Not other harnesses or tools; superseded by 4.0 for newer models.
Reported by Artificial Analysis
88.0%
Terminal-Bench 2.1 · rank 12 of 151
Unit
% of tasks, higher is better
Configuration
GPT-6 Astra (low reasoning)
Measured
1 Oct 2026
Not shown
Not other harnesses or tools; superseded by 4.0 for newer models.
Reported by Artificial Analysis
88.4%
Terminal-Bench 2.1 · rank 10 of 151
Unit
% of tasks, higher is better
Configuration
GPT-6 Astra (max)
Measured
1 Oct 2026
Not shown
Not other harnesses or tools; superseded by 4.0 for newer models.
Reported by Artificial Analysis
89.5%
Terminal-Bench 2.1 · rank 5 of 151
Unit
% of tasks, higher is better
Configuration
GPT-6 Astra (medium reasoning)
Measured
1 Oct 2026
Not shown
Not other harnesses or tools; superseded by 4.0 for newer models.
Reported by Artificial Analysis
89.1%
Terminal-Bench 2.1 · rank 7 of 151
Unit
% of tasks, higher is better
Configuration
GPT-6 Astra (xhigh reasoning)
Measured
1 Oct 2026
Not shown
Not other harnesses or tools; superseded by 4.0 for newer models.
Reported by Artificial Analysis
54.0%
Terminal-Bench 4.0 · rank 11 of 150
Unit
% of tasks, higher is better
Configuration
GPT-6 Astra (high reasoning)
Measured
1 Oct 2026
Not shown
Not other harnesses or tools; one attempt per task.
Reported by Artificial Analysis
41.9%
Terminal-Bench 4.0 · rank 26 of 150
Unit
% of tasks, higher is better
Configuration
GPT-6 Astra (low reasoning)
Measured
1 Oct 2026
Not shown
Not other harnesses or tools; one attempt per task.
Reported by Artificial Analysis
59.1%
Terminal-Bench 4.0 · rank 5 of 150
Unit
% of tasks, higher is better
Configuration
GPT-6 Astra (max)
Measured
1 Oct 2026
Not shown
Not other harnesses or tools; one attempt per task.
Reported by Artificial Analysis
49.5%
Terminal-Bench 4.0 · rank 17 of 150
Unit
% of tasks, higher is better
Configuration
GPT-6 Astra (medium reasoning)
Measured
1 Oct 2026
Not shown
Not other harnesses or tools; one attempt per task.
Reported by Artificial Analysis
59.6%
Terminal-Bench 4.0 · rank 2 of 150
Unit
% of tasks, higher is better
Configuration
GPT-6 Astra (xhigh reasoning)
Measured
1 Oct 2026
Not shown
Not other harnesses or tools; one attempt per task.
Reported by Artificial Analysis
40.0%
Τ-bench banking · rank 31 of 142
Unit
% of tasks, higher is better
Configuration
GPT-6 Astra (high reasoning)
Measured
1 Oct 2026
Not shown
Not your policies or systems; a simulated customer.
Reported by Artificial Analysis
32.0%
Τ-bench banking · rank 56 of 142
Unit
% of tasks, higher is better
Configuration
GPT-6 Astra (low reasoning)
Measured
1 Oct 2026
Not shown
Not your policies or systems; a simulated customer.
Reported by Artificial Analysis
41.4%
Τ-bench banking · rank 27 of 142
Unit
% of tasks, higher is better
Configuration
GPT-6 Astra (max)
Measured
1 Oct 2026
Not shown
Not your policies or systems; a simulated customer.
Reported by Artificial Analysis
35.5%
Τ-bench banking · rank 45 of 142
Unit
% of tasks, higher is better
Configuration
GPT-6 Astra (medium reasoning)
Measured
1 Oct 2026
Not shown
Not your policies or systems; a simulated customer.
Reported by Artificial Analysis
43.1%
Τ-bench banking · rank 22 of 142
Unit
% of tasks, higher is better
Configuration
GPT-6 Astra (xhigh reasoning)
Measured
1 Oct 2026
Not shown
Not your policies or systems; a simulated customer.
Reported by Remote Labor Index
20.8%
Projects done to client standard · rank 1 of 14
Unit
% of projects, higher is better
Configuration
GPT-6 Astra
Measured
1 Oct 2026
Not shown
Not speed or cost; a small set of projects, so a few points either way are noise.
Reported by SimpleQA Verified (Epoch AI)
75.6%
Correct answers · rank 1 of 85
Unit
% of questions, higher is better
Configuration
GPT-6 Astra (max)
Measured
30 Aug 2026
Not shown
Not answers grounded in your documents; tests what the model remembers.
Reported by UGI Leaderboard
0.0%
Requested-length error · rank 1 of 370
Unit
% off the requested word count, lower is better
Configuration
GPT-6 Astra (high reasoning)
Measured
5 Sep 2026
Not shown
Not other format limits such as character counts or bullet counts.
Reported by UGI Leaderboard
1.0%
Requested-length error · rank 3 of 370
Unit
% off the requested word count, lower is better
Configuration
GPT-6 Astra (low reasoning)
Measured
5 Sep 2026
Not shown
Not other format limits such as character counts or bullet counts.
Reported by UGI Leaderboard
1.0%
Requested-length error · rank 3 of 370
Unit
% off the requested word count, lower is better
Configuration
GPT-6 Astra (medium reasoning)
Measured
5 Sep 2026
Not shown
Not other format limits such as character counts or bullet counts.
Reported by UGI Leaderboard
0.0%
Requested-length error · rank 1 of 370
Unit
% off the requested word count, lower is better
Configuration
GPT-6 Astra (xhigh reasoning)
Measured
5 Sep 2026
Not shown
Not other format limits such as character counts or bullet counts.
Reported by UGI Leaderboard
0.36
Style adherence · rank 124 of 370
Unit
score from 0 to 1, higher is better
Configuration
GPT-6 Astra (high reasoning)
Measured
5 Sep 2026
Not shown
Not brand voice on your own examples: UGI's prompts are private and lean towards creative writing.
Reported by UGI Leaderboard
0.37
Style adherence · rank 104 of 370
Unit
score from 0 to 1, higher is better
Configuration
GPT-6 Astra (low reasoning)
Measured
5 Sep 2026
Not shown
Not brand voice on your own examples: UGI's prompts are private and lean towards creative writing.
Reported by UGI Leaderboard
0.38
Style adherence · rank 71 of 370
Unit
score from 0 to 1, higher is better
Configuration
GPT-6 Astra (medium reasoning)
Measured
5 Sep 2026
Not shown
Not brand voice on your own examples: UGI's prompts are private and lean towards creative writing.
Reported by UGI Leaderboard
0.38
Style adherence · rank 71 of 370
Unit
score from 0 to 1, higher is better
Configuration
GPT-6 Astra (xhigh reasoning)
Measured
5 Sep 2026
Not shown
Not brand voice on your own examples: UGI's prompts are private and lean towards creative writing.
Reported by UGI Leaderboard
68.9
Writing score · rank 32 of 370
Unit
score out of 100, higher is better
Configuration
GPT-6 Astra (high reasoning)
Measured
5 Sep 2026
Not shown
Not business copy quality: UGI's prompts are private and lean towards creative writing, and models that often refuse get no score.
Reported by UGI Leaderboard
65.1
Writing score · rank 64 of 370
Unit
score out of 100, higher is better
Configuration
GPT-6 Astra (low reasoning)
Measured
5 Sep 2026
Not shown
Not business copy quality: UGI's prompts are private and lean towards creative writing, and models that often refuse get no score.
Reported by UGI Leaderboard
68.1
Writing score · rank 39 of 370
Unit
score out of 100, higher is better
Configuration
GPT-6 Astra (medium reasoning)
Measured
5 Sep 2026
Not shown
Not business copy quality: UGI's prompts are private and lean towards creative writing, and models that often refuse get no score.
Reported by UGI Leaderboard
68.0
Writing score · rank 40 of 370
Unit
score out of 100, higher is better
Configuration
GPT-6 Astra (xhigh reasoning)
Measured
5 Sep 2026
Not shown
Not business copy quality: UGI's prompts are private and lean towards creative writing, and models that often refuse get no score.
Reported by Vectara Hallucination Leaderboard
100.0%
Answer rate · rank 1 of 108
Unit
% of documents, higher is better
Configuration
GPT-6 Astra
Measured
22 Sep 2026
Not shown
Not a quality score: a low rate usually means content filters were triggered, and hallucination rates are measured on answered documents only.
Reported by Vectara Hallucination Leaderboard
8.7%
Hallucination rate · rank 45 of 108
Unit
% of summaries, lower is better
Configuration
GPT-6 Astra
Measured
22 Sep 2026
Not shown
Not errors in open questions or other tasks: only summarisation, judged by Vectara's own model (HHEM-2.3), not by people, on news-style documents rather than your data.
Reported by Vending-Bench 2
$15,514.70
Money after a year · rank 1 of 63
Unit
US dollars, higher is better
Configuration
GPT-6 Astra
Measured
1 Oct 2026
Not shown
Not a real business; one simulated market with set rules.

Compare GPT-6 Astra with