Models / GPT-6 Astra
GPT-6 Astra
GPT-6 Astra is best for product listings, and reasoning and knowledge; pick it when quality matters more than cost. The cheapest model of similar intelligence is Claude Sonnet 5.5, at $4.00 per million tokens against $20.00.
Results 16 Nov 2026 · 157 results · 12 sources
Test GPT-6 Astra on your prompt → It runs beside the models you could use instead, with every answer checked and costed.
- Price per million tokens
- $10.00 in · $50.00 out
OpenAI's list price, 10 Nov 2026 · compare prices$1.00 cached input · 50% off in batch - Speed
- 72 tokens a second; on its test prompt the answer starts after 3.7 min, thinking time included
Artificial Analysis, on its usual API, at max reasoning; 55–72 across 5 settings - Intelligence Index
- 52.7
Artificial Analysis, at max reasoning; 45.8–52.7 across 5 settings - Spring Prompt overall
- 5th of 36 score 77 of 100 · how it works
- Spring Prompt Score
- 83 of 100 4th of 32 · 4 of 5 benchmarks · our own tests only
- Developer
- OpenAI, based in the US
Weights not published - Released
- 3 Sep 2026
1,050,000 tokens of context
Where it stands among the models you could choose
Available models grouped by price, intelligence, speed and developer location. Retired models are excluded.
| Among | Intelligence Index | Spring Prompt overall | Price, blended | Speed |
|---|---|---|---|---|
| Models available today | 4th of 185Claude Opus 5.5 | 5th of 35Claude Fable 5.2 | $20.00 blended, 98th percentilecheapest: Mistral Nemo | 49th of 65Nemotron 3.5 Super VL |
| Models priced $10 or more per million tokens | 2nd of 11Claude Fable 5.1 | 2nd of 3Claude Fable 5.2 | sets this group | – |
| Models with similar intelligence | sets this group | 2nd of 6GPT-6.1 Sol | $20.00 blended, 71st percentilecheapest: Claude Sonnet 5.5 | 4th of 5Muse Wonder |
| Models writing 50–100 tokens a second | 3rd of 21Claude Opus 5.5 | 3rd of 7Claude Opus 5.5 | $20.00 blended, 95th percentilecheapest: Granite 4.2 8B | sets this group |
| Models from developers based in the US | 4th of 92Claude Opus 5.5 | 5th of 21Claude Fable 5.2 | $20.00 blended, 95th percentilecheapest: Gemma 3 4B | 28th of 33Nemotron 3.5 Super VL |
The name under each rank is the leader of that group; green is the top quarter of the group and red the bottom quarter, by rank. Price is shown as a percentile: the share of the group that costs less, so lower is cheaper. "Sets this group" marks the measure the group is defined by. Spring Prompt overall is our score out of 100 across every source (how it works). Price is the developer's list price (or the typical OpenRouter host where we haven't read one) for three input tokens to one output; intelligence and speed are from Artificial Analysis (data sourced from Artificial Analysis); "similar intelligence" means within 4 points on its Intelligence Index. Developer locations are where each company is based, not where a model is served. Groups under 3 models are not ranked.
Measured cost per task
API cost recorded in our benchmark runs, excluding judging.
| Task | Benchmark | Cost per task |
|---|---|---|
| Product listing | CatalogBench | ≈ $0.037 |
| Deck | DeckBench | ≈ $1.09 |
| Game of blitz chess | BulletBench | ≈ $0.285 |
Cheapest model that passes
On our benchmarks that define a pass for each task: what one passing answer cost in our run, failed attempts included, and whether a cheaper model passed.
- CatalogBench · cost per 1,000 accepted listings
GPT-6 Astra: $47.97 (130 of 168 attempts), 17 of 25. Cheapest: GPT-6 Luna at $0.70 (114 of 168 attempts). Cheaper and passed at least as often: GPT-6.1 Sol at $10.75 (131 of 168 attempts). - DeckBench · cost per presentable deck
GPT-6 Astra: $1.64 (4 of 6 tasks), 11 of 12. Cheapest: GPT-6.1 Terra at $0.13 (3 of 6 tasks). Every cheaper model passed less often.
Cost per attempt divided by the share that passed, at the run date's prices, excluding judging. Each model at its cheapest setting per passing answer. With a handful of tasks, a pass or two either way is within chance. No estimate where a run had missing outputs, because their cost may not have been recorded.
How good is it, and for what?
Each use case ranks the available models its benchmarks measured, then those priced $10 or more per million tokens. The bar shows its percentile in that field, best to the right. Open a row for the results behind it.
Product listingsTurning a sparse product feed and photos into listings that can go live
| Benchmark | GPT-6 Astra | Rank among available | Best available |
|---|---|---|---|
| CatalogBenchCatalogBench: reliably publish-ready | 75.0% | 1st of 32 | This model |
| CatalogBenchCatalogBench (sales brief): reliably publish-ready | 69.6% | 1st of 32 | This model |
Decks from an analysisTurning a finished analysis into a deck you could present as it is
| Benchmark | GPT-6 Astra | Rank among available | Best available |
|---|---|---|---|
| DeckBenchDeckBench: deck rating | 1,566 | 2nd of 32 | Qwen4-Max 1,585 |
User surveysPlanning a user survey and reading its results without being misled
- SurveyBench: has not measured this model.
Marketing planningPlanning a year of ad spend without overspending
| Benchmark | GPT-6 Astra | Rank among available | Best available |
|---|---|---|---|
| ROASBenchROASBench: overall score | 56.6 | 3rd of 32 | Claude Fable 5.2 61.3 |
Agents and tool useMulti-step tasks with tools: support desks, coding agents, function calls
| Benchmark | GPT-6 Astra | Rank among available | Best available |
|---|---|---|---|
| Artificial AnalysisArtificial Analysis: Terminal-Bench 4.0 · reported | 59.6% | 3rd of 107 | Kimi K3.1 Pro 67.2% |
| Artificial AnalysisArtificial Analysis: Terminal-Bench 2.1 · reported | 89.9% | 2nd of 107 | Claude Fable 5.1 91.4% |
| Artificial AnalysisArtificial Analysis: τ-bench banking · reported | 43.1% | 13th of 104 | Grok 4.6 50.7% |
| Vending-Bench 2Vending-Bench 2: money after a year · reported | $15,515 | 1st of 53 | This model |
- tau2-bench: pending. Its latest results are dated 26 May 2026, before this model was released.
- Berkeley Function Calling Leaderboard (BFCL) V4: pending. Its latest results are dated 16 Dec 2025, before this model was released.
- OpenHands Index: pending. Its latest results are dated 30 Jun 2026, before this model was released.
- Microsoft STATE-Bench: pending. Its latest results are dated 29 May 2026, before this model was released.
Professional workReal tasks from banking, consulting and law, business documents and freelance projects
| Benchmark | GPT-6 Astra | Rank among available | Best available |
|---|---|---|---|
| APEX-AgentsAPEX-Agents: tasks passed · reported | 64.7% | 7th of 37 | Claude Sonnet 5.5 75.5% |
| Remote Labor IndexRemote Labor Index: projects done to client standard · reported | 20.8% | 1st of 12 | This model |
- GDP.pdf: has not measured this model.
Reasoning and knowledgeHard questions across science, maths and general knowledge
| Benchmark | GPT-6 Astra | Rank among available | Best available |
|---|---|---|---|
| Artificial AnalysisArtificial Analysis: Artificial Analysis Intelligence Index · reported | 52.7 | 4th of 185 | Claude Opus 5.5 57.6 |
| Artificial AnalysisArtificial Analysis: Humanity's Last Exam · reported | 54.7% | 7th of 186 | Claude Opus 5.5 61.4% |
| Artificial AnalysisArtificial Analysis: GPQA Diamond · reported | 96.3% | 1st of 168 | This model |
WritingWhat people prefer in blind comparisons, and judged writing quality
| Benchmark | GPT-6 Astra | Rank among available | Best available |
|---|---|---|---|
| Arena (formerly LMArena)Arena Text: overall · reported | 1,477 | 24th of 153 | Gemini 4 Argon 1,525 |
| UGI LeaderboardUGI: writing score · reported | 68.9 | 12th of 124 | Gemini 3.8 Flash 78.6 |
Sticking to the factsSummarising without inventing things, and factual answers
| Benchmark | GPT-6 Astra | Rank among available | Best available |
|---|---|---|---|
| Vectara Hallucination LeaderboardVectara: hallucination rate · reported | 8.7% | 32nd of 71 | GPT-5.4 nano 3.1% |
| Arena (formerly LMArena)Arena Text factuality: overall · reported | 1,466 | 27th of 109 | Gemini 4 Argon 1,511 |
| SimpleQA Verified (Epoch AI)SimpleQA Verified: correct answers · reported | 75.6% | 1st of 68 | This model |
Speed under pressureGood decisions against a real clock (fast chess)
| Benchmark | GPT-6 Astra | Rank among available | Best available |
|---|---|---|---|
| BulletBenchBulletBench Bullet 60s: ladder Elo | 323 | 20th of 33 | Gemini 3.8 Flash 1,068 |
Nearest alternatives
- Cheaper at similar intelligenceClaude Sonnet 5.5$4.00 blended · Intelligence Index 56.0Compare with GPT-6 Astra →
- The most capable open-weights modelMiMo-V2.6-Pro$0.54 blended · Intelligence Index 46.3Compare with GPT-6 Astra →
Against GPT-6 Astra at $20.00 blended, Intelligence Index 52.7. "Similar intelligence" means within 4 points or better.
Where to run it
6 hosts on OpenRouter at the standard service tier, with a median of $21.00 blended per million tokens. Cheapest first.
| Host | Quantisation | Input | Output | Blended |
|---|---|---|---|---|
| Amazon Bedrock | not stated | $10.00 | $50.00 | $20.00 |
| Azure | not stated | $10.00 | $50.00 | $20.00 |
| OpenAI | not stated | $10.00 | $50.00 | $20.00 |
| Amazon Bedrock | not stated | $11.00 | $55.00 | $22.00 |
| Azure | not stated | $11.00 | $55.00 | $22.00 |
| OpenAI | not stated | $60.00 | $300.00 | $120.00 |
Other service tiers, not counted above: OpenAI fast $20.00 in, $100.00 out; OpenAI flex $5.00 in, $25.00 out. Flex and batch are cheaper but slower or queued; priority and fast cost more.
Prices per million tokens from OpenRouter's public endpoint list, checked 10 Nov 2026.
Against the alternatives
The models you would most likely weigh it against: the leaders of the groups above.
Scroll sideways to see every alternative.
| GPT-6 Astra | Claude Fable 5.1 most intelligent at $10 or more per million tokens | Claude Sonnet 5.5 cheapest with similar intelligence | Muse Wonder fastest with similar intelligence | Claude Opus 5.5 most intelligent available today | |
|---|---|---|---|---|---|
| Price per million tokens | $20.00 | $20.00 | $4.00 | $8.00 | $8.00 |
| Tokens a second | 72 | 72 | 137 | 153 | 96 |
| Intelligence Index | 52.7 | 53.4 | 56.0 | 52.4 | 57.6 |
| Spring Prompt overall | 77 | 64 | 61 | 70 | 82 |
| Rank among available models, by use case | |||||
| Product listings | 1st of 32 | 24th | 18th | 5th | 13th |
| Decks from an analysis | 2nd of 32 | 11th | 6th | 13th | 7th |
| User surveys | – | – | – | 2nd | 4th |
| Marketing planning | 3rd of 32 | 10th | 7th | 22nd | 9th |
| Agents and tool use | 4th of 159 | 19th | 2nd | 11th | 3rd |
| Professional work | 5th of 51 | 4th | 1st | – | 3rd |
| Reasoning and knowledge | 3rd of 187 | 5th | 2nd | 8th | 1st |
| Writing | 20th of 169 | 19th | 33rd | – | 5th |
| Sticking to the facts | 26th of 139 | 5th | 42nd | – | 3rd |
| Speed under pressure | 20th of 35 | – | 32nd | 14th | – |
| Side by side → | Side by side → | Side by side → | Side by side → | ||
Shaded figures are better than GPT-6 Astra's. A dash means no result.
Research and examples
Where it has been measured
2nd most intelligent of the 11 models priced $10 or more per million tokens, and 3rd most intelligent of the 21 models writing 50–100 tokens a second. Among models available today, in the top quarter (by percentile) for 8 of the 9 use cases measured, led by product listings, and reasoning and knowledge.
- BulletBench15 results
- CatalogBench31 results
- DeckBench17 results
- ROASBench9 results
- APEX-Agents1 result
- Arena (formerly LMArena)12 results
- Artificial Analysis55 results
- Remote Labor Index1 result
- SimpleQA Verified (Epoch AI)1 result
- UGI Leaderboard12 results
- Vectara Hallucination Leaderboard2 results
- Vending-Bench 21 result
- Berkeley Function Calling Leaderboard (BFCL) V4Pending: latest results 16 Dec 2025
- Microsoft STATE-BenchPending: latest results 1 Jul 2026
- OpenHands IndexPending: latest results 30 Jun 2026
- tau2-benchPending: latest results 3 Aug 2026
- SurveyBenchNot measured
- GDP.pdfNot measured
Every result
157 published results from 12 sources, each in the source's own units, with the configuration that produced it.
BulletBench · measured by Spring Prompt · 15 results
| Measure | Value | Rank | Configuration | Dated |
|---|---|---|---|---|
| BulletBench Blitz 3+2: cost per gameUS dollars, lower is better | $0.28 | 19 of 22 | GPT-6 Astra provider default reasoning |
29 Sep 2026 |
| BulletBench Blitz 3+2: games lost on time% of games, lower is better | 37.5% | 9 of 22 | GPT-6 Astra provider default reasoning |
29 Sep 2026 |
| BulletBench Blitz 3+2: invalid moves% of moves, lower is better | 0.0% | 1 of 22 | GPT-6 Astra provider default reasoning |
29 Sep 2026 |
| BulletBench Blitz 3+2: ladder Eloladder Elo, higher is better | 839 595–1,072 |
7 of 22 | GPT-6 Astra provider default reasoning |
29 Sep 2026 |
| BulletBench Blitz 3+2: median move timemilliseconds, lower is better | 5.6 s | 13 of 22 | GPT-6 Astra provider default reasoning |
29 Sep 2026 |
| BulletBench Bullet 60s: cost per gameUS dollars, lower is better | $0.0943 | 67 of 71 | GPT-6 Astra provider default reasoning |
1 Oct 2026 |
| BulletBench Bullet 60s: cost per gameUS dollars, lower is better | $0.10 | 69 of 71 | GPT-6 Astra (low reasoning) low reasoning |
1 Oct 2026 |
| BulletBench Bullet 60s: games lost on time% of games, lower is better | 83.3% | 60 of 71 | GPT-6 Astra provider default reasoning |
1 Oct 2026 |
| BulletBench Bullet 60s: games lost on time% of games, lower is better | 75.0% | 54 of 71 | GPT-6 Astra (low reasoning) low reasoning |
1 Oct 2026 |
| BulletBench Bullet 60s: invalid moves% of moves, lower is better | 0.0% | 1 of 71 | GPT-6 Astra provider default reasoning |
1 Oct 2026 |
| BulletBench Bullet 60s: invalid moves% of moves, lower is better | 0.0% | 1 of 71 | GPT-6 Astra (low reasoning) low reasoning |
1 Oct 2026 |
| BulletBench Bullet 60s: ladder Eloladder Elo, higher is better | 197 0–439 |
56 of 71 | GPT-6 Astra provider default reasoning |
1 Oct 2026 |
| BulletBench Bullet 60s: ladder Eloladder Elo, higher is better | 323 0–528 |
51 of 71 | GPT-6 Astra (low reasoning) low reasoning |
1 Oct 2026 |
| BulletBench Bullet 60s: median move timemilliseconds, lower is better | 3.0 s | 60 of 71 | GPT-6 Astra provider default reasoning |
1 Oct 2026 |
| BulletBench Bullet 60s: median move timemilliseconds, lower is better | 2.3 s | 51 of 71 | GPT-6 Astra (low reasoning) low reasoning |
1 Oct 2026 |
Not shown: Not your cost: prices are those charged on the run date.
CatalogBench · measured by Spring Prompt · 31 results
| Measure | Value | Rank | Configuration | Dated |
|---|---|---|---|---|
| CatalogBench (sales brief): channel rules broken% of products, lower is better | 0.0% | 1 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench (sales brief): claims to check% of products, lower is better | 0.0% | 1 of 32 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench (sales brief): content quality% of checks, higher is better | 98.9% | 1 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench (sales brief): failed outputs% of products, lower is better | 0.0% | 1 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench (sales brief): missing UK information% of products, lower is better | 0.0% | 1 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench (sales brief): not findable% of products, lower is better | 5.4% | 23 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench (sales brief): publish-ready listings% of products, higher is better | 73.2% | 4 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench (sales brief): reliably publish-ready% of products, higher is better | 69.6% | 1 of 34 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench (sales brief): unsupported claims% of products, lower is better | 2.4% | 3 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench (sales brief): unsupported claimsclaims per product, lower is better | 0.05 | 1 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench (sales brief): wrong attributes% of products, lower is better | 20.2% | 23 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench (sales brief): wrong category or variant% of products, lower is better | 1.8% | 6 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench: channel compliance% of products, higher is better | 100.0% | 1 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench: channel rules broken% of products, lower is better | 0.0% | 1 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench: claims to check% of products, lower is better | 0.0% | 1 of 32 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench: conflicts caught% of conflicts, higher is better | 100.0% | 1 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench: content quality% of checks, higher is better | 98.5% | 4 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench: cost per productUS dollars, lower is better | $0.0371 | 30 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench: decision accuracy% of decisions, higher is better | 98.5% | 4 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench: failed outputs% of products, lower is better | 0.0% | 1 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench: field accuracy% of missing fields, higher is better | 94.2% | 13 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench: invented values% of filled values, lower is better | 1.9% | 22 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench: missing UK information% of products, lower is better | 0.0% | 1 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench: not findable% of products, lower is better | 6.0% | 24 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench: publish-ready listings% of products, higher is better | 77.4% | 4 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench: reliably publish-ready% of products, higher is better | 75.0% | 1 of 34 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench: time per productseconds, lower is better | 12.3 | 15 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench: unsupported claims% of products, lower is better | 1.2% | 4 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench: unsupported claimsclaims per product, lower is better | 0.02 | 3 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench: wrong attributes% of products, lower is better | 17.3% | 19 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
| CatalogBench: wrong category or variant% of products, lower is better | 1.8% | 6 of 35 | GPT-6 Astra provider default reasoning |
30 Sep 2026 |
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
DeckBench · measured by Spring Prompt · 17 results
| Measure | Value | Rank | Configuration | Dated |
|---|---|---|---|---|
| DeckBench: accurate decks% of tasks, higher is better | 100.0% | 1 of 34 | GPT-6 Astra provider default reasoning |
6 Oct 2026 |
| DeckBench: caveat dropped% of tasks, lower is better | 0.0% | 1 of 34 | GPT-6 Astra provider default reasoning |
6 Oct 2026 |
| DeckBench: clean layout% of tasks, higher is better | 100.0% | 1 of 34 | GPT-6 Astra provider default reasoning |
6 Oct 2026 |
| DeckBench: cost per deckUS dollars, lower is better | $1.09 | 33 of 34 | GPT-6 Astra provider default reasoning |
6 Oct 2026 |
| DeckBench: deck ratingrating, higher is better | 1,566 1,452–1,742 |
2 of 34 | GPT-6 Astra provider default reasoning |
6 Oct 2026 |
| DeckBench: design quality% of the maximum, higher is better | 88.5% | 1 of 34 | GPT-6 Astra provider default reasoning |
6 Oct 2026 |
| DeckBench: draft figure quoted% of tasks, lower is better | 0.0% | 1 of 34 | GPT-6 Astra provider default reasoning |
6 Oct 2026 |
| DeckBench: findings missing% of tasks, lower is better | 0.0% | 1 of 34 | GPT-6 Astra provider default reasoning |
6 Oct 2026 |
| DeckBench: head-to-head win rate% of comparisons, higher is better | 89.7% | 1 of 34 | GPT-6 Astra provider default reasoning |
6 Oct 2026 |
| DeckBench: layout defects% of tasks, lower is better | 0.0% | 1 of 34 | GPT-6 Astra provider default reasoning |
6 Oct 2026 |
| DeckBench: misleading metric used% of tasks, lower is better | 0.0% | 1 of 34 | GPT-6 Astra provider default reasoning |
6 Oct 2026 |
| DeckBench: presentable decks% of tasks, higher is better | 66.7% | 2 of 34 | GPT-6 Astra provider default reasoning |
6 Oct 2026 |
| DeckBench: recommendation late or wrong% of tasks, lower is better | 0.0% | 1 of 34 | GPT-6 Astra provider default reasoning |
6 Oct 2026 |
| DeckBench: slides needing work% of tasks, lower is better | 33.3% | 10 of 34 | GPT-6 Astra provider default reasoning |
6 Oct 2026 |
| DeckBench: time per deckseconds, lower is better | 311 | 27 of 34 | GPT-6 Astra provider default reasoning |
6 Oct 2026 |
| DeckBench: unsupported claims% of tasks, lower is better | 0.0% | 1 of 34 | GPT-6 Astra provider default reasoning |
6 Oct 2026 |
| DeckBench: unsupported numbers% of tasks, lower is better | 0.0% | 1 of 34 | GPT-6 Astra provider default reasoning |
6 Oct 2026 |
Not shown: Not your analysis or your brand: invented companies, six public tasks, one deck per model per task at the provider's default reasoning setting.
ROASBench · measured by Spring Prompt · 9 results
| Measure | Value | Rank | Configuration | Dated |
|---|---|---|---|---|
| ROASBench: audience scorescore out of 100, higher is better | 68.6 | 3 of 35 | GPT-6 Astra provider default reasoning |
29 Sep 2026 |
| ROASBench: business scorescore out of 100, higher is better | 57.5 | 4 of 35 | GPT-6 Astra provider default reasoning |
29 Sep 2026 |
| ROASBench: consistency scorescore out of 100, higher is better | 44.7 | 2 of 35 | GPT-6 Astra provider default reasoning |
29 Sep 2026 |
| ROASBench: contribution profitsimulated US dollars, higher is better | $599,139 | 18 of 35 | GPT-6 Astra provider default reasoning |
29 Sep 2026 |
| ROASBench: cost of a runUS dollars, lower is better | $1.23 | 32 of 35 | GPT-6 Astra provider default reasoning |
29 Sep 2026 |
| ROASBench: months over budgetmonths of 12, lower is better | 0 | 1 of 35 | GPT-6 Astra provider default reasoning |
29 Sep 2026 |
| ROASBench: overall scorescore out of 100, higher is better | 56.6 | 3 of 35 | GPT-6 Astra provider default reasoning |
29 Sep 2026 |
| ROASBench: planning scorescore out of 100, higher is better | 54.9 | 11 of 35 | GPT-6 Astra provider default reasoning |
29 Sep 2026 |
| ROASBench: return on ad spendprofit per $1 spent, higher is better | $0.67 | 8 of 35 | GPT-6 Astra provider default reasoning |
29 Sep 2026 |
Not shown: Not real ad performance: the market is a deterministic simulation of one invented skincare brand.
APEX-Agents · reported by APEX-Agents · 1 result
| Measure | Value | Rank | Configuration | Dated |
|---|---|---|---|---|
| APEX-Agents: tasks passed% of tasks, higher is better | 64.7% | 7 of 39 | GPT-6 Astra | 1 Oct 2026 |
Not shown: Not your firm's documents or tools; graded by rubric, not by a client.
Arena (formerly LMArena) · reported by Arena (formerly LMArena) · 12 results
| Measure | Value | Rank | Configuration | Dated |
|---|---|---|---|---|
| Arena Agent: confirmed task successIPS effect estimate, higher is better | 0.13 0.10–0.17 |
6 of 50 | GPT-6 Astra (max reasoning, arena agent) | 2 Oct 2026 |
| Arena Agent: praise over complaintIPS effect estimate, higher is better | 0.35 0.25–0.44 |
1 of 50 | GPT-6 Astra (max reasoning, arena agent) | 2 Oct 2026 |
| Arena Agent: steerabilityIPS effect estimate, higher is better | 0.08 0.05–0.10 |
7 of 50 | GPT-6 Astra (max reasoning, arena agent) | 2 Oct 2026 |
| Arena Agent: tool groundingIPS effect estimate, higher is better | 0.00 0.00–0.01 |
14 of 50 | GPT-6 Astra (max reasoning, arena agent) | 2 Oct 2026 |
| Arena Document: overallArena rating, higher is better | 1,473 1,458–1,487 |
17 of 44 | GPT-6 Astra (max reasoning) | 13 Sep 2026 |
| Arena Text factuality: overallArena rating, higher is better | 1,466 1,460–1,472 |
37 of 182 | GPT-6 Astra (max reasoning) | 2 Oct 2026 |
| Arena Text: business, management and financeArena rating, higher is better | 1,473 1,458–1,488 |
35 of 406 | GPT-6 Astra (max reasoning) | 2 Oct 2026 |
| Arena Text: creative writingArena rating, higher is better | 1,449 1,435–1,463 |
39 of 411 | GPT-6 Astra (max reasoning) | 2 Oct 2026 |
| Arena Text: expert promptsArena rating, higher is better | 1,517 1,497–1,537 |
20 of 363 | GPT-6 Astra (max reasoning) | 2 Oct 2026 |
| Arena Text: instruction followingArena rating, higher is better | 1,474 1,463–1,485 |
30 of 413 | GPT-6 Astra (max reasoning) | 2 Oct 2026 |
| Arena Text: overallArena rating, higher is better | 1,477 1,470–1,484 |
29 of 413 | GPT-6 Astra (max reasoning) | 2 Oct 2026 |
| Arena Text: writing, literature and languageArena rating, higher is better | 1,465 1,453–1,478 |
31 of 412 | GPT-6 Astra (max reasoning) | 2 Oct 2026 |
Not shown: Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
Artificial Analysis · reported by Artificial Analysis · 55 results
| Measure | Value | Rank | Configuration | Dated |
|---|---|---|---|---|
| Artificial Analysis: Artificial Analysis Coding Indexindex score, higher is better | 77.1 | 8 of 187 | GPT-6 Astra (high reasoning) | 20 Oct 2026 |
| Artificial Analysis: Artificial Analysis Coding Indexindex score, higher is better | 75.7 | 26 of 187 | GPT-6 Astra (low reasoning) | 20 Oct 2026 |
| Artificial Analysis: Artificial Analysis Coding Indexindex score, higher is better | 76.9 | 11 of 187 | GPT-6 Astra (max reasoning) | 20 Oct 2026 |
| Artificial Analysis: Artificial Analysis Coding Indexindex score, higher is better | 76.7 | 13 of 187 | GPT-6 Astra (medium reasoning) | 20 Oct 2026 |
| Artificial Analysis: Artificial Analysis Coding Indexindex score, higher is better | 75.9 | 23 of 187 | GPT-6 Astra (xhigh reasoning) | 20 Oct 2026 |
| Artificial Analysis: Artificial Analysis Intelligence Indexindex score, higher is better | 50.9 | 16 of 413 | GPT-6 Astra (high reasoning) | 20 Oct 2026 |
| Artificial Analysis: Artificial Analysis Intelligence Indexindex score, higher is better | 45.8 | 33 of 413 | GPT-6 Astra (low reasoning) | 20 Oct 2026 |
| Artificial Analysis: Artificial Analysis Intelligence Indexindex score, higher is better | 52.7 | 7 of 413 | GPT-6 Astra (max reasoning) | 20 Oct 2026 |
| Artificial Analysis: Artificial Analysis Intelligence Indexindex score, higher is better | 49.6 | 20 of 413 | GPT-6 Astra (medium reasoning) | 20 Oct 2026 |
| Artificial Analysis: Artificial Analysis Intelligence Indexindex score, higher is better | 52.4 | 9 of 413 | GPT-6 Astra (xhigh reasoning) | 20 Oct 2026 |
| Artificial Analysis: GPQA Diamond% of questions, higher is better | 94.9% | 4 of 360 | GPT-6 Astra (high reasoning) | 20 Oct 2026 |
| Artificial Analysis: GPQA Diamond% of questions, higher is better | 93.1% | 24 of 360 | GPT-6 Astra (low reasoning) | 20 Oct 2026 |
| Artificial Analysis: GPQA Diamond% of questions, higher is better | 96.1% | 2 of 360 | GPT-6 Astra (max reasoning) | 20 Oct 2026 |
| Artificial Analysis: GPQA Diamond% of questions, higher is better | 93.9% | 10 of 360 | GPT-6 Astra (medium reasoning) | 20 Oct 2026 |
| Artificial Analysis: GPQA Diamond% of questions, higher is better | 96.3% | 1 of 360 | GPT-6 Astra (xhigh reasoning) | 20 Oct 2026 |
| Artificial Analysis: Humanity's Last Exam% of questions, higher is better | 53.1% | 16 of 419 | GPT-6 Astra (high reasoning) | 20 Oct 2026 |
| Artificial Analysis: Humanity's Last Exam% of questions, higher is better | 49.2% | 29 of 419 | GPT-6 Astra (low reasoning) | 20 Oct 2026 |
| Artificial Analysis: Humanity's Last Exam% of questions, higher is better | 54.7% | 11 of 419 | GPT-6 Astra (max reasoning) | 20 Oct 2026 |
| Artificial Analysis: Humanity's Last Exam% of questions, higher is better | 52.7% | 19 of 419 | GPT-6 Astra (medium reasoning) | 20 Oct 2026 |
| Artificial Analysis: Humanity's Last Exam% of questions, higher is better | 54.6% | 13 of 419 | GPT-6 Astra (xhigh reasoning) | 20 Oct 2026 |
| Artificial Analysis: Long-context reasoning (AA-LCR)% of questions, higher is better | 80.0% | 77 of 407 | GPT-6 Astra (high reasoning) | 20 Oct 2026 |
| Artificial Analysis: Long-context reasoning (AA-LCR)% of questions, higher is better | 80.0% | 77 of 407 | GPT-6 Astra (low reasoning) | 20 Oct 2026 |
| Artificial Analysis: Long-context reasoning (AA-LCR)% of questions, higher is better | 80.7% | 64 of 407 | GPT-6 Astra (max reasoning) | 20 Oct 2026 |
| Artificial Analysis: Long-context reasoning (AA-LCR)% of questions, higher is better | 79.7% | 86 of 407 | GPT-6 Astra (medium reasoning) | 20 Oct 2026 |
| Artificial Analysis: Long-context reasoning (AA-LCR)% of questions, higher is better | 80.0% | 77 of 407 | GPT-6 Astra (xhigh reasoning) | 20 Oct 2026 |
| Artificial Analysis: Output speedtokens per second, higher is better | 58.8 | 103 of 137 | GPT-6 Astra (high reasoning) | 20 Oct 2026 |
| Artificial Analysis: Output speedtokens per second, higher is better | 56.2 | 104 of 137 | GPT-6 Astra (low reasoning) | 20 Oct 2026 |
| Artificial Analysis: Output speedtokens per second, higher is better | 71.7 | 95 of 137 | GPT-6 Astra (max reasoning) | 20 Oct 2026 |
| Artificial Analysis: Output speedtokens per second, higher is better | 54.8 | 108 of 137 | GPT-6 Astra (medium reasoning) | 20 Oct 2026 |
| Artificial Analysis: Output speedtokens per second, higher is better | 67.5 | 97 of 137 | GPT-6 Astra (xhigh reasoning) | 20 Oct 2026 |
| Artificial Analysis: SciCode% of problems, higher is better | 55.4% | 49 of 205 | GPT-6 Astra (high reasoning) | 20 Oct 2026 |
| Artificial Analysis: SciCode% of problems, higher is better | 54.1% | 68 of 205 | GPT-6 Astra (low reasoning) | 20 Oct 2026 |
| Artificial Analysis: SciCode% of problems, higher is better | 56.5% | 35 of 205 | GPT-6 Astra (max reasoning) | 20 Oct 2026 |
| Artificial Analysis: SciCode% of problems, higher is better | 54.2% | 65 of 205 | GPT-6 Astra (medium reasoning) | 20 Oct 2026 |
| Artificial Analysis: SciCode% of problems, higher is better | 55.7% | 45 of 205 | GPT-6 Astra (xhigh reasoning) | 20 Oct 2026 |
| Artificial Analysis: Terminal-Bench 2.1% of tasks, higher is better | 89.9% | 3 of 188 | GPT-6 Astra (high reasoning) | 20 Oct 2026 |
| Artificial Analysis: Terminal-Bench 2.1% of tasks, higher is better | 88.0% | 12 of 188 | GPT-6 Astra (low reasoning) | 20 Oct 2026 |
| Artificial Analysis: Terminal-Bench 2.1% of tasks, higher is better | 88.4% | 10 of 188 | GPT-6 Astra (max reasoning) | 20 Oct 2026 |
| Artificial Analysis: Terminal-Bench 2.1% of tasks, higher is better | 89.5% | 5 of 188 | GPT-6 Astra (medium reasoning) | 20 Oct 2026 |
| Artificial Analysis: Terminal-Bench 2.1% of tasks, higher is better | 89.1% | 7 of 188 | GPT-6 Astra (xhigh reasoning) | 20 Oct 2026 |
| Artificial Analysis: Terminal-Bench 4.0% of tasks, higher is better | 54.0% | 13 of 204 | GPT-6 Astra (high reasoning) | 20 Oct 2026 |
| Artificial Analysis: Terminal-Bench 4.0% of tasks, higher is better | 41.9% | 30 of 204 | GPT-6 Astra (low reasoning) | 20 Oct 2026 |
| Artificial Analysis: Terminal-Bench 4.0% of tasks, higher is better | 59.1% | 6 of 204 | GPT-6 Astra (max reasoning) | 20 Oct 2026 |
| Artificial Analysis: Terminal-Bench 4.0% of tasks, higher is better | 49.5% | 20 of 204 | GPT-6 Astra (medium reasoning) | 20 Oct 2026 |
| Artificial Analysis: Terminal-Bench 4.0% of tasks, higher is better | 59.6% | 3 of 204 | GPT-6 Astra (xhigh reasoning) | 20 Oct 2026 |
| Artificial Analysis: Time to first answer tokenseconds, lower is better | 50.6 | 117 of 137 | GPT-6 Astra (high reasoning) | 20 Oct 2026 |
| Artificial Analysis: Time to first answer tokenseconds, lower is better | 1.41 | 34 of 137 | GPT-6 Astra (low reasoning) | 20 Oct 2026 |
| Artificial Analysis: Time to first answer tokenseconds, lower is better | 220 | 133 of 137 | GPT-6 Astra (max reasoning) | 20 Oct 2026 |
| Artificial Analysis: Time to first answer tokenseconds, lower is better | 5.71 | 44 of 137 | GPT-6 Astra (medium reasoning) | 20 Oct 2026 |
| Artificial Analysis: Time to first answer tokenseconds, lower is better | 118 | 129 of 137 | GPT-6 Astra (xhigh reasoning) | 20 Oct 2026 |
| Artificial Analysis: τ-bench banking% of tasks, higher is better | 40.0% | 31 of 175 | GPT-6 Astra (high reasoning) | 20 Oct 2026 |
| Artificial Analysis: τ-bench banking% of tasks, higher is better | 32.0% | 56 of 175 | GPT-6 Astra (low reasoning) | 20 Oct 2026 |
| Artificial Analysis: τ-bench banking% of tasks, higher is better | 41.4% | 27 of 175 | GPT-6 Astra (max reasoning) | 20 Oct 2026 |
| Artificial Analysis: τ-bench banking% of tasks, higher is better | 35.5% | 45 of 175 | GPT-6 Astra (medium reasoning) | 20 Oct 2026 |
| Artificial Analysis: τ-bench banking% of tasks, higher is better | 43.1% | 22 of 175 | GPT-6 Astra (xhigh reasoning) | 20 Oct 2026 |
Not shown: Not your codebase or tools.
Remote Labor Index · reported by Remote Labor Index · 1 result
| Measure | Value | Rank | Configuration | Dated |
|---|---|---|---|---|
| Remote Labor Index: projects done to client standard% of projects, higher is better | 20.8% | 1 of 14 | GPT-6 Astra | 1 Oct 2026 |
Not shown: Not speed or cost; a small set of projects, so a few points either way are noise.
SimpleQA Verified (Epoch AI) · reported by SimpleQA Verified (Epoch AI) · 1 result
| Measure | Value | Rank | Configuration | Dated |
|---|---|---|---|---|
| SimpleQA Verified: correct answers% of questions, higher is better | 75.6% | 1 of 85 | GPT-6 Astra (max reasoning) | 30 Aug 2026 |
Not shown: Not answers grounded in your documents; tests what the model remembers.
UGI Leaderboard · reported by UGI Leaderboard · 12 results
| Measure | Value | Rank | Configuration | Dated |
|---|---|---|---|---|
| UGI: requested-length error% off the requested word count, lower is better | 0.0% | 1 of 379 | GPT-6 Astra (high reasoning) | 5 Sep 2026 |
| UGI: requested-length error% off the requested word count, lower is better | 1.0% | 5 of 379 | GPT-6 Astra (low reasoning) | 5 Sep 2026 |
| UGI: requested-length error% off the requested word count, lower is better | 1.0% | 5 of 379 | GPT-6 Astra (medium reasoning) | 5 Sep 2026 |
| UGI: requested-length error% off the requested word count, lower is better | 0.0% | 1 of 379 | GPT-6 Astra (xhigh reasoning) | 5 Sep 2026 |
| UGI: style adherencescore from 0 to 1, higher is better | 0.36 | 133 of 379 | GPT-6 Astra (high reasoning) | 5 Sep 2026 |
| UGI: style adherencescore from 0 to 1, higher is better | 0.37 | 112 of 379 | GPT-6 Astra (low reasoning) | 5 Sep 2026 |
| UGI: style adherencescore from 0 to 1, higher is better | 0.38 | 75 of 379 | GPT-6 Astra (medium reasoning) | 5 Sep 2026 |
| UGI: style adherencescore from 0 to 1, higher is better | 0.38 | 75 of 379 | GPT-6 Astra (xhigh reasoning) | 5 Sep 2026 |
| UGI: writing scorescore out of 100, higher is better | 68.9 | 32 of 379 | GPT-6 Astra (high reasoning) | 5 Sep 2026 |
| UGI: writing scorescore out of 100, higher is better | 65.1 | 65 of 379 | GPT-6 Astra (low reasoning) | 5 Sep 2026 |
| UGI: writing scorescore out of 100, higher is better | 68.1 | 39 of 379 | GPT-6 Astra (medium reasoning) | 5 Sep 2026 |
| UGI: writing scorescore out of 100, higher is better | 68.0 | 40 of 379 | GPT-6 Astra (xhigh reasoning) | 5 Sep 2026 |
Not shown: Not other format limits such as character counts or bullet counts.
Vectara Hallucination Leaderboard · reported by Vectara Hallucination Leaderboard · 2 results
| Measure | Value | Rank | Configuration | Dated |
|---|---|---|---|---|
| Vectara: answer rate% of documents, higher is better | 100.0% | 1 of 108 | GPT-6 Astra | 22 Sep 2026 |
| Vectara: hallucination rate% of summaries, lower is better | 8.7% | 45 of 108 | GPT-6 Astra | 22 Sep 2026 |
Not shown: Not a quality score: a low rate usually means content filters were triggered, and hallucination rates are measured on answered documents only.
Vending-Bench 2 · reported by Vending-Bench 2 · 1 result
| Measure | Value | Rank | Configuration | Dated |
|---|---|---|---|---|
| Vending-Bench 2: money after a yearUS dollars, higher is better | $15,515 | 1 of 63 | GPT-6 Astra | 1 Oct 2026 |
Not shown: Not a real business; one simulated market with set rules.
Embed a score badge
A badge for its Spring Prompt Score and each of our benchmarks that ranked GPT-6 Astra, from the current results. Paste the code into a page or README; it links back to where the result comes from.
Spring Prompt Score · 4 of 5 benchmarks
<a href="https://springprompt.com/score#openai-gpt-6-astra"><img src="https://springprompt.com/badge/score/openai-gpt-6-astra.svg" alt="GPT-6 Astra is #4 of 32 on the Spring Prompt Score (83 of 100, from 4 of 5 of our benchmarks), measured by Spring Prompt" height="20"></a>
CatalogBench · Reliably publish-ready, factual brief
<a href="https://springprompt.com/benchmarks/catalogbench?focus=openai-gpt-6-astra"><img src="https://springprompt.com/badge/catalogbench/openai-gpt-6-astra.svg" alt="GPT-6 Astra is #1 of 32 on CatalogBench (Reliably publish-ready, factual brief: 75.0%), measured by Spring Prompt" height="20"></a>
DeckBench · Deck rating
<a href="https://springprompt.com/benchmarks/deckbench?focus=openai-gpt-6-astra"><img src="https://springprompt.com/badge/deckbench/openai-gpt-6-astra.svg" alt="GPT-6 Astra is #2 of 33 on DeckBench (Deck rating: 1,566), measured by Spring Prompt" height="20"></a>
ROASBench · Score
<a href="https://springprompt.com/benchmarks/roasbench?focus=openai-gpt-6-astra"><img src="https://springprompt.com/badge/roasbench/openai-gpt-6-astra.svg" alt="GPT-6 Astra is #3 of 33 on ROASBench (Score: 56.6), measured by Spring Prompt" height="20"></a>
BulletBench · Ladder Elo
<a href="https://springprompt.com/benchmarks/bulletbench?focus=openai-gpt-6-astra"><img src="https://springprompt.com/badge/bulletbench/openai-gpt-6-astra.svg" alt="GPT-6 Astra is #46 of 59 on BulletBench (Ladder Elo: 323), measured by Spring Prompt" height="20"></a>
Will GPT-6 Astra work for your product?
Benchmarks aren't your task. Paste the prompt your product uses and run it beside the models you could use instead, with every answer checked and costed.
New here? Your email starts a free trial. No credit card needed.