Compare / Claude Haiku 5.5 vs GPT-6 Astra
Claude Haiku 5.5 vs GPT-6 Astra
Which is cheaper, which is more capable, and which does better at each kind of work, from 72 results on 5 sources that measured both models.
Results as of 8 October 2026 (catalogue release 2026-10-08-4199ce0620fe).
Claude Haiku 5.5 or GPT-6 Astra? The short answer
Pick GPT-6 Astra if quality matters most: it scores higher (Spring Prompt overall 79 against 44). Pick Claude Haiku 5.5 if cost matters more: it costs 31 times less per product listing on CatalogBench. Claude Haiku 5.5 is also faster.
- Spring Prompt overall: Claude Haiku 5.5 44, GPT-6 Astra 79 (out of 100; how the score works).
- Claude Haiku 5.5 is cheaper to run: $0.001 against $0.037 per product listing on CatalogBench (31 times less).
- GPT-6 Astra scores higher on the Artificial Analysis Intelligence Index: 52.7 against 43.4.
- Claude Haiku 5.5 writes faster: 235 tokens a second against 52.
- Claude Haiku 5.5 is newer: released 7 Oct 2026, against 3 Sep 2026 for GPT-6 Astra.
- On our own benchmarks, on the results both models have: GPT-6 Astra does better for product listings, decks from an analysis and marketing planning.
- On third-party benchmarks, on the results both models have: GPT-6 Astra does better for agents and tool use and reasoning and knowledge.
At a glance
| Claude Haiku 5.5 | GPT-6 Astra | |
|---|---|---|
| Price per million tokens | $0.10 in · $0.50 out | $10.00 in · $50.00 out |
| Blended (3 in : 1 out) | $0.20 | $20.00 |
| Cheapest host, blended | – | $20.00 (Azure) |
| Cost per product listing (CatalogBench) | $0.001 | $0.037 |
| Cached input, per million | – | $1.00 cached input |
| Intelligence Index | 43.4 | 52.7 |
| Spring Prompt overall | 44 | 79 |
| Output speed, tokens a second | 235 | 52 |
| Context window | 1,000,000 tokens | 1,050,000 tokens |
| Released | 7 Oct 2026 (newer) | 3 Sep 2026 |
| Weights | Closed | Closed |
| Developer based in | the US | the US |
Prices are the developer's list price where we have read it, otherwise the typical host on OpenRouter; see every model's price. Intelligence and speed from Artificial Analysis.
Which is better for what
Each model's rank among models available today, for each kind of work, from our own benchmarks and licensed sources. The better rank is in green.
| Use case | Claude Haiku 5.5 | GPT-6 Astra |
|---|---|---|
| Product listingsTurning a sparse product feed and photos into listings that can go live | 11 of 20 | 1 of 20 |
| Decks from an analysisTurning a finished analysis into a deck you could present as it is | 10 of 19 | 1 of 19 |
| User surveysPlanning a user survey and reading its results without being misled | 3 of 8 | not measured |
| Marketing planningPlanning a year of ad spend without overspending | 17 of 19 | 1 of 19 |
| Agents and tool useMulti-step tasks with tools: support desks, coding agents, function calls | 20 of 164 | 4 of 164 |
| Professional workReal tasks from banking, consulting and law, business documents and freelance projects | not measured | 5 of 51 |
| Reasoning and knowledgeHard questions across science, maths and general knowledge | 19 of 198 | 3 of 198 |
| WritingWhat people prefer in blind comparisons, and judged writing quality | not measured | 19 of 188 |
| Sticking to the factsSummarising without inventing things, and factual answers | not measured | 24 of 152 |
| Speed under pressureGood decisions against a real clock (fast chess) | 15 of 22 | 14 of 22 |
Their slides, side by side
The same brief for both: Manchester store investment review for Hearthside Coffee, an invented company. First slide of each deck from DeckBench.
From our research
Every shared result
Each model's best result on every measure both have, grouped by benchmark, with the setting that produced it. The headline measures of each benchmark come first; the rest are under "Show all". Green marks the better value; where a source reports ranges that overlap, neither is marked.
| Measure | Claude Haiku 5.5 | GPT-6 Astra |
|---|---|---|
| BulletBench measured by Spring Prompt · 3 results | ||
| Cost per game · Blitz 3+2US dollars, lower is better | $0.0164 | $0.28 |
| Cost per game · Bullet 60sUS dollars, lower is better | $0.0019no reasoning | $0.0943 |
| Ladder Elo · Bullet 60sladder Elo, higher is better | 310no reasoning | 323low reasoning |
| CatalogBench measured by Spring Prompt · 3 results | ||
| Cost per productUS dollars, lower is better | $0.0012 | $0.0371 |
| Reliably publish-ready% of products, higher is better | 26.8% | 75.0% |
| Reliably publish-ready · sales brief% of products, higher is better | 10.7% | 69.6% |
| DeckBench measured by Spring Prompt · 3 results | ||
| Cost per deckUS dollars, lower is better | $0.0091 | $1.09 |
| Deck ratingrating, higher is betterThe rating weighs each win by how strong the other deck was; the win rate counts wins against whichever decks a model happened to meet, so the two can disagree. | 1,130 | 1,477 |
| Accurate decks% of tasks, higher is better | 33.3% | 100.0% |
| ROASBench measured by Spring Prompt · 3 results | ||
| Overall scorescore out of 100, higher is better | 24.1 | 56.6 |
| Audience scorescore out of 100, higher is better | 48.4 | 68.6 |
| Business scorescore out of 100, higher is better | 13.5 | 57.5 |
| Artificial Analysis reported by Artificial Analysis · 3 results | ||
| Artificial Analysis Intelligence Indexindex score, higher is better | 43.4max reasoning | 52.7max reasoning |
| Humanity's Last Exam% of questions, higher is better | 44.4%max reasoning | 54.7%max reasoning |
| Terminal-Bench 4.0% of tasks, higher is better | 32.8%max reasoning | 59.6%xhigh reasoning |
Show all 72 results (57 more)
| Measure | Claude Haiku 5.5 | GPT-6 Astra |
|---|---|---|
| BulletBench measured by Spring Prompt · 7 results | ||
| Games lost on time · Blitz 3+2% of games, lower is better | 37.5% | 37.5% |
| Games lost on time · Bullet 60s% of games, lower is better | 37.5%no reasoning | 75.0%low reasoning |
| Invalid moves · Blitz 3+2% of moves, lower is better | 0.0% | 0.0% |
| Invalid moves · Bullet 60s% of moves, lower is better | 0.0%no reasoning | 0.0% |
| Ladder Elo · Blitz 3+2ladder Elo, higher is better | 557 | 839 |
| Median move time · Blitz 3+2milliseconds, lower is better | 6.2 s | 5.6 s |
| Median move time · Bullet 60smilliseconds, lower is better | 1.7 sno reasoning | 2.3 slow reasoning |
| CatalogBench measured by Spring Prompt · 27 results | ||
| Channel compliance% of products, higher is better | 100.0% | 100.0% |
| Channel rules broken% of products, lower is better | 0.6% | 0.0% |
| Channel rules broken · sales brief% of products, lower is better | 0.0% | 0.0% |
| Claims to check% of products, lower is better | 0.6% | 0.0% |
| Claims to check · sales brief% of products, lower is better | 1.2% | 0.0% |
| Conflicts caught% of conflicts, higher is better | 100.0% | 100.0% |
| Content quality% of checks, higher is better | 95.6% | 98.5% |
| Content quality · sales brief% of checks, higher is better | 96.3% | 98.9% |
| Decision accuracy% of decisions, higher is better | 95.6% | 98.5% |
| Failed outputs% of products, lower is better | 0.0% | 0.0% |
| Failed outputs · sales brief% of products, lower is better | 0.0% | 0.0% |
| Field accuracy% of missing fields, higher is better | 91.0% | 94.2% |
| Invented values% of filled values, lower is better | 0.8% | 1.9% |
| Missing UK information% of products, lower is better | 0.0% | 0.0% |
| Missing UK information · sales brief% of products, lower is better | 0.0% | 0.0% |
| Not findable% of products, lower is better | 11.9% | 6.0% |
| Not findable · sales brief% of products, lower is better | 10.7% | 5.4% |
| Publish-ready listings% of products, higher is better | 47.0% | 77.4% |
| Publish-ready listings · sales brief% of products, higher is better | 20.2% | 73.2% |
| Unsupported claims% of products, lower is better | 32.1% | 1.2% |
| Unsupported claimsclaims per product, lower is better | 1.20 | 0.02 |
| Unsupported claims · sales brief% of products, lower is better | 70.2% | 2.4% |
| Unsupported claims · sales briefclaims per product, lower is better | 2.46 | 0.05 |
| Wrong attributes% of products, lower is better | 19.6% | 17.3% |
| Wrong attributes · sales brief% of products, lower is better | 18.5% | 20.2% |
| Wrong category or variant% of products, lower is better | 0.0% | 1.8% |
| Wrong category or variant · sales brief% of products, lower is better | 0.0% | 1.8% |
| DeckBench measured by Spring Prompt · 13 results | ||
| Caveat dropped% of tasks, lower is better | 16.7% | 0.0% |
| Clean layout% of tasks, higher is better | 66.7% | 100.0% |
| Design quality% of the maximum, higher is better | 61.1% | 88.5% |
| Draft figure quoted% of tasks, lower is better | 33.3% | 0.0% |
| Findings missing% of tasks, lower is better | 16.7% | 0.0% |
| Head-to-head win rate% of comparisons, higher is betterThe rating weighs each win by how strong the other deck was; the win rate counts wins against whichever decks a model happened to meet, so the two can disagree. | 50.0% | 86.5% |
| Layout defects% of tasks, lower is better | 33.3% | 0.0% |
| Misleading metric used% of tasks, lower is better | 16.7% | 0.0% |
| Presentable decks% of tasks, higher is better | 33.3% | 66.7% |
| Recommendation late or wrong% of tasks, lower is better | 33.3% | 0.0% |
| Slides needing work% of tasks, lower is better | 16.7% | 33.3% |
| Unsupported claims% of tasks, lower is better | 33.3% | 0.0% |
| Unsupported numbers% of tasks, lower is better | 16.7% | 0.0% |
| ROASBench measured by Spring Prompt · 6 results | ||
| Consistency scorescore out of 100, higher is better | 10.6 | 44.7 |
| Contribution profitsimulated US dollars, higher is better | $32,146 | $599,139 |
| Cost of a runUS dollars, lower is better | $0.0313 | $1.23 |
| Months over budgetmonths of 12, lower is better | 0 | 0 |
| Planning scorescore out of 100, higher is better | 54.8 | 54.9 |
| Return on ad spendprofit per $1 spent, higher is better | $0.03 | $0.67 |
| Artificial Analysis reported by Artificial Analysis · 4 results | ||
| Long-context reasoning (AA-LCR)% of questions, higher is better | 82.7%max reasoning | 80.7%max reasoning |
| Output speedtokens per second, higher is better | 235max reasoning | 51.7xhigh reasoning |
| SciCode% of problems, higher is better | 55.0%max reasoning | 56.5%max reasoning |
| Time to first answer tokenseconds, lower is better | 5.08low reasoning | 2.11low reasoning |
Quick answers
Is Claude Haiku 5.5 better than GPT-6 Astra?
Pick GPT-6 Astra if quality matters most: it scores higher (Spring Prompt overall 79 against 44). Pick Claude Haiku 5.5 if cost matters more: it costs 31 times less per product listing on CatalogBench. Claude Haiku 5.5 is also faster.
Which is cheaper, Claude Haiku 5.5 or GPT-6 Astra?
Claude Haiku 5.5 is cheaper to run: $0.001 against $0.037 per product listing on CatalogBench (31 times less).
Which is faster, Claude Haiku 5.5 or GPT-6 Astra?
Claude Haiku 5.5 writes about 235 tokens a second on its usual API, against 52 for GPT-6 Astra (Artificial Analysis).
Run Claude Haiku 5.5 and GPT-6 Astra on your own prompt
Benchmarks aren't your data. Try both side by side in the playground, with the cost of every answer.