Compare / GPT-6 Astra vs GPT-6 Luna

GPT-6 Astra vs GPT-6 Luna

58 results from 4 sources that measured both models. Each row is in the source's own units; there is no overall winner.

GPT-6 Astra
OpenAI · profile
GPT-6 Luna
OpenAI · profile
Results compared
58
Shared sources
4
BenchmarkMetricGPT-6 AstraGPT-6 Luna
BulletBenchmeasured by usCost per gameUS dollars $0.28$0.0072
BulletBenchmeasured by usGames lost on time% of games 37.5%50.0%
BulletBenchmeasured by usInvalid moves% of moves 0.0%0.0%
BulletBenchmeasured by usLadder Eloladder Elo 839557
BulletBenchmeasured by usMedian move timemilliseconds 5.6 s7.0 s
BulletBenchmeasured by usCost per gameUS dollars $0.0943$0.0016
BulletBenchmeasured by usGames lost on time% of games 75.0%50.0%
BulletBenchmeasured by usInvalid moves% of moves 0.0%0.0%
BulletBenchmeasured by usLadder Eloladder Elo 323249
BulletBenchmeasured by usMedian move timemilliseconds 2.3 s1.5 s
CatalogBenchmeasured by usChannel rules broken% of products 0.0%0.0%
CatalogBenchmeasured by usContent quality% of checks 99.0%97.8%
CatalogBenchmeasured by usFailed outputs% of products 0.0%0.0%
CatalogBenchmeasured by usMissing UK information% of products 0.0%0.0%
CatalogBenchmeasured by usNot findable% of products 5.4%10.1%
CatalogBenchmeasured by usPublish-ready listings% of products 72.6%69.0%
CatalogBenchmeasured by usReliably publish-ready% of products 67.9%55.4%
CatalogBenchmeasured by usUnsupported claimsclaims per product 0.070.32
CatalogBenchmeasured by usUnsupported claims% of products 3.0%7.7%
CatalogBenchmeasured by usWrong attributes% of products 20.2%19.1%
CatalogBenchmeasured by usWrong category or variant% of products 1.8%0.0%
CatalogBenchmeasured by usChannel compliance% of products 100.0%100.0%
CatalogBenchmeasured by usChannel rules broken% of products 0.0%0.0%
CatalogBenchmeasured by usConflicts caught% of conflicts 100.0%100.0%
CatalogBenchmeasured by usContent quality% of checks 98.3%97.3%
CatalogBenchmeasured by usCost per productUS dollars $0.0371$0.0005
CatalogBenchmeasured by usDecision accuracy% of decisions 98.4%97.1%
CatalogBenchmeasured by usFailed outputs% of products 0.0%0.0%
CatalogBenchmeasured by usField accuracy% of missing fields 94.2%93.7%
CatalogBenchmeasured by usInvented values% of filled values 1.9%1.7%
CatalogBenchmeasured by usMissing UK information% of products 0.0%0.0%
CatalogBenchmeasured by usNot findable% of products 6.0%10.1%
CatalogBenchmeasured by usPublish-ready listings% of products 77.4%66.7%
CatalogBenchmeasured by usReliably publish-ready% of products 75.0%55.4%
CatalogBenchmeasured by usUnsupported claims% of products 1.2%9.5%
CatalogBenchmeasured by usUnsupported claimsclaims per product 0.020.30
CatalogBenchmeasured by usWrong attributes% of products 17.3%18.4%
CatalogBenchmeasured by usWrong category or variant% of products 1.8%1.8%
ROASBenchmeasured by usAudience scorescore out of 100 68.668.2
ROASBenchmeasured by usBusiness scorescore out of 100 57.554.8
ROASBenchmeasured by usConsistency scorescore out of 100 44.735.8
ROASBenchmeasured by usContribution profitsimulated US dollars $599,139$738,878
ROASBenchmeasured by usCost of a runUS dollars $1.23$0.0142
ROASBenchmeasured by usMonths over budgetmonths of 12 00
ROASBenchmeasured by usOverall scorescore out of 100 56.653.4
ROASBenchmeasured by usPlanning scorescore out of 100 54.954.8
ROASBenchmeasured by usReturn on ad spendprofit per $1 spent $0.67$0.66
Arena (formerly LMArena)reportedConfirmed task successIPS effect estimate 0.130.05
Arena (formerly LMArena)reportedPraise over complaintIPS effect estimate 0.34-0.03
Arena (formerly LMArena)reportedSteerabilityIPS effect estimate -0.010.02
Arena (formerly LMArena)reportedTool groundingIPS effect estimate 0.000.00
Arena (formerly LMArena)reportedOverallArena rating 1,4651,422
Arena (formerly LMArena)reportedBusiness, management and financeArena rating 1,4831,452
Arena (formerly LMArena)reportedCreative writingArena rating 1,4531,403
Arena (formerly LMArena)reportedExpert promptsArena rating 1,5101,505
Arena (formerly LMArena)reportedInstruction followingArena rating 1,4731,443
Arena (formerly LMArena)reportedOverallArena rating 1,4781,442
Arena (formerly LMArena)reportedWriting, literature and languageArena rating 1,4691,415

Bold green marks the better value on that metric. Where a source reports ranges that overlap, the difference may not be meaningful; see the benchmark page for ranges.