Compare / Claude Haiku 4.5 vs GPT-6.1 Sol

Claude Haiku 4.5 vs GPT-6.1 Sol

36 results from 3 sources that measured both models. Each row is in the source's own units; there is no overall winner.

Claude Haiku 4.5
Anthropic · profile
GPT-6.1 Sol
OpenAI · profile
Results compared
36
Shared sources
3
BenchmarkMetricClaude Haiku 4.5GPT-6.1 Sol
CatalogBenchmeasured by usChannel rules broken% of products 4.2%0.0%
CatalogBenchmeasured by usClaims to check% of products 44.6%0.0%
CatalogBenchmeasured by usContent quality% of checks 93.9%98.8%
CatalogBenchmeasured by usFailed outputs% of products 0.0%0.0%
CatalogBenchmeasured by usMissing UK information% of products 0.0%0.0%
CatalogBenchmeasured by usNot findable% of products 6.5%5.4%
CatalogBenchmeasured by usPublish-ready listings% of products 3.0%72.0%
CatalogBenchmeasured by usReliably publish-ready% of products 0.0%67.9%
CatalogBenchmeasured by usUnsupported claims% of products 91.7%3.6%
CatalogBenchmeasured by usUnsupported claimsclaims per product 5.320.07
CatalogBenchmeasured by usWrong attributes% of products 51.2%19.1%
CatalogBenchmeasured by usWrong category or variant% of products 6.5%1.8%
CatalogBenchmeasured by usChannel compliance% of products 100.0%100.0%
CatalogBenchmeasured by usChannel rules broken% of products 0.0%0.0%
CatalogBenchmeasured by usClaims to check% of products 22.6%0.0%
CatalogBenchmeasured by usConflicts caught% of conflicts 100.0%100.0%
CatalogBenchmeasured by usContent quality% of checks 94.4%98.6%
CatalogBenchmeasured by usCost per productUS dollars $0.0061$0.0084
CatalogBenchmeasured by usDecision accuracy% of decisions 90.6%98.7%
CatalogBenchmeasured by usFailed outputs% of products 0.0%0.0%
CatalogBenchmeasured by usField accuracy% of missing fields 93.7%94.4%
CatalogBenchmeasured by usInvented values% of filled values 6.2%2.2%
CatalogBenchmeasured by usMissing UK information% of products 0.0%0.0%
CatalogBenchmeasured by usNot findable% of products 8.9%4.8%
CatalogBenchmeasured by usPublish-ready listings% of products 12.5%78.0%
CatalogBenchmeasured by usReliably publish-ready% of products 1.8%75.0%
CatalogBenchmeasured by usUnsupported claimsclaims per product 2.690.00
CatalogBenchmeasured by usUnsupported claims% of products 73.2%0.0%
CatalogBenchmeasured by usWrong attributes% of products 48.2%16.7%
CatalogBenchmeasured by usWrong category or variant% of products 7.7%1.8%
Artificial AnalysisreportedArtificial Analysis Intelligence Indexindex score 16.951.8
Artificial AnalysisreportedHumanity's Last Exam% of questions 10.4%52.9%
Artificial AnalysisreportedLong-context reasoning (AA-LCR)% of questions 74.3%84.0%
Artificial AnalysisreportedSciCode% of problems 42.2%55.8%
Artificial AnalysisreportedTerminal-Bench 4.0% of tasks 0.0%56.1%
SimpleQA Verified (Epoch AI)reportedCorrect answers% of questions 13.2%73.9%

Bold green marks the better value on that metric. Where a source reports ranges that overlap, the difference may not be meaningful; see the benchmark page for ranges.