Compare / Claude Sonnet 4.6 vs GPT-5.4 Mini

Claude Sonnet 4.6 vs GPT-5.4 Mini

22 results from 4 sources that measured both models. Each row is in the source's own units; there is no overall winner.

Claude Sonnet 4.6
Anthropic · profile
GPT-5.4 Mini
OpenAI · profile
Results compared
22
Shared sources
4
BenchmarkMetricClaude Sonnet 4.6GPT-5.4 Mini
Arena (formerly LMArena)reportedOverallArena rating 1,4611,447
Arena (formerly LMArena)reportedBusiness, management and financeArena rating 1,4821,460
Arena (formerly LMArena)reportedCreative writingArena rating 1,4491,402
Arena (formerly LMArena)reportedExpert promptsArena rating 1,5061,480
Arena (formerly LMArena)reportedInstruction followingArena rating 1,4751,434
Arena (formerly LMArena)reportedOverallArena rating 1,4721,447
Arena (formerly LMArena)reportedWriting, literature and languageArena rating 1,4551,424
Artificial AnalysisreportedArtificial Analysis Coding Indexindex score 63.056.1
Artificial AnalysisreportedArtificial Analysis Intelligence Indexindex score 30.124.1
Artificial AnalysisreportedGPQA Diamond% of questions 87.5%87.5%
Artificial AnalysisreportedHumanity's Last Exam% of questions 33.6%28.1%
Artificial AnalysisreportedIFBench% of instructions 56.6%73.3%
Artificial AnalysisreportedLong-context reasoning (AA-LCR)% of questions 80.0%77.0%
Artificial AnalysisreportedSciCode% of problems 50.1%52.1%
Artificial AnalysisreportedTerminal-Bench 2.1% of tasks 71.2%59.2%
Artificial AnalysisreportedTerminal-Bench 4.0% of tasks 3.0%2.0%
Artificial AnalysisreportedTerminal-Bench Hard% of tasks 53.0%52.3%
Artificial AnalysisreportedΤ-bench banking% of tasks 34.4%25.6%
Artificial AnalysisreportedΤ²-bench telecom% of tasks 79.5%83.3%
SimpleQA Verified (Epoch AI)reportedCorrect answers% of questions 35.5%29.4%
Vectara Hallucination LeaderboardreportedAnswer rate% of documents 99.9%100.0%
Vectara Hallucination LeaderboardreportedHallucination rate% of summaries 10.6%5.5%

Bold green marks the better value on that metric. Where a source reports ranges that overlap, the difference may not be meaningful; see the benchmark page for ranges.