Compare / Claude Haiku 4.5 vs Gemini 3.5 Flash

Claude Haiku 4.5 vs Gemini 3.5 Flash

21 results from 3 sources that measured both models. Each row is in the source's own units; there is no overall winner.

Claude Haiku 4.5
Anthropic · profile
Gemini 3.5 Flash
Google · profile
Results compared
21
Shared sources
3
BenchmarkMetricClaude Haiku 4.5Gemini 3.5 Flash
BulletBenchmeasured by usCost per gameUS dollars $0.0163$0.0289
BulletBenchmeasured by usGames lost on time% of games 25.0%25.0%
BulletBenchmeasured by usInvalid moves% of moves 0.3%0.5%
BulletBenchmeasured by usLadder Eloladder Elo 445810
BulletBenchmeasured by usMedian move timemilliseconds 1.2 s1.2 s
BulletBenchmeasured by usCost per gameUS dollars $0.0095$0.0213
BulletBenchmeasured by usGames lost on time% of games 83.3%33.3%
BulletBenchmeasured by usInvalid moves% of moves 0.0%0.6%
BulletBenchmeasured by usLadder Eloladder Elo 33727
BulletBenchmeasured by usMedian move timemilliseconds 1.3 s1.2 s
Arena (formerly LMArena)reportedOverallArena rating 1,4191,461
Arena (formerly LMArena)reportedOverallArena rating 1,4181,476
Arena (formerly LMArena)reportedBusiness, management and financeArena rating 1,4201,468
Arena (formerly LMArena)reportedCreative writingArena rating 1,3871,466
Arena (formerly LMArena)reportedExpert promptsArena rating 1,4521,491
Arena (formerly LMArena)reportedInstruction followingArena rating 1,4151,465
Arena (formerly LMArena)reportedOverallArena rating 1,4141,477
Arena (formerly LMArena)reportedWriting, literature and languageArena rating 1,3991,472
UGI LeaderboardreportedRequested-length error% off the requested word count 6.0%9.0%
UGI LeaderboardreportedStyle adherencescore from 0 to 1 0.390.35
UGI LeaderboardreportedWriting scorescore out of 100 52.272.5

Bold green marks the better value on that metric. Where a source reports ranges that overlap, the difference may not be meaningful; see the benchmark page for ranges.