Compare / Gemini 3.8 Flash vs Kimi K3

Gemini 3.8 Flash vs Kimi K3

53 results from 4 sources that measured both models. Each row is in the source's own units; there is no overall winner.

Gemini 3.8 Flash
Google · profile
Kimi K3
Moonshot AI · profile
Results compared
53
Shared sources
4
BenchmarkMetricGemini 3.8 FlashKimi K3
BulletBenchmeasured by usCost per gameUS dollars $0.0154$0.0540
BulletBenchmeasured by usGames lost on time% of games 50.0%91.7%
BulletBenchmeasured by usInvalid moves% of moves 0.0%0.0%
BulletBenchmeasured by usLadder Eloladder Elo 1,06833
BulletBenchmeasured by usMedian move timemilliseconds 1.8 s2.6 s
CatalogBenchmeasured by usChannel rules broken% of products 3.0%0.6%
CatalogBenchmeasured by usContent quality% of checks 97.3%95.8%
CatalogBenchmeasured by usFailed outputs% of products 0.0%0.6%
CatalogBenchmeasured by usMissing UK information% of products 0.0%0.0%
CatalogBenchmeasured by usNot findable% of products 8.9%3.0%
CatalogBenchmeasured by usPublish-ready listings% of products 2.4%1.8%
CatalogBenchmeasured by usReliably publish-ready% of products 1.8%0.0%
CatalogBenchmeasured by usUnsupported claimsclaims per product 7.127.18
CatalogBenchmeasured by usUnsupported claims% of products 97.0%97.0%
CatalogBenchmeasured by usWrong attributes% of products 11.9%20.8%
CatalogBenchmeasured by usWrong category or variant% of products 3.0%4.2%
CatalogBenchmeasured by usChannel compliance% of products 98.8%99.4%
CatalogBenchmeasured by usChannel rules broken% of products 1.2%0.6%
CatalogBenchmeasured by usConflicts caught% of conflicts 100.0%97.0%
CatalogBenchmeasured by usContent quality% of checks 97.1%96.0%
CatalogBenchmeasured by usCost per productUS dollars $0.0103$0.0469
CatalogBenchmeasured by usDecision accuracy% of decisions 94.3%94.8%
CatalogBenchmeasured by usFailed outputs% of products 0.0%0.0%
CatalogBenchmeasured by usField accuracy% of missing fields 92.7%94.4%
CatalogBenchmeasured by usInvented values% of filled values 0.2%5.7%
CatalogBenchmeasured by usMissing UK information% of products 0.0%0.0%
CatalogBenchmeasured by usNot findable% of products 8.3%4.2%
CatalogBenchmeasured by usPublish-ready listings% of products 33.3%47.6%
CatalogBenchmeasured by usReliably publish-ready% of products 16.1%17.9%
CatalogBenchmeasured by usUnsupported claimsclaims per product 1.791.39
CatalogBenchmeasured by usUnsupported claims% of products 60.1%33.9%
CatalogBenchmeasured by usWrong attributes% of products 15.5%24.4%
CatalogBenchmeasured by usWrong category or variant% of products 3.6%3.0%
ROASBenchmeasured by usAudience scorescore out of 100 67.165.1
ROASBenchmeasured by usBusiness scorescore out of 100 51.040.2
ROASBenchmeasured by usConsistency scorescore out of 100 36.428.3
ROASBenchmeasured by usContribution profitsimulated US dollars $842,432$654,270
ROASBenchmeasured by usCost of a runUS dollars $0.16$1.01
ROASBenchmeasured by usMonths over budgetmonths of 12 00
ROASBenchmeasured by usOverall scorescore out of 100 51.444.1
ROASBenchmeasured by usPlanning scorescore out of 100 54.754.7
ROASBenchmeasured by usReturn on ad spendprofit per $1 spent $0.65$0.50
Arena (formerly LMArena)reportedConfirmed task successIPS effect estimate 0.090.09
Arena (formerly LMArena)reportedPraise over complaintIPS effect estimate 0.050.07
Arena (formerly LMArena)reportedSteerabilityIPS effect estimate 0.04-0.01
Arena (formerly LMArena)reportedTool groundingIPS effect estimate 0.000.00
Arena (formerly LMArena)reportedOverallArena rating 1,4771,472
Arena (formerly LMArena)reportedBusiness, management and financeArena rating 1,4821,489
Arena (formerly LMArena)reportedCreative writingArena rating 1,4821,458
Arena (formerly LMArena)reportedExpert promptsArena rating 1,5291,533
Arena (formerly LMArena)reportedInstruction followingArena rating 1,4881,486
Arena (formerly LMArena)reportedOverallArena rating 1,4921,488
Arena (formerly LMArena)reportedWriting, literature and languageArena rating 1,4861,475

Bold green marks the better value on that metric. Where a source reports ranges that overlap, the difference may not be meaningful; see the benchmark page for ranges.