Compare / Gemini 3.1 Pro Preview vs Grok 4.7

Gemini 3.1 Pro Preview vs Grok 4.7

33 results from 4 sources that measured both models. Each row is in the source's own units; there is no overall winner.

Gemini 3.1 Pro Preview
Google · profile
Grok 4.7
xAI · profile
Results compared
33
Shared sources
4
BenchmarkMetricGemini 3.1 Pro PreviewGrok 4.7
BulletBenchmeasured by usLadder Eloladder Elo 683147
BulletBenchmeasured by usMedian move timemilliseconds 6.2 s10.1 s
CatalogBenchmeasured by usContent quality% of checks 96.6%97.7%
CatalogBenchmeasured by usFailed outputs% of products 0.0%0.0%
CatalogBenchmeasured by usPublish-ready listings% of products 3.6%38.1%
CatalogBenchmeasured by usReliably publish-ready% of products 0.0%10.7%
CatalogBenchmeasured by usUnsupported claimsclaims per product 7.211.58
CatalogBenchmeasured by usChannel compliance% of products 97.0%100.0%
CatalogBenchmeasured by usConflicts caught% of conflicts 100.0%100.0%
CatalogBenchmeasured by usContent quality% of checks 96.5%97.3%
CatalogBenchmeasured by usCost per productUS dollars $0.0355$0.0237
CatalogBenchmeasured by usDecision accuracy% of decisions 94.8%96.4%
CatalogBenchmeasured by usFailed outputs% of products 0.0%0.0%
CatalogBenchmeasured by usField accuracy% of missing fields 95.4%92.9%
CatalogBenchmeasured by usInvented values% of filled values 1.5%0.5%
CatalogBenchmeasured by usPublish-ready listings% of products 42.3%62.5%
CatalogBenchmeasured by usReliably publish-ready% of products 25.0%44.6%
CatalogBenchmeasured by usUnsupported claimsclaims per product 1.640.80
ROASBenchmeasured by usCost of a runUS dollars $0.52$0.42
ROASBenchmeasured by usMonths over budgetmonths of 12 00
ROASBenchmeasured by usOverall scorescore out of 100 43.536.6
ROASBenchmeasured by usReturn on ad spendprofit per £1 spent £0.42£0.23
Arena (formerly LMArena)reportedConfirmed task successIPS effect estimate -0.080.09
Arena (formerly LMArena)reportedPraise over complaintIPS effect estimate -0.010.04
Arena (formerly LMArena)reportedSteerabilityIPS effect estimate -0.040.00
Arena (formerly LMArena)reportedTool groundingIPS effect estimate -0.000.00
Arena (formerly LMArena)reportedOverallArena rating 1,4721,420
Arena (formerly LMArena)reportedBusiness, management and financeArena rating 1,4771,424
Arena (formerly LMArena)reportedCreative writingArena rating 1,4801,427
Arena (formerly LMArena)reportedExpert promptsArena rating 1,5091,454
Arena (formerly LMArena)reportedInstruction followingArena rating 1,4791,437
Arena (formerly LMArena)reportedOverallArena rating 1,4871,439
Arena (formerly LMArena)reportedWriting, literature and languageArena rating 1,4801,426

Bold green marks the better value on that metric. Where a source reports ranges that overlap, the difference may not be meaningful; see the benchmark page for ranges.