Compare / Gemini 3.1 Pro Preview vs Inkling

Gemini 3.1 Pro Preview vs Inkling

13 results from 2 sources that measured both models. Each row is in the source's own units; there is no overall winner.

Gemini 3.1 Pro Preview
Google · profile
Inkling
Thinkingmachines · profile
Results compared
13
Shared sources
2
BenchmarkMetricGemini 3.1 Pro PreviewInkling
Arena (formerly LMArena)reportedConfirmed task successIPS effect estimate -0.08-0.22
Arena (formerly LMArena)reportedPraise over complaintIPS effect estimate -0.01-0.22
Arena (formerly LMArena)reportedSteerabilityIPS effect estimate -0.04-0.12
Arena (formerly LMArena)reportedTool groundingIPS effect estimate -0.00-0.00
Arena (formerly LMArena)reportedOverallArena rating 1,4721,452
Arena (formerly LMArena)reportedBusiness, management and financeArena rating 1,4771,444
Arena (formerly LMArena)reportedCreative writingArena rating 1,4801,384
Arena (formerly LMArena)reportedExpert promptsArena rating 1,5091,474
Arena (formerly LMArena)reportedInstruction followingArena rating 1,4791,427
Arena (formerly LMArena)reportedOverallArena rating 1,4871,442
Arena (formerly LMArena)reportedWriting, literature and languageArena rating 1,4801,403
tau2-benchreportedConsistency (pass^4)% of tasks 9.3%11.3%
tau2-benchreportedTask success (pass^1)% of tasks 26.0%25.0%

Bold green marks the better value on that metric. Where a source reports ranges that overlap, the difference may not be meaningful; see the benchmark page for ranges.