Compare / Gemini 3.1 Pro Preview vs Grok 4.20

Gemini 3.1 Pro Preview vs Grok 4.20

10 results from 3 sources that measured both models. Each row is in the source's own units; there is no overall winner.

Gemini 3.1 Pro Preview
Google · profile
Grok 4.20
xAI · profile
Results compared
10
Shared sources
3
BenchmarkMetricGemini 3.1 Pro PreviewGrok 4.20
Artificial AnalysisreportedArtificial Analysis Intelligence Indexindex score 29.725.7
Artificial AnalysisreportedGPQA Diamond% of questions 94.1%91.1%
Artificial AnalysisreportedHumanity's Last Exam% of questions 47.0%34.5%
Artificial AnalysisreportedIFBench% of instructions 77.1%81.2%
Artificial AnalysisreportedLong-context reasoning (AA-LCR)% of questions 82.0%69.0%
Artificial AnalysisreportedTerminal-Bench Hard% of tasks 53.8%37.9%
Artificial AnalysisreportedΤ²-bench telecom% of tasks 95.6%93.0%
tau2-benchreportedConsistency (pass^4)% of tasks 9.3%8.2%
tau2-benchreportedTask success (pass^1)% of tasks 26.0%18.0%
Vending-Bench 2reportedMoney after a yearUS dollars $911.21$4,662.85

Bold green marks the better value on that metric. Where a source reports ranges that overlap, the difference may not be meaningful; see the benchmark page for ranges.