Compare / Gemma 4 31B vs GPT-6 Sol

Gemma 4 31B vs GPT-6 Sol

15 results from 4 sources that measured both models. Each row is in the source's own units; there is no overall winner.

Gemma 4 31B
Google · profile
GPT-6 Sol
OpenAI · profile
Results compared
15
Shared sources
4
BenchmarkMetricGemma 4 31BGPT-6 Sol
Arena (formerly LMArena)reportedOverallArena rating 1,4501,424
Arena (formerly LMArena)reportedBusiness, management and financeArena rating 1,4491,465
Arena (formerly LMArena)reportedCreative writingArena rating 1,4191,451
Arena (formerly LMArena)reportedExpert promptsArena rating 1,4991,507
Arena (formerly LMArena)reportedInstruction followingArena rating 1,4531,447
Arena (formerly LMArena)reportedOverallArena rating 1,4531,457
Arena (formerly LMArena)reportedWriting, literature and languageArena rating 1,4351,440
Artificial AnalysisreportedArtificial Analysis Intelligence Indexindex score 14.747.6
Artificial AnalysisreportedHumanity's Last Exam% of questions 23.6%47.9%
Artificial AnalysisreportedLong-context reasoning (AA-LCR)% of questions 69.7%83.7%
Artificial AnalysisreportedSciCode% of problems 45.5%57.6%
Artificial AnalysisreportedTerminal-Bench 4.0% of tasks 0.0%43.9%
SimpleQA Verified (Epoch AI)reportedCorrect answers% of questions 10.4%60.7%
Vectara Hallucination LeaderboardreportedAnswer rate% of documents 100.0%100.0%
Vectara Hallucination LeaderboardreportedHallucination rate% of summaries 7.4%6.5%

Bold green marks the better value on that metric. Where a source reports ranges that overlap, the difference may not be meaningful; see the benchmark page for ranges.