Compare / Gemma 4 26B A4B vs GPT-5 Mini

Gemma 4 26B A4B vs GPT-5 Mini

20 results from 3 sources that measured both models. Each row is in the source's own units; there is no overall winner.

Gemma 4 26B A4B
Google · profile
GPT-5 Mini
OpenAI · profile
Results compared
20
Shared sources
3
BenchmarkMetricGemma 4 26B A4BGPT-5 Mini
Arena (formerly LMArena)reportedOverallArena rating 1,4451,394
Arena (formerly LMArena)reportedBusiness, management and financeArena rating 1,4441,381
Arena (formerly LMArena)reportedCreative writingArena rating 1,3991,324
Arena (formerly LMArena)reportedExpert promptsArena rating 1,4751,400
Arena (formerly LMArena)reportedInstruction followingArena rating 1,4371,373
Arena (formerly LMArena)reportedOverallArena rating 1,4381,390
Arena (formerly LMArena)reportedWriting, literature and languageArena rating 1,4061,352
Artificial AnalysisreportedArtificial Analysis Coding Indexindex score 39.315.6
Artificial AnalysisreportedArtificial Analysis Intelligence Indexindex score 16.720.6
Artificial AnalysisreportedGPQA Diamond% of questions 79.2%82.8%
Artificial AnalysisreportedHumanity's Last Exam% of questions 19.3%21.5%
Artificial AnalysisreportedIFBench% of instructions 72.4%75.4%
Artificial AnalysisreportedLong-context reasoning (AA-LCR)% of questions 65.7%72.3%
Artificial AnalysisreportedSciCode% of problems 40.0%39.0%
Artificial AnalysisreportedTerminal-Bench 2.1% of tasks 39.0%3.7%
Artificial AnalysisreportedTerminal-Bench Hard% of tasks 25.0%33.3%
Artificial AnalysisreportedΤ-bench banking% of tasks 12.0%15.5%
Artificial AnalysisreportedΤ²-bench telecom% of tasks 43.6%71.1%
Vectara Hallucination LeaderboardreportedAnswer rate% of documents 99.8%99.9%
Vectara Hallucination LeaderboardreportedHallucination rate% of summaries 5.2%12.9%

Bold green marks the better value on that metric. Where a source reports ranges that overlap, the difference may not be meaningful; see the benchmark page for ranges.