Compare / Gemini 3.7 Flash vs Mistral Medium 3.5

Gemini 3.7 Flash vs Mistral Medium 3.5

23 results from 3 sources that measured both models. Each row is in the source's own units; there is no overall winner.

Gemini 3.7 Flash
Google · profile
Mistral Medium 3.5
Mistral · profile
Results compared
23
Shared sources
3
BenchmarkMetricGemini 3.7 FlashMistral Medium 3.5
Arena (formerly LMArena)reportedConfirmed task successIPS effect estimate 0.00-0.16
Arena (formerly LMArena)reportedPraise over complaintIPS effect estimate -0.03-0.15
Arena (formerly LMArena)reportedSteerabilityIPS effect estimate -0.00-0.07
Arena (formerly LMArena)reportedTool groundingIPS effect estimate -0.00-0.02
Arena (formerly LMArena)reportedOverallArena rating 1,4771,430
Arena (formerly LMArena)reportedBusiness, management and financeArena rating 1,4831,430
Arena (formerly LMArena)reportedCreative writingArena rating 1,4921,398
Arena (formerly LMArena)reportedExpert promptsArena rating 1,5121,434
Arena (formerly LMArena)reportedInstruction followingArena rating 1,4871,421
Arena (formerly LMArena)reportedOverallArena rating 1,4881,426
Arena (formerly LMArena)reportedWriting, literature and languageArena rating 1,4961,404
Artificial AnalysisreportedArtificial Analysis Coding Indexindex score 76.146.9
Artificial AnalysisreportedArtificial Analysis Intelligence Indexindex score 39.614.2
Artificial AnalysisreportedGPQA Diamond% of questions 94.5%74.8%
Artificial AnalysisreportedHumanity's Last Exam% of questions 47.9%13.8%
Artificial AnalysisreportedLong-context reasoning (AA-LCR)% of questions 83.0%69.3%
Artificial AnalysisreportedSciCode% of problems 59.8%40.2%
Artificial AnalysisreportedTerminal-Bench 2.1% of tasks 85.8%50.6%
Artificial AnalysisreportedTerminal-Bench 4.0% of tasks 13.6%0.0%
Artificial AnalysisreportedΤ-bench banking% of tasks 35.5%15.1%
UGI LeaderboardreportedRequested-length error% off the requested word count 7.0%18.0%
UGI LeaderboardreportedStyle adherencescore from 0 to 1 0.330.35
UGI LeaderboardreportedWriting scorescore out of 100 77.545.5

Bold green marks the better value on that metric. Where a source reports ranges that overlap, the difference may not be meaningful; see the benchmark page for ranges.