Compare / Claude Sonnet 5 vs Mistral Medium 3.1

Claude Sonnet 5 vs Mistral Medium 3.1

19 results from 3 sources that measured both models. Each row is in the source's own units; there is no overall winner.

Claude Sonnet 5
Anthropic · profile
Mistral Medium 3.1
Mistral · profile
Results compared
19
Shared sources
3
BenchmarkMetricClaude Sonnet 5Mistral Medium 3.1
Arena (formerly LMArena)reportedOverallArena rating 1,4521,429
Arena (formerly LMArena)reportedBusiness, management and financeArena rating 1,4651,407
Arena (formerly LMArena)reportedCreative writingArena rating 1,4351,378
Arena (formerly LMArena)reportedExpert promptsArena rating 1,5121,410
Arena (formerly LMArena)reportedInstruction followingArena rating 1,4671,395
Arena (formerly LMArena)reportedOverallArena rating 1,4621,408
Arena (formerly LMArena)reportedWriting, literature and languageArena rating 1,4521,386
Artificial AnalysisreportedArtificial Analysis Coding Indexindex score 71.520.5
Artificial AnalysisreportedArtificial Analysis Intelligence Indexindex score 38.29.20
Artificial AnalysisreportedGPQA Diamond% of questions 91.1%58.8%
Artificial AnalysisreportedHumanity's Last Exam% of questions 41.3%4.7%
Artificial AnalysisreportedLong-context reasoning (AA-LCR)% of questions 82.0%42.7%
Artificial AnalysisreportedSciCode% of problems 54.3%32.4%
Artificial AnalysisreportedTerminal-Bench 2.1% of tasks 80.5%13.9%
Artificial AnalysisreportedTerminal-Bench 4.0% of tasks 14.1%0.0%
Artificial AnalysisreportedΤ-bench banking% of tasks 37.3%8.2%
UGI LeaderboardreportedRequested-length error% off the requested word count 3.0%27.0%
UGI LeaderboardreportedStyle adherencescore from 0 to 1 0.380.39
UGI LeaderboardreportedWriting scorescore out of 100 62.739.5

Bold green marks the better value on that metric. Where a source reports ranges that overlap, the difference may not be meaningful; see the benchmark page for ranges.