Compare / Claude Sonnet 4.6 vs Mistral Medium 3.5

Claude Sonnet 4.6 vs Mistral Medium 3.5

22 results from 3 sources that measured both models. Each row is in the source's own units; there is no overall winner.

Claude Sonnet 4.6
Anthropic · profile
Mistral Medium 3.5
Mistral · profile
Results compared
22
Shared sources
3
BenchmarkMetricClaude Sonnet 4.6Mistral Medium 3.5
Arena (formerly LMArena)reportedOverallArena rating 1,4611,430
Arena (formerly LMArena)reportedBusiness, management and financeArena rating 1,4821,430
Arena (formerly LMArena)reportedCreative writingArena rating 1,4491,398
Arena (formerly LMArena)reportedExpert promptsArena rating 1,5061,434
Arena (formerly LMArena)reportedInstruction followingArena rating 1,4751,421
Arena (formerly LMArena)reportedOverallArena rating 1,4721,426
Arena (formerly LMArena)reportedWriting, literature and languageArena rating 1,4551,404
Artificial AnalysisreportedArtificial Analysis Coding Indexindex score 63.046.9
Artificial AnalysisreportedArtificial Analysis Intelligence Indexindex score 30.114.2
Artificial AnalysisreportedGPQA Diamond% of questions 87.5%74.8%
Artificial AnalysisreportedHumanity's Last Exam% of questions 33.6%13.8%
Artificial AnalysisreportedIFBench% of instructions 56.6%68.8%
Artificial AnalysisreportedLong-context reasoning (AA-LCR)% of questions 80.0%69.3%
Artificial AnalysisreportedSciCode% of problems 50.1%40.2%
Artificial AnalysisreportedTerminal-Bench 2.1% of tasks 71.2%50.6%
Artificial AnalysisreportedTerminal-Bench 4.0% of tasks 3.0%0.0%
Artificial AnalysisreportedTerminal-Bench Hard% of tasks 53.0%33.3%
Artificial AnalysisreportedΤ-bench banking% of tasks 34.4%15.1%
Artificial AnalysisreportedΤ²-bench telecom% of tasks 79.5%94.2%
UGI LeaderboardreportedRequested-length error% off the requested word count 2.0%18.0%
UGI LeaderboardreportedStyle adherencescore from 0 to 1 0.410.35
UGI LeaderboardreportedWriting scorescore out of 100 64.545.5

Bold green marks the better value on that metric. Where a source reports ranges that overlap, the difference may not be meaningful; see the benchmark page for ranges.