Compare / Claude Opus 4.8 vs Kimi K2 Thinking

Claude Opus 4.8 vs Kimi K2 Thinking

16 results from 3 sources that measured both models. Each row is in the source's own units; there is no overall winner.

Claude Opus 4.8
Anthropic · profile
Kimi K2 Thinking
Moonshot AI · profile
Results compared
16
Shared sources
3
BenchmarkMetricClaude Opus 4.8Kimi K2 Thinking
Artificial AnalysisreportedArtificial Analysis Intelligence Indexindex score 41.822.0
Artificial AnalysisreportedGPQA Diamond% of questions 92.0%83.8%
Artificial AnalysisreportedHumanity's Last Exam% of questions 48.7%23.8%
Artificial AnalysisreportedIFBench% of instructions 62.2%68.1%
Artificial AnalysisreportedLong-context reasoning (AA-LCR)% of questions 77.7%72.0%
Artificial AnalysisreportedTerminal-Bench Hard% of tasks 58.3%31.1%
Artificial AnalysisreportedΤ²-bench telecom% of tasks 94.4%93.0%
OpenHands IndexreportedAverage% resolved 71.9%41.0%
OpenHands IndexreportedFront end (SWE-Bench Multimodal)% resolved 50.0%32.4%
OpenHands IndexreportedGreenfield (Commit0)% resolved 62.5%12.5%
OpenHands IndexreportedInformation gathering (GAIA)% resolved 78.8%43.6%
OpenHands IndexreportedIssue resolution (SWE-Bench)% resolved 83.8%69.2%
OpenHands IndexreportedTesting (SWT-Bench)% resolved 84.3%47.3%
UGI LeaderboardreportedRequested-length error% off the requested word count 6.0%20.0%
UGI LeaderboardreportedStyle adherencescore from 0 to 1 0.400.38
UGI LeaderboardreportedWriting scorescore out of 100 65.959.3

Bold green marks the better value on that metric. Where a source reports ranges that overlap, the difference may not be meaningful; see the benchmark page for ranges.