Compare / Muse Spark 1.1 vs Inkling

Muse Spark 1.1 vs Inkling

14 results from 3 sources that measured both models. Each row is in the source's own units; there is no overall winner.

Muse Spark 1.1
Meta · profile
Inkling
Thinkingmachines · profile
Results compared
14
Shared sources
3
BenchmarkMetricMuse Spark 1.1Inkling
Arena (formerly LMArena)reportedConfirmed task successIPS effect estimate -0.02-0.22
Arena (formerly LMArena)reportedPraise over complaintIPS effect estimate -0.11-0.22
Arena (formerly LMArena)reportedSteerabilityIPS effect estimate -0.06-0.12
Arena (formerly LMArena)reportedTool groundingIPS effect estimate 0.00-0.00
Arena (formerly LMArena)reportedOverallArena rating 1,4631,452
Arena (formerly LMArena)reportedBusiness, management and financeArena rating 1,4931,444
Arena (formerly LMArena)reportedCreative writingArena rating 1,4491,384
Arena (formerly LMArena)reportedExpert promptsArena rating 1,5041,474
Arena (formerly LMArena)reportedInstruction followingArena rating 1,4731,427
Arena (formerly LMArena)reportedOverallArena rating 1,4911,442
Arena (formerly LMArena)reportedWriting, literature and languageArena rating 1,4601,403
SimpleQA Verified (Epoch AI)reportedCorrect answers% of questions 57.8%40.3%
tau2-benchreportedConsistency (pass^4)% of tasks 20.6%11.3%
tau2-benchreportedTask success (pass^1)% of tasks 40.5%25.0%

Bold green marks the better value on that metric. Where a source reports ranges that overlap, the difference may not be meaningful; see the benchmark page for ranges.