Recommendation late or wrong: Mercury 3
16 results above zero · % of tasks, lower is better. Choose a model to highlight it.Clear highlight
- 9 Claude Sonnet 5.5Anthropic 16.7%
- 9 DeepSeek-V4.1-Flash-1017DeepSeek 16.7%
- 9 GPT-6 LunaOpenAI 16.7%
- 9 Grok 4.7xAI 16.7%
- 13 Claude Haiku 5.5Anthropic 33.3%
- 13 Gemini 3.8 FlashGoogle 33.3%
- 13 MiniMax M3.1 FlashMiniMax 33.3%
- 13 Kimi K3Moonshot AI 33.3%
- 17 Claude Haiku 4.5Anthropic 50.0%
- 17 Gemini 3.1 Pro PreviewGoogle 50.0%
- 17 Mistral Medium 3.5Mistral AI 50.0%
- 20 DeepSeek-V4-Pro (0423)DeepSeek 66.7%
- 20 Muse Spark 1.3Meta 66.7%
- 22 Gemini 3.5 Flash-LiteGoogle 83.3%
- 22 Mercury 3Inception 83.3%
8 models had none: Claude Fable 5.1, Claude Opus 5.5, GPT-6 Astra, GPT-6 Sol, GPT-6.1 Sol, Gemini 4 Argon, Muse Wonder, Qwen3.8-Max (0902).