1
Claude Fable 5.2 Anthropic Provisional · 2 of 5 groups
90
88 – 95 – –
$16.00
10 Nov 2026
Spring Prompt benches 88CatalogBench 87 · Reliably publish-ready 71.4%; Sales brief: reliably publish-ready 44.6% ROASBench 100 · Overall score 61.3 BulletBench 74 · Ladder Elo 491 (95% range 230–714) Knowledge work 95DeckBench 91 · Deck rating 1,421 (95% range 1,327–1,560) SurveyBench 100 · Analysis rating 1,641 (95% range 1,548–1,782)
No results: Agents and tool use, Writing and preference, Factuality
2
Claude Opus 5.5 Anthropic
82
69 90 90 88 86
$8.00
8 Oct 2026
Spring Prompt benches 69CatalogBench 65 · Reliably publish-ready 55.4%; Sales brief: reliably publish-ready 21.4% ROASBench 75 · Overall score 51.7 Agents and tool use 90Terminal-Bench (Artificial Analysis) 90 · Terminal-Bench 4.0 59.6% Knowledge work 90APEX-Agents 91 · Tasks passed 73.5% GDP.pdf 100 · Professional document tasks 30.6% DeckBench 81 · Deck rating 1,323 (95% range 1,247–1,403) SurveyBench 87 · Analysis rating 1,427 (95% range 1,376–1,486) Writing and preference 88Arena text 95 · Overall 1,504 (95% range 1,495–1,513) UGI Leaderboard 80 · Writing score 70.0 Factuality 86Arena factuality 95 · Overall 1,507 (95% range 1,499–1,515) SimpleQA Verified (Epoch AI) 77 · Correct answers 72.2%
3=
GPT-6.1 Sol OpenAI
80
95 81 78 58 66
$4.00
9 Oct 2026
Spring Prompt benches 95CatalogBench 96 · Reliably publish-ready 75.0%; Sales brief: reliably publish-ready 67.9% BulletBench 93 · Lightning 10+1: ladder Elo 584 (95% range 327–806); Bullet 60s: ladder Elo 928 (95% range 676–1,184) Agents and tool use 81Terminal-Bench (Artificial Analysis) 81 · Terminal-Bench 4.0 56.1% Knowledge work 78APEX-Agents 55 · Tasks passed 60.0% DeckBench 88 · Deck rating 1,391 (95% range 1,316–1,491) SurveyBench 91 · Analysis rating 1,432 (95% range 1,381–1,520) Writing and preference 58Arena text 65 · Overall 1,483 (95% range 1,473–1,494) UGI Leaderboard 50 · Writing score 67.7 Factuality 66Arena factuality 40 · Overall 1,463 (95% range 1,454–1,472) SimpleQA Verified (Epoch AI) 92 · Correct answers 73.9%
3=
GPT-6.1 Terra OpenAI Provisional · 3 of 5 groups
80
84 77 74 – –
$2.00
27 Oct 2026
Spring Prompt benches 84CatalogBench 89 · Reliably publish-ready 64.3%; Sales brief: reliably publish-ready 67.9% ROASBench 97 · Overall score 58.4 BulletBench 51 · Lightning 10+1: ladder Elo 491 (95% range 0–727); Bullet 60s: ladder Elo 358 (95% range 0–595) Agents and tool use 77Terminal-Bench (Artificial Analysis) 77 · Terminal-Bench 4.0 55.6% Knowledge work 74DeckBench 78 · Deck rating 1,305 (95% range 1,209–1,405) SurveyBench 70 · Analysis rating 1,234 (95% range 1,175–1,312)
No results: Writing and preference, Factuality
5
GPT-6 Astra OpenAI
77
87 79 85 60 65
$20.00
6 Oct 2026
Spring Prompt benches 87CatalogBench 99 · Reliably publish-ready 75.0%; Sales brief: reliably publish-ready 69.6% ROASBench 94 · Overall score 56.6 BulletBench 44 · Ladder Elo 323 (95% range 0–528) Agents and tool use 79Terminal-Bench (Artificial Analysis) 91 · Terminal-Bench 4.0 59.6%; Terminal-Bench 2.1 89.9% τ-bench banking (Artificial Analysis) 45 · Τ-bench banking 43.1% Vending-Bench 2 100 · Money after a year $15,515 Knowledge work 85APEX-Agents 73 · Tasks passed 64.7% DeckBench 97 · Deck rating 1,566 (95% range 1,452–1,742) Writing and preference 60Arena text 50 · Overall 1,477 (95% range 1,470–1,484) UGI Leaderboard 70 · Writing score 68.9 Factuality 65Vectara Hallucination Leaderboard 50 · Hallucination rate 8.7% Arena factuality 45 · Overall 1,466 (95% range 1,460–1,472) SimpleQA Verified (Epoch AI) 100 · Correct answers 75.6%
6
Gemini 4 Argon Google
72
57 85 35 100 100
$4.00
14 Oct 2026
Spring Prompt benches 57CatalogBench 68 · Reliably publish-ready 60.7%; Sales brief: reliably publish-ready 17.9% ROASBench 63 · Overall score 47.0 BulletBench 22 · Ladder Elo 147 (95% range 0–381) Agents and tool use 85Terminal-Bench (Artificial Analysis) 85 · Terminal-Bench 4.0 57.1% Knowledge work 35DeckBench 31 · Deck rating 960 (95% range 893–1,039) SurveyBench 39 · Analysis rating 942 (95% range 886–992) Writing and preference 100Arena text 100 · Overall 1,525 (95% range 1,516–1,534) Factuality 100Arena factuality 100 · Overall 1,511 (95% range 1,503–1,518)
7
Muse Wonder Meta Provisional · 3 of 5 groups
70
66 69 79 – –
$8.00
12 Oct 2026
Spring Prompt benches 66CatalogBench 87 · Reliably publish-ready 66.1%; Sales brief: reliably publish-ready 51.8% ROASBench 34 · Overall score 38.9 BulletBench 60 · Ladder Elo 409 (95% range 100–609) Agents and tool use 69Terminal-Bench (Artificial Analysis) 69 · Terminal-Bench 4.0 52.0% Knowledge work 79DeckBench 63 · Deck rating 1,221 (95% range 1,163–1,275) SurveyBench 96 · Analysis rating 1,455 (95% range 1,394–1,529)
No results: Writing and preference, Factuality
8=
GPT-6 Sol OpenAI
68
85 76 63 30 58
$4.00
6 Oct 2026
Spring Prompt benches 85CatalogBench 91 · Reliably publish-ready 66.1%; Sales brief: reliably publish-ready 67.9% ROASBench 88 · Overall score 54.1 BulletBench 66 · Ladder Elo 445 (95% range 215–639) Agents and tool use 76Terminal-Bench (Artificial Analysis) 65 · Terminal-Bench 4.0 43.9% Vending-Bench 2 88 · Money after a year $14,428 Knowledge work 63APEX-Agents 27 · Tasks passed 54.3% GDP.pdf 67 · Professional document tasks 26.4% DeckBench 94 · Deck rating 1,456 (95% range 1,394–1,561) Writing and preference 30Arena text 30 · Overall 1,457 (95% range 1,450–1,464) UGI Leaderboard 30 · Writing score 55.6 Factuality 58Vectara Hallucination Leaderboard 100 · Hallucination rate 6.5% Arena factuality 20 · Overall 1,434 (95% range 1,428–1,440) SimpleQA Verified (Epoch AI) 54 · Correct answers 60.7%
8=
Kimi K3.1 Pro Moonshot AI Provisional · 3 of 5 groups
68
63 100 35 – –
$3.81
27 Oct 2026
Spring Prompt benches 63ROASBench 91 · Overall score 55.1 BulletBench 22 · Ladder Elo 147 (95% range 0–381) Agents and tool use 100Terminal-Bench (Artificial Analysis) 100 · Terminal-Bench 4.0 67.2% Knowledge work 35DeckBench 56 · Deck rating 1,204 (95% range 1,087–1,328) SurveyBench 13 · Analysis rating 609 (95% range 467–707)
No results: Writing and preference, Factuality
10=
Muse Ember Meta Provisional · 2 of 5 groups
65
65 – 66 – –
$0.20
10 Nov 2026
Spring Prompt benches 65CatalogBench 69 · Reliably publish-ready 53.6%; Sales brief: reliably publish-ready 35.7% ROASBench 78 · Overall score 51.8 BulletBench 38 · Ladder Elo 310 (95% range 0–595) Knowledge work 66DeckBench 53 · Deck rating 1,154 (95% range 1,070–1,246) SurveyBench 78 · Analysis rating 1,379 (95% range 1,317–1,478)
No results: Agents and tool use, Writing and preference, Factuality
10=
Gemini 4 Hydrogen Google Provisional · 2 of 5 groups
65
70 – 53 – –
$3.00
16 Nov 2026
Spring Prompt benches 70CatalogBench 73 · Reliably publish-ready 62.5%; Sales brief: reliably publish-ready 23.2% ROASBench 53 · Overall score 45.4 BulletBench 86 · Lightning 10+1: ladder Elo 557 (95% range 370–727); Bullet 60s: ladder Elo 889 (95% range 593–1,229) Knowledge work 53DeckBench 50 · Deck rating 1,131 (95% range 1,022–1,230) SurveyBench 57 · Analysis rating 1,116 (95% range 1,023–1,224)
No results: Agents and tool use, Writing and preference, Factuality
12
Claude Fable 5.1 Anthropic
64
46 74 80 65 80
$20.00
6 Oct 2026
Spring Prompt benches 46CatalogBench 30 · Reliably publish-ready 26.8%; Sales brief: reliably publish-ready 5.4% ROASBench 72 · Overall score 51.5 Agents and tool use 74Terminal-Bench (Artificial Analysis) 87 · Terminal-Bench 4.0 55.1%; Terminal-Bench 2.1 91.4% τ-bench banking (Artificial Analysis) 73 · Τ-bench banking 47.2% Vending-Bench 2 63 · Money after a year $5,422 Knowledge work 80APEX-Agents 82 · Tasks passed 68.6% GDP.pdf 89 · Professional document tasks 29.6% DeckBench 69 · Deck rating 1,265 (95% range 1,204–1,337) Writing and preference 65Arena text 90 · Overall 1,501 (95% range 1,495–1,508) UGI Leaderboard 40 · Writing score 63.9 Factuality 80Arena factuality 90 · Overall 1,500 (95% range 1,494–1,505) SimpleQA Verified (Epoch AI) 69 · Correct answers 70.8%
13
Claude Sonnet 5.5 Anthropic
61
45 96 92 40 42
$4.00
6 Oct 2026
Spring Prompt benches 45CatalogBench 40 · Reliably publish-ready 32.1%; Sales brief: reliably publish-ready 10.7% ROASBench 81 · Overall score 52.0 BulletBench 5 · Ladder Elo 33 (95% range 0–270) Agents and tool use 96Terminal-Bench (Artificial Analysis) 96 · Terminal-Bench 4.0 63.6% Knowledge work 92APEX-Agents 100 · Tasks passed 75.5% DeckBench 84 · Deck rating 1,332 (95% range 1,251–1,431) Writing and preference 40Arena text 40 · Overall 1,471 (95% range 1,461–1,481) Factuality 42Arena factuality 60 · Overall 1,470 (95% range 1,461–1,479) SimpleQA Verified (Epoch AI) 23 · Correct answers 46.5%
14
Muse Spark 1.3 Meta
59
33 78 49 80 85
$2.00
6 Oct 2026
Spring Prompt benches 33CatalogBench 49 · Reliably publish-ready 48.2%; Sales brief: reliably publish-ready 10.7% ROASBench 25 · Overall score 34.1 BulletBench 4 · Ladder Elo 33 (95% range 0–270) Agents and tool use 78Terminal-Bench (Artificial Analysis) 57 · Terminal-Bench 4.0 33.3%; Terminal-Bench 2.1 85.4% τ-bench banking (Artificial Analysis) 100 · Τ-bench banking 50.5% Knowledge work 49APEX-Agents 45 · Tasks passed 57.8% GDP.pdf 78 · Professional document tasks 27.6% DeckBench 25 · Deck rating 819 (95% range 754–866) Writing and preference 80Arena text 80 · Overall 1,494 (95% range 1,488–1,500) Factuality 85Arena factuality 85 · Overall 1,480 (95% range 1,475–1,485)
15
Gemini 3.8 Flash Google
58
49 47 44 93 71
$3.00
10 Nov 2026
Spring Prompt benches 49CatalogBench 33 · Reliably publish-ready 35.7%; Sales brief: reliably publish-ready 3.6% ROASBench 69 · Overall score 51.4 BulletBench 60 · Lightning 10+1: ladder Elo 197 (95% range 0–439); Bullet 60s: ladder Elo 1,068 (95% range 888–1,241) Agents and tool use 47Terminal-Bench (Artificial Analysis) 50 · Terminal-Bench 4.0 19.7%; Terminal-Bench 2.1 87.6% τ-bench banking (Artificial Analysis) 55 · Τ-bench banking 45.8% Vending-Bench 2 38 · Money after a year $5,094 Knowledge work 44APEX-Agents 64 · Tasks passed 64.3% GDP.pdf 56 · Professional document tasks 23.4% DeckBench 22 · Deck rating 788 (95% range 719–842) SurveyBench 35 · Analysis rating 875 (95% range 794–943) Writing and preference 93Arena text 85 · Overall 1,495 (95% range 1,490–1,500) UGI Leaderboard 100 · Writing score 78.6 Factuality 71Arena factuality 80 · Overall 1,477 (95% range 1,472–1,481) SimpleQA Verified (Epoch AI) 62 · Correct answers 69.7%
16
Qwen4-Max Alibaba Provisional · 2 of 5 groups
56
41 – 91 – –
$2.25
16 Nov 2026
Spring Prompt benches 41CatalogBench 39 · Reliably publish-ready 39.3%; Sales brief: reliably publish-ready 8.9% ROASBench 56 · Overall score 45.8 BulletBench 22 · Ladder Elo 147 (95% range 0–381) Knowledge work 91DeckBench 100 · Deck rating 1,585 (95% range 1,497–1,708) SurveyBench 83 · Analysis rating 1,395 (95% range 1,320–1,482)
No results: Agents and tool use, Writing and preference, Factuality
17
Gemini 4 Carbon Google Provisional · 2 of 5 groups
53
59 – 41 – –
$8.00
11 Nov 2026
Spring Prompt benches 59CatalogBench 57 · Reliably publish-ready 53.6%; Sales brief: reliably publish-ready 14.3% ROASBench 66 · Overall score 51.2 BulletBench 52 · Ladder Elo 358 (95% range 0–619) Knowledge work 41DeckBench 34 · Deck rating 1,004 (95% range 864–1,128) SurveyBench 48 · Analysis rating 1,073 (95% range 991–1,194)
No results: Agents and tool use, Writing and preference, Factuality
18
DeepSeek-V4.1-Flash DeepSeek
51
56 42 – 45 55
$0.52
30 Sep 2026
Spring Prompt benches 56CatalogBench 56 · Reliably publish-ready 41.1%; Sales brief: reliably publish-ready 23.2% Agents and tool use 42Terminal-Bench (Artificial Analysis) 42 · Terminal-Bench 4.0 26.8% Writing and preference 45Arena text 45 · Overall 1,474 (95% range 1,468–1,481) Factuality 55Arena factuality 55 · Overall 1,467 (95% range 1,461–1,473)
No results: Knowledge work
19
Kimi K3 Moonshot AI
47
33 50 33 75 61
$6.00
6 Oct 2026
Spring Prompt benches 33CatalogBench 34 · Reliably publish-ready 41.1%; Sales brief: reliably publish-ready 1.8% ROASBench 50 · Overall score 44.1 BulletBench 4 · Ladder Elo 33 (95% range 0–270) Agents and tool use 50Terminal-Bench (Artificial Analysis) 36 · Terminal-Bench 4.0 12.6%; Terminal-Bench 2.1 85.0% τ-bench banking (Artificial Analysis) 64 · Τ-bench banking 46.0% Vending-Bench 2 50 · Money after a year $5,165 Knowledge work 33APEX-Agents 18 · Tasks passed 50.6% GDP.pdf 22 · Professional document tasks 19.0% DeckBench 59 · Deck rating 1,205 (95% range 1,150–1,292) Writing and preference 75Arena text 75 · Overall 1,488 (95% range 1,484–1,493) Factuality 61Arena factuality 75 · Overall 1,472 (95% range 1,469–1,476) SimpleQA Verified (Epoch AI) 46 · Correct answers 50.6%
20
Gemini 3.1 Pro Preview Google
46
57 21 13 80 52
$4.50
8 Oct 2026
Spring Prompt benches 57CatalogBench 53 · Reliably publish-ready 44.6%; Sales brief: reliably publish-ready 16.1% ROASBench 47 · Overall score 43.5 BulletBench 80 · Ladder Elo 529 (95% range 329–698) Agents and tool use 21Terminal-Bench (Artificial Analysis) 24 · Terminal-Bench 4.0 4.0%; Terminal-Bench 2.1 73.8% τ-bench banking (Artificial Analysis) 27 · Τ-bench banking 21.4% Vending-Bench 2 13 · Money after a year $911.21 Knowledge work 13APEX-Agents 0 · Tasks passed 35.3% GDP.pdf 11 · Professional document tasks 17.0% DeckBench 16 · Deck rating 732 (95% range 652–799) SurveyBench 26 · Analysis rating 758 (95% range 700–814) Writing and preference 80Arena text 70 · Overall 1,487 (95% range 1,484–1,490) UGI Leaderboard 90 · Writing score 72.2 Factuality 52Vectara Hallucination Leaderboard 0 · Hallucination rate 10.4% Arena factuality 70 · Overall 1,472 (95% range 1,470–1,474) SimpleQA Verified (Epoch AI) 85 · Correct answers 73.5%
21
Qwen3.8-Max (0902) Alibaba
45
18 76 41 60 52
$3.00
6 Oct 2026
Spring Prompt benches 18CatalogBench 20 · Reliably publish-ready 28.6%; Sales brief: reliably publish-ready 0.0% ROASBench 16 · Overall score 25.4 Agents and tool use 76Terminal-Bench (Artificial Analysis) 70 · Terminal-Bench 4.0 38.9%; Terminal-Bench 2.1 88.8% τ-bench banking (Artificial Analysis) 82 · Τ-bench banking 47.8% Knowledge work 41GDP.pdf 44 · Professional document tasks 23.2% DeckBench 38 · Deck rating 1,035 (95% range 966–1,109) Writing and preference 60Arena text 60 · Overall 1,482 (95% range 1,476–1,487) Factuality 52Arena factuality 65 · Overall 1,472 (95% range 1,467–1,476) SimpleQA Verified (Epoch AI) 38 · Correct answers 47.3%
22
MiniMax M3.1 Flash MiniMax Provisional · 3 of 5 groups
42
48 37 38 – –
$0.26
4 Nov 2026
Spring Prompt benches 48CatalogBench 68 · Reliably publish-ready 50.0%; Sales brief: reliably publish-ready 37.5% ROASBench 38 · Overall score 40.3 BulletBench 12 · Ladder Elo 115 (95% range 0–485) Agents and tool use 37Terminal-Bench (Artificial Analysis) 37 · Terminal-Bench 4.0 25.8% Knowledge work 38DeckBench 75 · Deck rating 1,281 (95% range 1,204–1,369) SurveyBench 0 · Analysis rating 442 (95% range 267–579)
No results: Writing and preference, Factuality
23=
Grok 4.7 xAI
40
56 37 66 18 5
$3.00
6 Oct 2026
Spring Prompt benches 56CatalogBench 73 · Reliably publish-ready 57.1%; Sales brief: reliably publish-ready 33.9% ROASBench 28 · Overall score 36.6 Agents and tool use 37Terminal-Bench (Artificial Analysis) 37 · Terminal-Bench 4.0 25.8% Knowledge work 66DeckBench 66 · Deck rating 1,257 (95% range 1,182–1,341) Writing and preference 18Arena text 15 · Overall 1,442 (95% range 1,435–1,450) UGI Leaderboard 20 · Writing score 54.1 Factuality 5Arena factuality 5 · Overall 1,428 (95% range 1,421–1,435)
23=
Claude Haiku 5.5 Anthropic Provisional · 3 of 5 groups
40
27 46 60 – –
$0.20
8 Oct 2026
Spring Prompt benches 27CatalogBench 35 · Reliably publish-ready 26.8%; Sales brief: reliably publish-ready 10.7% ROASBench 6 · Overall score 24.1 BulletBench 38 · Ladder Elo 310 (95% range 0–575) Agents and tool use 46Terminal-Bench (Artificial Analysis) 46 · Terminal-Bench 4.0 32.8% Knowledge work 60DeckBench 47 · Deck rating 1,125 (95% range 1,059–1,197) SurveyBench 74 · Analysis rating 1,248 (95% range 1,212–1,298)
No results: Writing and preference, Factuality
25
GPT-6 Luna OpenAI
39
70 17 42 20 13
$0.20
10 Nov 2026
Spring Prompt benches 70CatalogBench 77 · Reliably publish-ready 55.4%; Sales brief: reliably publish-ready 51.8% ROASBench 84 · Overall score 53.4 BulletBench 32 · Ladder Elo 249 (95% range 0–453) Agents and tool use 17Terminal-Bench (Artificial Analysis) 17 · Terminal-Bench 4.0 12.6% Knowledge work 42APEX-Agents 9 · Tasks passed 44.3% GDP.pdf 33 · Professional document tasks 23.0% DeckBench 72 · Deck rating 1,267 (95% range 1,208–1,343) SurveyBench 52 · Analysis rating 1,093 (95% range 997–1,179) Writing and preference 20Arena text 20 · Overall 1,443 (95% range 1,436–1,449) Factuality 13Arena factuality 10 · Overall 1,430 (95% range 1,424–1,436) SimpleQA Verified (Epoch AI) 15 · Correct answers 41.4%
26
DeepSeek-V4.1-Flash-1017 DeepSeek Provisional · 3 of 5 groups
38
24 54 51 – –
$0.52
19 Oct 2026
Spring Prompt benches 24CatalogBench 15 · Reliably publish-ready 21.4%; Sales brief: reliably publish-ready 0.0% ROASBench 41 · Overall score 41.4 BulletBench 22 · Ladder Elo 147 (95% range 0–443) Agents and tool use 54Terminal-Bench (Artificial Analysis) 54 · Terminal-Bench 4.0 33.8% Knowledge work 51DeckBench 41 · Deck rating 1,062 (95% range 947–1,145) SurveyBench 61 · Analysis rating 1,138 (95% range 1,066–1,207)
No results: Writing and preference, Factuality
27
GLM-5.3 Z.ai
35
7 73 36 55 29
$2.15
1 Oct 2026
Spring Prompt benches 7ROASBench 9 · Overall score 24.8 BulletBench 4 · Ladder Elo 33 (95% range 0–270) Agents and tool use 73Terminal-Bench (Artificial Analysis) 53 · Terminal-Bench 4.0 41.9%; Terminal-Bench 2.1 83.9% τ-bench banking (Artificial Analysis) 91 · Τ-bench banking 50.3% Vending-Bench 2 75 · Money after a year $8,164 Knowledge work 36APEX-Agents 36 · Tasks passed 56.6% Writing and preference 55Arena text 55 · Overall 1,478 (95% range 1,473–1,484) Factuality 29Arena factuality 50 · Overall 1,467 (95% range 1,462–1,472) SimpleQA Verified (Epoch AI) 8 · Correct answers 41.0%
28
Mercury 3 Inception Provisional · 2 of 5 groups
34
40 – 20 – –
–
19 Oct 2026
Spring Prompt benches 40ROASBench 19 · Overall score 26.1 BulletBench 72 · Lightning 10+1: ladder Elo 555 (95% range 263–727); Bullet 60s: ladder Elo 491 (95% range 299–659) Knowledge work 20DeckBench 19 · Deck rating 745 (95% range 653–824) SurveyBench 22 · Analysis rating 742 (95% range 653–821)
No results: Agents and tool use, Writing and preference, Factuality
29
GLM-5.3 FlashX Legal Z.ai Provisional · 2 of 5 groups
31
29 – 36 – –
$0.59
4 Nov 2026
Spring Prompt benches 29CatalogBench 5 · Reliably publish-ready 0.0%; Sales brief: reliably publish-ready 0.0% ROASBench 59 · Overall score 46.2 BulletBench 46 · Lightning 10+1: ladder Elo 310 (95% range 0–641); Bullet 60s: ladder Elo 358 (95% range 0–600) Knowledge work 36DeckBench 28 · Deck rating 826 (95% range 683–936) SurveyBench 43 · Analysis rating 953 (95% range 876–1,062)
No results: Agents and tool use, Writing and preference, Factuality
30
Particle-1 Particle AI Provisional · 2 of 5 groups
30
19 – 54 – –
$0.16
4 Nov 2026
Spring Prompt benches 19CatalogBench 5 · Reliably publish-ready 0.0%; Sales brief: reliably publish-ready 0.0% ROASBench 44 · Overall score 43.3 Knowledge work 54DeckBench 44 · Deck rating 1,112 (95% range 996–1,216) SurveyBench 65 · Analysis rating 1,153 (95% range 1,077–1,249)
No results: Agents and tool use, Writing and preference, Factuality
31
DeepSeek-V4-Pro (0423) DeepSeek
28
22 29 0 48 47
$1.77
6 Oct 2026
Spring Prompt benches 22ROASBench 22 · Overall score 28.3 Agents and tool use 29Terminal-Bench (Artificial Analysis) 25 · Terminal-Bench 4.0 14.6%; Terminal-Bench 2.1 64.8% τ-bench banking (Artificial Analysis) 36 · Τ-bench banking 30.1% Vending-Bench 2 25 · Money after a year $3,285 Knowledge work 0DeckBench 0 · Deck rating 542 (95% range 408–625) Writing and preference 48Arena text 35 · Overall 1,458 (95% range 1,454–1,462) UGI Leaderboard 60 · Writing score 68.4 Factuality 47Vectara Hallucination Leaderboard 75 · Hallucination rate 8.6% Arena factuality 35 · Overall 1,455 (95% range 1,452–1,458) SimpleQA Verified (Epoch AI) 31 · Correct answers 47.0%
32=
Mistral Large 4 Mistral AI Provisional · 3 of 5 groups
25
24 31 18 – –
$2.06
8 Oct 2026
Spring Prompt benches 24CatalogBench 17 · Reliably publish-ready 10.7%; Sales brief: reliably publish-ready 1.8% ROASBench 31 · Overall score 37.0 BulletBench 30 · Ladder Elo 249 (95% range 0–486) Agents and tool use 31Terminal-Bench (Artificial Analysis) 31 · Terminal-Bench 4.0 24.7% Knowledge work 18DeckBench 6 · Deck rating 608 (95% range 488–703) SurveyBench 30 · Analysis rating 785 (95% range 730–834)
No results: Writing and preference, Factuality
32=
Gemini 3.5 Flash-Lite Google
25
34 16 9 25 30
$0.85
8 Oct 2026
Spring Prompt benches 34CatalogBench 23 · Reliably publish-ready 17.9%; Sales brief: reliably publish-ready 3.6% ROASBench 13 · Overall score 25.4 BulletBench 94 · Lightning 10+1: ladder Elo 892 (95% range 641–1,081); Bullet 60s: ladder Elo 780 (95% range 586–956) Agents and tool use 16Terminal-Bench (Artificial Analysis) 13 · Terminal-Bench 4.0 1.0%; Terminal-Bench 2.1 53.6% τ-bench banking (Artificial Analysis) 18 · Τ-bench banking 17.5% Knowledge work 9GDP.pdf 0 · Professional document tasks 10.0% DeckBench 9 · Deck rating 618 (95% range 514–707) SurveyBench 17 · Analysis rating 647 (95% range 584–694) Writing and preference 25Arena text 25 · Overall 1,455 (95% range 1,450–1,459) Factuality 30Arena factuality 30 · Overall 1,447 (95% range 1,444–1,451)
34
Mistral Medium 3.5 Mistral AI
15
30 7 6 3 15
$3.00
8 Oct 2026
Spring Prompt benches 30CatalogBench 31 · Reliably publish-ready 17.9%; Sales brief: reliably publish-ready 10.7% ROASBench 0 · Overall score 15.2 BulletBench 72 · Lightning 10+1: ladder Elo 529 (95% range 361–669); Bullet 60s: ladder Elo 572 (95% range 428–708) Agents and tool use 7Terminal-Bench (Artificial Analysis) 6 · Terminal-Bench 4.0 0.0%; Terminal-Bench 2.1 50.6% τ-bench banking (Artificial Analysis) 9 · Τ-bench banking 15.1% Knowledge work 6DeckBench 3 · Deck rating 598 (95% range 501–674) SurveyBench 9 · Analysis rating 587 (95% range 497–652) Writing and preference 3Arena text 5 · Overall 1,427 (95% range 1,421–1,433) UGI Leaderboard 0 · Writing score 45.5 Factuality 15Arena factuality 15 · Overall 1,431 (95% range 1,425–1,436)
35
GLM-5V-Turbo Z.ai Provisional · 3 of 5 groups
12
8 – – 10 25
$1.90
30 Sep 2026
Spring Prompt benches 8CatalogBench 8 · Reliably publish-ready 1.8%; Sales brief: reliably publish-ready 0.0% Writing and preference 10Arena text 10 · Overall 1,433 (95% range 1,427–1,440) Factuality 25Arena factuality 25 · Overall 1,440 (95% range 1,435–1,446)
No results: Agents and tool use, Knowledge work
36
Claude Haiku 4.5 Anthropic
8
12 0 8 5 8
$2.00
8 Oct 2026
Spring Prompt benches 12CatalogBench 8 · Reliably publish-ready 1.8%; Sales brief: reliably publish-ready 0.0% ROASBench 3 · Overall score 17.5 BulletBench 36 · Lightning 10+1: ladder Elo 33 (95% range 0–248); Bullet 60s: ladder Elo 445 (95% range 135–626) Agents and tool use 0Terminal-Bench (Artificial Analysis) 1 · Terminal-Bench 4.0 0.0%; Terminal-Bench 2.1 44.2% τ-bench banking (Artificial Analysis) 0 · Τ-bench banking 9.3% Vending-Bench 2 0 · Money after a year $458.89 Knowledge work 8DeckBench 13 · Deck rating 658 (95% range 564–734) SurveyBench 4 · Analysis rating 569 (95% range 498–621) Writing and preference 5Arena text 0 · Overall 1,414 (95% range 1,411–1,416) UGI Leaderboard 10 · Writing score 52.2 Factuality 8Vectara Hallucination Leaderboard 25 · Hallucination rate 9.8% Arena factuality 0 · Overall 1,418 (95% range 1,416–1,420) SimpleQA Verified (Epoch AI) 0 · Correct answers 13.2%