Benchmarks / Artificial Analysis

Reported by Artificial Analysis

Artificial Analysis

Artificial Analysis's blend of its coding evaluations.

Last updated 9 Nov 2026

Results dated
20 Oct 2026
Results
187 configurations of 130 models
Unit
index score
Licence
Artificial Analysis commercial data licence

Artificial Analysis in brief

What it measures. Artificial Analysis is a third-party benchmark, shown here with credit. Measured here: Artificial Analysis's blend of its coding evaluations.

Latest results. , 187 configurations ranked.

Top 3 on Artificial Analysis Coding Index (index score, higher is better):

  1. Claude Fable 5.1 (max reasoning) (Anthropic): 81.6
  2. Claude Fable 5.1 (extra-high reasoning) (Anthropic): 80.7
  3. Claude Fable 5.1 (high reasoning) (Anthropic): 79.1

How to cite. Artificial Analysis, via Spring Prompt, results dated 20 October 2026. https://springprompt.com/benchmarks/artificial-analysis These results belong to Artificial Analysis, not to us. Licence: Artificial Analysis commercial data licence. Credit Artificial Analysis first.

Artificial Analysis Coding Index: GLM-4.7

Top 15 of 187 results · index score, higher is better. Choose a model to highlight it.Clear highlight

  1. 1 Claude Fable 5.1 (max reasoning)Anthropic 81.6
  2. 2 Claude Fable 5.1 (extra-high reasoning)Anthropic 80.7
  3. 3 Claude Fable 5.1 (high reasoning)Anthropic 79.1
  4. 4 GPT-5.6 Sol (extra-high reasoning)OpenAI 78.3
  5. 5 Claude Opus 5 (max reasoning)Anthropic 78.0
  6. 6 GPT-5.6 Sol (max reasoning)OpenAI 77.4
  7. 7 GPT-5.6 Sol (high reasoning)OpenAI 77.2
  8. 8 Claude Fable 5.1 (medium reasoning)Anthropic 77.1
  9. 8 GPT-6 Astra (high reasoning)OpenAI 77.1
  10. 10 Claude Opus 5 (extra-high reasoning)Anthropic 77.0
  11. 11 GPT-6 Astra (max reasoning)OpenAI 76.9
  12. 12 Grok 4.6 (high reasoning)xAI 76.8
  13. 13 GPT-5.6 Terra (max reasoning)OpenAI 76.7
  14. 13 GPT-6 Astra (medium reasoning)OpenAI 76.7
  15. 15 Claude Fable 5 (max reasoning)Anthropic 76.5
  16. 110 GLM-4.7Z.ai 45.3

Full results

Artificial Analysis: Artificial Analysis Coding Index, index score, higher is better
#ModelArtificial Analysis Coding Index
index score, higher is better
Price
$ per million tokens, in / out
1 Claude Fable 5.1 (max reasoning)Anthropic
81.6
$10 / $50
2 Claude Fable 5.1 (extra-high reasoning)Anthropic
80.7
$10 / $50
3 Claude Fable 5.1 (high reasoning)Anthropic
79.1
$10 / $50
4 GPT-5.6 Sol (extra-high reasoning)OpenAI
78.3
$4 / $20
5 Claude Opus 5 (max reasoning)Anthropic
78.0
$5 / $25
6 GPT-5.6 Sol (max reasoning)OpenAI
77.4
$4 / $20
7 GPT-5.6 Sol (high reasoning)OpenAI
77.2
$4 / $20
8 Claude Fable 5.1 (medium reasoning)Anthropic
77.1
$10 / $50
8 GPT-6 Astra (high reasoning)OpenAI
77.1
$10 / $50
10 Claude Opus 5 (extra-high reasoning)Anthropic
77.0
$5 / $25
11 GPT-6 Astra (max reasoning)OpenAI
76.9
$10 / $50
12 Grok 4.6 (high reasoning)xAI
76.8
$2 / $6
13 GPT-5.6 Terra (max reasoning)OpenAI
76.7
$2 / $12
13 GPT-6 Astra (medium reasoning)OpenAI
76.7
$10 / $50
15 Claude Fable 5 (max reasoning)Anthropic
76.5
$10 / $50
15 Claude Opus 5 (high reasoning)Anthropic
76.5
$5 / $25
15 Muse Spark 1.3 (extra-high reasoning)Meta
76.5
$1.25 / $4.25
18 Gemini 3.8 Flash (high reasoning)Google
76.3
$1.50 / $7.50
18 GPT-5.6 Sol (medium reasoning)OpenAI
76.3
$4 / $20
20 Qwen3.8-Max (0902)Alibaba
76.2
$2 / $6
20 Kimi K3 (max reasoning)Moonshot AI
76.2
$3 / $15
22 Gemini 3.7 Flash (high reasoning)Google
76.1
$1.50 / $7.50
23 GPT-6 Astra (extra-high reasoning)OpenAI
75.9
$10 / $50
23 Grok 4.6 (extra-high reasoning)xAI
75.9
$2 / $6
25 Muse Spark 1.3 (max reasoning)Meta
75.8
$1.25 / $4.25
26 GPT-6 Astra (low reasoning)OpenAI
75.7
$10 / $50
27 Claude Fable 5.1 (low reasoning)Anthropic
75.2
$10 / $50
28 GPT-5.5 (extra-high reasoning)OpenAI
74.9
$5 / $30
29 GLM-5.3 (max reasoning)Z.ai
74.8
$1.40 / $4.40
30 Grok 4.6 (medium reasoning)xAI
74.4
$2 / $6
31 Claude Opus 4.8 (max reasoning)Anthropic
74.3
$5 / $25
31 Claude Opus 5 (medium reasoning)Anthropic
74.3
$5 / $25
33 Gemini 3.8 Flash (medium reasoning)Google
74.1
$1.50 / $7.50
34 Claude Opus 4.7 (max reasoning)Anthropic
73.6
$5 / $25
35 Gemini 3.8 Flash (low reasoning)Google
73.5
$1.50 / $7.50
36 Qwen3.8-Flash-NextAlibaba
73.1
–
37 Grok 4.5 (high reasoning)xAI
72.4
$2 / $6
38 Muse Spark 1.2 (extra-high reasoning)Meta
72.2
$1.25 / $4.25
39 Kimi K3 (low reasoning)Moonshot AI
72.0
$3 / $15
40 Qwen3.8-2.4T-A95BAlibaba
71.9
$2 / $6
41 Qwen3.8-Max (0803)Alibaba
71.8
–
42 GPT-5.5 (high reasoning)OpenAI
71.6
$5 / $30
43 Claude Sonnet 5 (max reasoning)Anthropic
71.5
$2 / $10
43 Gemini 3.7 Flash (medium reasoning)Google
71.5
$1.50 / $7.50
43 GPT-5.5 (medium reasoning)OpenAI
71.5
$5 / $30
43 GLM-5.3-FlashZ.ai
71.5
$0.15 / $0.50
47 GPT-5.6 Luna (max reasoning)OpenAI
71.4
$0.20 / $1.20
48 Muse Spark 1.1 (extra-high reasoning)Meta
71.3
$1.25 / $4.25
49 GPT-5.4 (extra-high reasoning)OpenAI
71.1
$2.50 / $15
50 Gemini 3.7 Flash (low reasoning)Google
71.0
$1.50 / $7.50
51 GPT-5.6 Terra (extra-high reasoning)OpenAI
70.6
$2 / $12
52 Gemini 3.5 Flash (high reasoning)Google
70.1
$1.50 / $9
53 GPT-5.6 Sol (low reasoning)OpenAI
69.7
$4 / $20
54 Gemini 3.6 Flash (high reasoning)Google
69.2
$1.50 / $7.50
55 DeepSeek-V4-Flash (0731, max reasoning)DeepSeek
69.1
$0.13 / $0.40
56 DeepSeek-V4-Pro (0813, max reasoning)DeepSeek
68.8
$1.32 / $3.96
56 Gemini 3.1 Pro PreviewGoogle
68.8
$2 / $12
56 GLM-5.2 (max reasoning)Z.ai
68.8
$1.40 / $4.40
59 GPT-5.6 Luna (extra-high reasoning)OpenAI
68.6
$0.20 / $1.20
60 Qwen3.8-27B (extra-high reasoning)Alibaba
68.1
$0.50 / $3
61 GPT-5.6 Terra (high reasoning)OpenAI
67.1
$2 / $12
62 Claude Opus 5 (low reasoning)Anthropic
66.9
$5 / $25
63 Claude Sonnet 5 (no reasoning)Anthropic
66.4
$2 / $10
64 Grok 4.6 (low reasoning)xAI
66.3
$2 / $6
65 Qwen3.7-MaxAlibaba
66.0
$1.48 / $4.42
66 GPT-5.6 Sol (no reasoning)OpenAI
65.1
$4 / $20
67 DeepSeek-V4-Flash-Vision-Exp (max reasoning)DeepSeek
65.0
$0.22 / $0.65
68 GPT-5.6 Terra (medium reasoning)OpenAI
64.7
$2 / $12
69 GPT-5.6 Luna (high reasoning)OpenAI
63.3
$0.20 / $1.20
70 Claude Sonnet 4.6 (max reasoning)Anthropic
63.0
$3 / $15
71 Kimi K2.6Moonshot AI
61.8
$0.95 / $4
72 GPT-5.5 (low reasoning)OpenAI
60.9
$5 / $30
73 Kimi K2.7 CodeMoonshot AI
60.8
$0.95 / $4
74 MiMo-V2.5-Pro (reasoning on)Xiaomi
60.2
$0.43 / $0.87
75 DeepSeek-V4-Pro (0423, max reasoning)DeepSeek
59.4
$1.42 / $2.83
76 Hy3Tencent
58.8
$0.14 / $0.58
77 DeepSeek-V4-Pro (0423, high reasoning)DeepSeek
58.7
$1.42 / $2.83
78 Muse SparkMeta
58.6
–
78 MiniMax-M3MiniMax
58.6
$0.30 / $1.20
80 Qwen3.8-27B (low reasoning)Alibaba
58.2
$0.50 / $3
81 GPT-5.6 Terra (low reasoning)OpenAI
58.1
$2 / $12
82 MiMo-V2.5Xiaomi
56.8
$0.40 / $2
83 GPT-5.5 (no reasoning)OpenAI
56.5
$5 / $30
84 DeepSeek-V4-Flash (0423, max reasoning)DeepSeek
56.2
$0.05 / $0.45
85 Qwen3.8-27B (medium reasoning)Alibaba
56.1
$0.50 / $3
85 GPT-5.4 mini (extra-high reasoning)OpenAI
56.1
$0.75 / $4.50
85 GPT-5.4 nano (extra-high reasoning)OpenAI
56.1
$0.20 / $1.25
88 Qwen3.7-PlusAlibaba
55.9
$0.32 / $1.28
89 GLM-5.1Z.ai
55.8
$1.33 / $4.18
90 Qwen3.6-PlusAlibaba
54.5
$0.33 / $1.95
91 Qwen3.6-27BAlibaba
53.7
$0.30 / $3.20
92 Inkling SmallThinking Machines
52.9
$0.45 / $1.20
93 MiniMax-M2.7MiniMax
52.6
$0.30 / $1.20
94 GPT-5.6 Terra (no reasoning)OpenAI
52.3
$2 / $12
95 Claude Sonnet 4.5 (reasoning on)Anthropic
52.1
$3 / $15
95 Inkling (extra-high reasoning)Thinking Machines
52.1
$1 / $4.05
97 DeepSeek-V4-Flash (0423, high reasoning)DeepSeek
52.0
$0.05 / $0.45
98 Grok Build 0.1xAI
51.5
$1 / $2
99 GPT-5.6 Luna (medium reasoning)OpenAI
50.7
$0.20 / $1.20
100 GPT-5.1 (high reasoning)OpenAI
49.4
$1.25 / $10
101 Gemini 3.5 Flash-LiteGoogle
49.3
$0.30 / $2.50
102 Muse Glimmer (high reasoning)Meta
49.0
–
103 Qwen3.5-397B-A17BAlibaba
48.2
$0.55 / $3.50
104 Mistral Medium 3.5Mistral AI
46.9
$1.50 / $7.50
105 Kimi K2.5Moonshot AI
46.8
$0.57 / $2.85
106 Qwen3.6-27B (no reasoning)Alibaba
46.6
$0.30 / $3.20
107 GLM-5.2 (no reasoning)Z.ai
46.5
$1.40 / $4.40
108 GLM-4.6 (reasoning on)Z.ai
45.8
$0.50 / $2
109 Qwen3.5-122B-A10BAlibaba
45.7
$0.26 / $2.08
110 GLM-4.7Z.ai
45.3
$0.60 / $2.20
111 Qwen3.8-27B (no reasoning)Alibaba
44.6
$0.50 / $3
112 DeepSeek-V3.2 (reasoning on)DeepSeek
44.2
$0.28 / $0.42
112 GPT-5.6 Luna (low reasoning)OpenAI
44.2
$0.20 / $1.20
114 Claude Haiku 4.5 (reasoning on)Anthropic
43.9
$1 / $5
115 DeepSeek-V3.1-Terminus (reasoning on)DeepSeek
43.5
$0.27 / $1
116 Gemma 4 31BGoogle
43.4
$0.15 / $0.40
117 Qwen3.5-122B-A10B (no reasoning)Alibaba
43.3
$0.26 / $2.08
118 Grok 4.3 (high reasoning)xAI
42.2
$1.25 / $2.50
119 Qwen3.6-35B-A3BAlibaba
41.9
$0.10 / $0.95
120 o1OpenAI
39.7
–
121 GPT-5.5 Instant (2026-06-26)OpenAI
39.4
–
122 Gemma 4 26B A4BGoogle
39.3
$0.09 / $0.30
122 GPT-5.6 Luna (no reasoning)OpenAI
39.3
$0.20 / $1.20
124 GPT-5 (high reasoning)OpenAI
37.8
$1.25 / $10
125 Nemotron 3 Super 120B A12BNVIDIA
37.7
$0.08 / $0.45
126 Claude Sonnet 4 (reasoning on)Anthropic
37.6
–
127 Qwen3.5-35B-A3B (no reasoning)Alibaba
37.0
$0.15 / $1
128 Qwen3-Coder-NextAlibaba
36.2
$0.12 / $0.80
129 Grok 4.3 (no reasoning)xAI
35.2
$1.25 / $2.50
130 Gemini 3.1 Flash-Lite PreviewGoogle
34.7
$0.25 / $1.50
131 Gemini 2.5 ProGoogle
33.3
$1.25 / $10
132 Gemma 4 31B (no reasoning)Google
33.2
$0.15 / $0.40
133 Devstral 2Mistral AI
31.3
$0.40 / $2
134 Mercury 2Inception
31.1
–
135 Gemma 4 12BGoogle
31.0
–
136 gpt-oss-120b (high reasoning)OpenAI
30.4
$0.10 / $0.50
137 Devstral Small 2Mistral AI
29.3
–
138 Qwen3.5-9BAlibaba
28.7
$0.10 / $0.15
139 Qwen3.6-35B-A3B (no reasoning)Alibaba
28.1
$0.10 / $0.95
140 Mistral Small 4Mistral AI
26.6
$0.15 / $0.60
141 Mistral Small 3.1 24BMistral AI
26.3
$0.35 / $0.56
142 Trinity Large ThinkingArcee AI
25.8
–
143 DeepSeek-R1DeepSeek
24.6
–
144 GPT-4o (2024-05-13)OpenAI
24.2
$5 / $15
145 Qwen3.5-9B (no reasoning)Alibaba
23.5
$0.10 / $0.15
146 Nova 2 Lite (high reasoning)Amazon
23.0
$0.30 / $2.50
146 DeepSeek-V3DeepSeek
23.0
$0.26 / $1.03
148 Qwen3.5-4B (reasoning on)Alibaba
22.6
–
149 Granite 4.2 8BIBM
22.4
$0.06 / $0.15
150 Qwen3-235B-A22B-Thinking-2507Alibaba
22.1
$0.45 / $3.50
151 Magistral Medium 1.2Mistral AI
21.3
–
152 DeepSeek-V3-0324DeepSeek
21.2
$0.25 / $1
152 gpt-oss-120b (low reasoning)OpenAI
21.2
$0.10 / $0.50
154 gpt-oss-20b (high reasoning)OpenAI
20.7
$0.03 / $0.14
155 Mistral Medium 3.1Mistral AI
20.5
$0.40 / $2
156 Qwen3.5-4B (no reasoning)Alibaba
20.3
–
157 GPT-4.1 miniOpenAI
20.2
$0.40 / $1.60
158 Mistral Large 3Mistral AI
20.1
$0.50 / $1.50
159 DiffusionGemma 26B A4BGoogle
19.7
–
160 Qwen3-Next-80B-A3B-ThinkingAlibaba
17.4
–
161 Llama 4 MaverickMeta
16.3
$0.35 / $1
161 o3-mini (high reasoning)OpenAI
16.3
–
163 Solar Pro 3Upstage
16.2
–
164 GPT-5 mini (high reasoning)OpenAI
15.6
$0.25 / $2
165 Qwen3-32B (reasoning on)Alibaba
15.3
$0.14 / $0.40
166 Magistral Small 1.2Mistral AI
14.7
–
167 Ministral 3 14BMistral AI
14.4
$0.20 / $0.20
167 Nemotron 3 Nano 30B A3B (reasoning on)NVIDIA
14.4
$0.06 / $0.24
169 Qwen3-14B (reasoning on)Alibaba
13.8
$0.10 / $0.22
170 Mistral Small 3.2 24BMistral AI
12.5
$0.094 / $0.25
171 Qwen3-30B-A3B-Thinking-2507Alibaba
12.1
–
172 Llama 3.3 70B InstructMeta
11.9
$0.71 / $0.71
173 GPT-4o mini (2024-07-18)OpenAI
11.4
$0.15 / $0.60
174 GPT-4.1 nanoOpenAI
11.1
$0.10 / $0.40
175 Gemma 3 27BGoogle
10.1
$0.08 / $0.35
176 Ministral 3 8BMistral AI
9.7
$0.15 / $0.15
177 Qwen3-8B (reasoning on)Alibaba
9.0
–
178 Llama 4 ScoutMeta
8.2
$0.10 / $0.30
179 Gemma 4 E2BGoogle
7.2
–
180 Gemma 3 12BGoogle
5.8
$0.05 / $0.15
181 Llama 3.1 8B InstructMeta
5.4
$0.05 / $0.08
182 Ministral 3 3BMistral AI
4.8
$0.10 / $0.10
183 Qwen3.5-2B (reasoning on)Alibaba
2.9
–
184 Gemma 3 4BGoogle
2.7
$0.04 / $0.05
185 Qwen3.5-2B (no reasoning)Alibaba
2.4
–
186 Qwen3.5-0.8B (no reasoning)Alibaba
1.2
–
187 Qwen3.5-0.8B (reasoning on)Alibaba
0.0
–

Swipe the table sideways for more columns.

Source: Artificial Analysis, via Spring Prompt, springprompt.com/benchmarks/artificial-analysis. Test your own prompt on these models →

Ranks follow the score as shown, so equal numbers share a rank. Results as published by Artificial Analysis; we do not re-run them.

Progress over time

Artificial Analysis Coding Index, plotted at each model's release date, higher is better. Each model counts once, at its best setting. Scores are today's, not launch day's. Hover or tap a mark for its model.

Best score so far

Every model at its release date. The line moves each time a new release beats every earlier one, and each new best is named where there is room.

050100 Jul 20242025Jul2026Jul GPT-4o (2024-05-13)o1DeepSeek-V3.1-TerminusClaude Sonnet 4.5Claude Sonnet 4.6Gemini 3.1 Pro PreviewGPT-5.4Claude Fable 5GPT-5.6 SolClaude Fable 5.1

Best score by lab

Each lab's best so far, stepping whenever one of its releases beats its own earlier models. The 6 labs with the best scores today; 14 others not drawn.

AnthropicOpenAIxAIMetaGoogleAlibaba

020406080100 Jul 20242025Jul2026Jul AnthropicOpenAIxAIMetaGoogleAlibaba

What it measures

Artificial Analysis's blend of its coding evaluations.

What it does not measure

Not your codebase or tools.

291 results from Artificial Analysis not ranked here · show why

We rank a result only when we can tie it to a specific model you can use. These are left out:

  • Not on sale through the API providers we track: 276
  • A different snapshot or variant from the model we list: 14
  • An unusual combination of settings: 1

Data sourced from Artificial Analysis. Licence: Artificial Analysis commercial data licence.