Benchmarks / Artificial Analysis

Reported by Artificial Analysis

Artificial Analysis

Artificial Analysis's blend of its coding evaluations.

Last updated 8 Oct 2026

Results dated
8 Oct 2026
Results
188 configurations of 131 models
Unit
index score
Licence
Artificial Analysis commercial data licence

Artificial Analysis Coding Index: Qwen3.5-0.8B

Top 16 of 188 results · index score, higher is better. Choose a model to highlight it.Clear highlight

  1. 1 Claude Fable 5.1 (max reasoning)Anthropic 81.6
  2. 2 Claude Fable 5.1 (extra-high reasoning)Anthropic 80.7
  3. 3 Claude Fable 5.1 (high reasoning)Anthropic 79.1
  4. 4 GPT-5.6 Sol (extra-high reasoning)OpenAI 78.3
  5. 5 Claude Opus 5 (max reasoning)Anthropic 78.0
  6. 6 GPT-5.6 Sol (max reasoning)OpenAI 77.4
  7. 7 GPT-5.6 Sol (high reasoning)OpenAI 77.2
  8. 8 Claude Fable 5.1 (medium reasoning)Anthropic 77.1
  9. 8 GPT-6 Astra (high reasoning)OpenAI 77.1
  10. 10 Claude Opus 5 (extra-high reasoning)Anthropic 77.0
  11. 11 GPT-6 Astra (max reasoning)OpenAI 76.9
  12. 12 Grok 4.6 (high reasoning)xAI 76.8
  13. 13 GPT-5.6 Terra (max reasoning)OpenAI 76.7
  14. 13 GPT-6 Astra (medium reasoning)OpenAI 76.7
  15. 15 Claude Fable 5 (max reasoning)Anthropic 76.5
  16. 187 Qwen3.5-0.8B (no reasoning)Alibaba 1.2
  17. 188 Qwen3.5-0.8B (reasoning on)Alibaba 0.0

Full results

Artificial Analysis: Artificial Analysis Coding Index, index score, higher is better
#ModelArtificial Analysis Coding Index
index score, higher is better		Price
$ per million tokens, in / out
1 Claude Fable 5.1 (max reasoning)Anthropic
81.6
$10 / $50
2 Claude Fable 5.1 (extra-high reasoning)Anthropic
80.7
$10 / $50
3 Claude Fable 5.1 (high reasoning)Anthropic
79.1
$10 / $50
4 GPT-5.6 Sol (extra-high reasoning)OpenAI
78.3
$4 / $20
5 Claude Opus 5 (max reasoning)Anthropic
78.0
$5 / $25
6 GPT-5.6 Sol (max reasoning)OpenAI
77.4
$4 / $20
7 GPT-5.6 Sol (high reasoning)OpenAI
77.2
$4 / $20
8 Claude Fable 5.1 (medium reasoning)Anthropic
77.1
$10 / $50
8 GPT-6 Astra (high reasoning)OpenAI
77.1
$10 / $50
10 Claude Opus 5 (extra-high reasoning)Anthropic
77.0
$5 / $25
11 GPT-6 Astra (max reasoning)OpenAI
76.9
$10 / $50
12 Grok 4.6 (high reasoning)xAI
76.8
$2 / $6
13 GPT-5.6 Terra (max reasoning)OpenAI
76.7
$2 / $12
13 GPT-6 Astra (medium reasoning)OpenAI
76.7
$10 / $50
15 Claude Fable 5 (max reasoning)Anthropic
76.5
$10 / $50
15 Claude Opus 5 (high reasoning)Anthropic
76.5
$5 / $25
15 Muse Spark 1.3 (extra-high reasoning)Meta
76.5
$1.25 / $4.25
18 Gemini 3.8 Flash (high reasoning)Google
76.3
$1.50 / $7.50
18 GPT-5.6 Sol (medium reasoning)OpenAI
76.3
$4 / $20
20 Qwen3.8-Max (0902)Alibaba
76.2
$2 / $6
20 Kimi K3 (max reasoning)Moonshot AI
76.2
$3 / $15
22 Gemini 3.7 Flash (high reasoning)Google
76.1
$1.50 / $7.50
23 GPT-6 Astra (extra-high reasoning)OpenAI
75.9
$10 / $50
23 Grok 4.6 (extra-high reasoning)xAI
75.9
$2 / $6
25 Muse Spark 1.3 (max reasoning)Meta
75.8
$1.25 / $4.25
26 GPT-6 Astra (low reasoning)OpenAI
75.7
$10 / $50
27 Claude Fable 5.1 (low reasoning)Anthropic
75.2
$10 / $50
28 GPT-5.5 (extra-high reasoning)OpenAI
74.9
$5 / $30
29 GLM-5.3 (max reasoning)Z.ai
74.8
$1.40 / $4.40
30 Grok 4.6 (medium reasoning)xAI
74.4
$2 / $6
31 Claude Opus 4.8 (max reasoning)Anthropic
74.3
$5 / $25
31 Claude Opus 5 (medium reasoning)Anthropic
74.3
$5 / $25
33 Gemini 3.8 Flash (medium reasoning)Google
74.1
$1.50 / $7.50
34 Claude Opus 4.7 (max reasoning)Anthropic
73.6
$5 / $25
35 Gemini 3.8 Flash (low reasoning)Google
73.5
$1.50 / $7.50
36 Qwen3.8-Flash-NextAlibaba
73.1
–
37 Grok 4.5 (high reasoning)xAI
72.4
$2 / $6
38 Muse Spark 1.2 (extra-high reasoning)Meta
72.2
$1.25 / $4.25
39 Kimi K3 (low reasoning)Moonshot AI
72.0
$3 / $15
40 Qwen3.8-2.4T-A95BAlibaba
71.9
$2 / $6
41 Qwen3.8-Max (0803)Alibaba
71.8
–
42 GPT-5.5 (high reasoning)OpenAI
71.6
$5 / $30
43 Claude Sonnet 5 (max reasoning)Anthropic
71.5
$2 / $10
43 Gemini 3.7 Flash (medium reasoning)Google
71.5
$1.50 / $7.50
43 GPT-5.5 (medium reasoning)OpenAI
71.5
$5 / $30
43 GLM-5.3-FlashZ.ai
71.5
$0.15 / $0.50
47 GPT-5.6 Luna (max reasoning)OpenAI
71.4
$0.20 / $1.20
48 Muse Spark 1.1 (extra-high reasoning)Meta
71.3
$1.25 / $4.25
49 GPT-5.4 (extra-high reasoning)OpenAI
71.1
$2.50 / $15
50 Gemini 3.7 Flash (low reasoning)Google
71.0
$1.50 / $7.50
51 GPT-5.6 Terra (extra-high reasoning)OpenAI
70.6
$2 / $12
52 Gemini 3.5 Flash (high reasoning)Google
70.1
$1.50 / $9
53 GPT-5.6 Sol (low reasoning)OpenAI
69.7
$4 / $20
54 Gemini 3.6 Flash (high reasoning)Google
69.2
$1.50 / $7.50
55 DeepSeek-V4-Flash (0731, max reasoning)DeepSeek
69.1
$0.14 / $0.28
56 DeepSeek-V4-Pro (0813, max reasoning)DeepSeek
68.8
$1.32 / $3.96
56 Gemini 3.1 Pro PreviewGoogle
68.8
$2 / $12
56 GLM-5.2 (max reasoning)Z.ai
68.8
$1.40 / $4.40
59 GPT-5.6 Luna (extra-high reasoning)OpenAI
68.6
$0.20 / $1.20
60 Qwen3.8-27B (extra-high reasoning)Alibaba
68.1
$0.50 / $3
61 GPT-5.6 Terra (high reasoning)OpenAI
67.1
$2 / $12
62 Claude Opus 5 (low reasoning)Anthropic
66.9
$5 / $25
63 Claude Sonnet 5 (no reasoning)Anthropic
66.4
$2 / $10
64 Grok 4.6 (low reasoning)xAI
66.3
$2 / $6
65 Qwen3.7-MaxAlibaba
66.0
$1.48 / $4.42
66 GPT-5.6 Sol (no reasoning)OpenAI
65.1
$4 / $20
67 DeepSeek-V4-Flash-Vision-Exp (max reasoning)DeepSeek
65.0
$0.44 / $1.32
68 GPT-5.6 Terra (medium reasoning)OpenAI
64.7
$2 / $12
69 GPT-5.6 Luna (high reasoning)OpenAI
63.3
$0.20 / $1.20
70 Claude Sonnet 4.6 (max reasoning)Anthropic
63.0
$3 / $15
71 Kimi K2.6Moonshot AI
61.8
$0.95 / $4
72 GPT-5.5 (low reasoning)OpenAI
60.9
$5 / $30
73 Kimi K2.7 CodeMoonshot AI
60.8
$0.95 / $4
74 MiMo-V2.5-Pro (reasoning on)Xiaomi
60.2
$0.43 / $0.87
75 DeepSeek-V4-Pro (0423, max reasoning)DeepSeek
59.4
$1.42 / $2.83
76 Hy3Tencent
58.8
$0.14 / $0.58
77 DeepSeek-V4-Pro (0423, high reasoning)DeepSeek
58.7
$1.42 / $2.83
78 Muse SparkMeta
58.6
–
78 MiniMax-M3MiniMax
58.6
$0.30 / $1.20
80 Qwen3.8-27B (low reasoning)Alibaba
58.2
$0.50 / $3
81 GPT-5.6 Terra (low reasoning)OpenAI
58.1
$2 / $12
82 MiMo-V2.5Xiaomi
56.8
$0.17 / $0.34
83 GPT-5.5 (no reasoning)OpenAI
56.5
$5 / $30
84 DeepSeek-V4-Flash (0423, max reasoning)DeepSeek
56.2
$0.14 / $0.28
85 Qwen3.8-27B (medium reasoning)Alibaba
56.1
$0.50 / $3
85 GPT-5.4 mini (extra-high reasoning)OpenAI
56.1
$0.75 / $4.50
85 GPT-5.4 nano (extra-high reasoning)OpenAI
56.1
$0.20 / $1.25
88 Qwen3.7-PlusAlibaba
55.9
$0.32 / $1.28
89 GLM-5.1Z.ai
55.8
$1.38 / $4.40
90 Qwen3.6-PlusAlibaba
54.5
$0.33 / $1.95
91 Qwen3.6-27BAlibaba
53.7
$0.30 / $3.20
92 Inkling SmallThinking Machines
52.9
$0.45 / $1.20
93 Solar Pro 4Upstage
52.7
$0.09 / $0.36
94 MiniMax-M2.7MiniMax
52.6
$0.30 / $1.20
95 GPT-5.6 Terra (no reasoning)OpenAI
52.3
$2 / $12
96 Claude Sonnet 4.5 (reasoning on)Anthropic
52.1
$3 / $15
96 Inkling (extra-high reasoning)Thinking Machines
52.1
$0.95 / $4.05
98 DeepSeek-V4-Flash (0423, high reasoning)DeepSeek
52.0
$0.14 / $0.28
99 Grok Build 0.1xAI
51.5
$1 / $2
100 GPT-5.6 Luna (medium reasoning)OpenAI
50.7
$0.20 / $1.20
101 GPT-5.1 (high reasoning)OpenAI
49.4
$1.25 / $10
102 Gemini 3.5 Flash-LiteGoogle
49.3
$0.30 / $2.50
103 Muse Glimmer (high reasoning)Meta
49.0
–
104 Qwen3.5-397B-A17BAlibaba
48.2
$0.55 / $3.50
105 Mistral Medium 3.5Mistral AI
46.9
$1.50 / $7.50
106 Kimi K2.5Moonshot AI
46.8
$0.57 / $2.85
107 Qwen3.6-27B (no reasoning)Alibaba
46.6
$0.30 / $3.20
108 GLM-5.2 (no reasoning)Z.ai
46.5
$1.40 / $4.40
109 GLM-4.6 (reasoning on)Z.ai
45.8
$0.50 / $2
110 Qwen3.5-122B-A10BAlibaba
45.7
$0.26 / $2.08
111 GLM-4.7Z.ai
45.3
$0.54 / $1.98
112 Qwen3.8-27B (no reasoning)Alibaba
44.6
$0.50 / $3
113 DeepSeek-V3.2 (reasoning on)DeepSeek
44.2
$0.30 / $0.96
113 GPT-5.6 Luna (low reasoning)OpenAI
44.2
$0.20 / $1.20
115 Claude Haiku 4.5 (reasoning on)Anthropic
43.9
$1 / $5
116 DeepSeek-V3.1-Terminus (reasoning on)DeepSeek
43.5
$0.27 / $1
117 Gemma 4 31BGoogle
43.4
$0.14 / $0.40
118 Qwen3.5-122B-A10B (no reasoning)Alibaba
43.3
$0.26 / $2.08
119 Grok 4.3 (high reasoning)xAI
42.2
$1.25 / $2.50
120 Qwen3.6-35B-A3BAlibaba
41.9
$0.10 / $1
121 o1OpenAI
39.7
$15 / $60
122 GPT-5.5 Instant (2026-06-26)OpenAI
39.4
–
123 Gemma 4 26B A4BGoogle
39.3
$0.10 / $0.30
123 GPT-5.6 Luna (no reasoning)OpenAI
39.3
$0.20 / $1.20
125 GPT-5 (high reasoning)OpenAI
37.8
$1.25 / $10
126 Nemotron 3 Super 120B A12BNVIDIA
37.7
$0.085 / $0.40
127 Claude Sonnet 4 (reasoning on)Anthropic
37.6
$3 / $15
128 Qwen3.5-35B-A3B (no reasoning)Alibaba
37.0
$0.16 / $1.30
129 Qwen3-Coder-NextAlibaba
36.2
$0.18 / $0.90
130 Grok 4.3 (no reasoning)xAI
35.2
$1.25 / $2.50
131 Gemini 3.1 Flash-Lite PreviewGoogle
34.7
$0.25 / $1.50
132 Gemini 2.5 ProGoogle
33.3
$1.25 / $10
133 Gemma 4 31B (no reasoning)Google
33.2
$0.14 / $0.40
134 Devstral 2Mistral AI
31.3
$0.40 / $2
135 Mercury 2Inception
31.1
$0.25 / $0.75
136 Gemma 4 12BGoogle
31.0
–
137 gpt-oss-120b (high reasoning)OpenAI
30.4
$0.15 / $0.60
138 Devstral Small 2Mistral AI
29.3
–
139 Qwen3.5-9BAlibaba
28.7
$0.10 / $0.15
140 Qwen3.6-35B-A3B (no reasoning)Alibaba
28.1
$0.10 / $1
141 Mistral Small 4Mistral AI
26.6
$0.15 / $0.60
142 Mistral Small 3.1 24BMistral AI
26.3
$0.35 / $0.56
143 Trinity Large ThinkingArcee AI
25.8
$0.25 / $0.80
144 DeepSeek-R1DeepSeek
24.6
$0.70 / $2.50
145 GPT-4o (2024-05-13)OpenAI
24.2
$5 / $15
146 Qwen3.5-9B (no reasoning)Alibaba
23.5
$0.10 / $0.15
147 Nova 2 Lite (high reasoning)Amazon
23.0
$0.30 / $2.50
147 DeepSeek-V3DeepSeek
23.0
$0.26 / $1.03
149 Qwen3.5-4B (reasoning on)Alibaba
22.6
–
150 Granite 4.2 8BIBM
22.4
$0.06 / $0.25
151 Qwen3-235B-A22B-Thinking-2507Alibaba
22.1
$0.30 / $3
152 Magistral Medium 1.2Mistral AI
21.3
–
153 DeepSeek-V3-0324DeepSeek
21.2
$0.25 / $1
153 gpt-oss-120b (low reasoning)OpenAI
21.2
$0.15 / $0.60
155 gpt-oss-20b (high reasoning)OpenAI
20.7
$0.03 / $0.15
156 Mistral Medium 3.1Mistral AI
20.5
$0.40 / $2
157 Qwen3.5-4B (no reasoning)Alibaba
20.3
–
158 GPT-4.1 miniOpenAI
20.2
$0.40 / $1.60
159 Mistral Large 3Mistral AI
20.1
$0.50 / $1.50
160 DiffusionGemma 26B A4BGoogle
19.7
–
161 Qwen3-Next-80B-A3B-ThinkingAlibaba
17.4
$0.15 / $1.20
162 Llama 4 MaverickMeta
16.3
$0.27 / $0.85
162 o3-mini (high reasoning)OpenAI
16.3
$1.10 / $4.40
164 Solar Pro 3Upstage
16.2
$0.15 / $0.60
165 GPT-5 mini (high reasoning)OpenAI
15.6
$0.25 / $2
166 Qwen3-32B (reasoning on)Alibaba
15.3
$0.14 / $0.40
167 Magistral Small 1.2Mistral AI
14.7
–
168 Ministral 3 14BMistral AI
14.4
$0.20 / $0.20
168 Nemotron 3 Nano 30B A3B (reasoning on)NVIDIA
14.4
$0.05 / $0.20
170 Qwen3-14B (reasoning on)Alibaba
13.8
$0.12 / $0.24
171 Mistral Small 3.2 24BMistral AI
12.5
$0.094 / $0.25
172 Qwen3-30B-A3B-Thinking-2507Alibaba
12.1
$0.20 / $2.40
173 Llama 3.3 70B InstructMeta
11.9
$0.59 / $0.79
174 GPT-4o mini (2024-07-18)OpenAI
11.4
$0.15 / $0.60
175 GPT-4.1 nanoOpenAI
11.1
$0.10 / $0.40
176 Gemma 3 27BGoogle
10.1
$0.12 / $0.20
177 Ministral 3 8BMistral AI
9.7
$0.15 / $0.15
178 Qwen3-8B (reasoning on)Alibaba
9.0
$0.12 / $0.46
179 Llama 4 ScoutMeta
8.2
$0.18 / $0.59
180 Gemma 4 E2BGoogle
7.2
–
181 Gemma 3 12BGoogle
5.8
$0.05 / $0.15
182 Llama 3.1 8B InstructMeta
5.4
$0.05 / $0.08
183 Ministral 3 3BMistral AI
4.8
$0.10 / $0.10
184 Qwen3.5-2B (reasoning on)Alibaba
2.9
–
185 Gemma 3 4BGoogle
2.7
$0.05 / $0.10
186 Qwen3.5-2B (no reasoning)Alibaba
2.4
–
187 Qwen3.5-0.8B (no reasoning)Alibaba
1.2
–
188 Qwen3.5-0.8B (reasoning on)Alibaba
0.0
–

Swipe the table sideways for more columns.

Ranks follow the score as shown, so equal numbers share a rank. Results as published by Artificial Analysis; we do not re-run them.

What it measures

Artificial Analysis's blend of its coding evaluations.

What it does not measure

Not your codebase or tools.

Source

Artificial Analysis · Methodology

282 results from Artificial Analysis not ranked here · show why

We rank a result only when we can tie it to a specific model you can use. These are left out:

  • Not on sale through the API providers we track: 268
  • A different snapshot or variant from the model we list: 13
  • An unusual combination of settings: 1

Data sourced from Artificial Analysis. Licence: Artificial Analysis commercial data licence.