Benchmarks / Artificial Analysis

Reported by Artificial Analysis

Artificial Analysis

Artificial Analysis's blend of its coding evaluations.

Last updated 8 Oct 2026

Results dated
8 Oct 2026
Results
188 configurations of 131 models
Unit
index score
Licence
Artificial Analysis commercial data licence

Artificial Analysis Coding Index: Gemini 3.8 Flash

Top 15 of 188 results · index score, higher is better. Choose a model to highlight it.Clear highlight

  1. 1 Claude Fable 5.1 (max reasoning)Anthropic 81.6
  2. 2 Claude Fable 5.1 (extra-high reasoning)Anthropic 80.7
  3. 3 Claude Fable 5.1 (high reasoning)Anthropic 79.1
  4. 4 GPT-5.6 Sol (extra-high reasoning)OpenAI 78.3
  5. 5 Claude Opus 5 (max reasoning)Anthropic 78.0
  6. 6 GPT-5.6 Sol (max reasoning)OpenAI 77.4
  7. 7 GPT-5.6 Sol (high reasoning)OpenAI 77.2
  8. 8 Claude Fable 5.1 (medium reasoning)Anthropic 77.1
  9. 8 GPT-6 Astra (high reasoning)OpenAI 77.1
  10. 10 Claude Opus 5 (extra-high reasoning)Anthropic 77.0
  11. 11 GPT-6 Astra (max reasoning)OpenAI 76.9
  12. 12 Grok 4.6 (high reasoning)xAI 76.8
  13. 13 GPT-5.6 Terra (max reasoning)OpenAI 76.7
  14. 13 GPT-6 Astra (medium reasoning)OpenAI 76.7
  15. 15 Claude Fable 5 (max reasoning)Anthropic 76.5
  16. 18 Gemini 3.8 Flash (high reasoning)Google 76.3
  17. 33 Gemini 3.8 Flash (medium reasoning)Google 74.1
  18. 35 Gemini 3.8 Flash (low reasoning)Google 73.5

Full results

Artificial Analysis: Artificial Analysis Coding Index, index score, higher is better
#ModelArtificial Analysis Coding Index
index score, higher is better		Price
$ per million tokens, in / out
1 Claude Fable 5.1 (max reasoning)Anthropic
81.6
$10 / $50
2 Claude Fable 5.1 (extra-high reasoning)Anthropic
80.7
$10 / $50
3 Claude Fable 5.1 (high reasoning)Anthropic
79.1
$10 / $50
4 GPT-5.6 Sol (extra-high reasoning)OpenAI
78.3
$4 / $20
5 Claude Opus 5 (max reasoning)Anthropic
78.0
$5 / $25
6 GPT-5.6 Sol (max reasoning)OpenAI
77.4
$4 / $20
7 GPT-5.6 Sol (high reasoning)OpenAI
77.2
$4 / $20
8 Claude Fable 5.1 (medium reasoning)Anthropic
77.1
$10 / $50
8 GPT-6 Astra (high reasoning)OpenAI
77.1
$10 / $50
10 Claude Opus 5 (extra-high reasoning)Anthropic
77.0
$5 / $25
11 GPT-6 Astra (max reasoning)OpenAI
76.9
$10 / $50
12 Grok 4.6 (high reasoning)xAI
76.8
$2 / $6
13 GPT-5.6 Terra (max reasoning)OpenAI
76.7
$2 / $12
13 GPT-6 Astra (medium reasoning)OpenAI
76.7
$10 / $50
15 Claude Fable 5 (max reasoning)Anthropic
76.5
$10 / $50
15 Claude Opus 5 (high reasoning)Anthropic
76.5
$5 / $25
15 Muse Spark 1.3 (extra-high reasoning)Meta
76.5
$1.25 / $4.25
18 Gemini 3.8 Flash (high reasoning)Google
76.3
$1.50 / $7.50
18 GPT-5.6 Sol (medium reasoning)OpenAI
76.3
$4 / $20
20 Qwen3.8-Max (0902)Alibaba
76.2
$2 / $6
20 Kimi K3 (max reasoning)Moonshot AI
76.2
$3 / $15
22 Gemini 3.7 Flash (high reasoning)Google
76.1
$1.50 / $7.50
23 GPT-6 Astra (extra-high reasoning)OpenAI
75.9
$10 / $50
23 Grok 4.6 (extra-high reasoning)xAI
75.9
$2 / $6
25 Muse Spark 1.3 (max reasoning)Meta
75.8
$1.25 / $4.25
26 GPT-6 Astra (low reasoning)OpenAI
75.7
$10 / $50
27 Claude Fable 5.1 (low reasoning)Anthropic
75.2
$10 / $50
28 GPT-5.5 (extra-high reasoning)OpenAI
74.9
$5 / $30
29 GLM-5.3 (max reasoning)Z.ai
74.8
$1.40 / $4.40
30 Grok 4.6 (medium reasoning)xAI
74.4
$2 / $6
31 Claude Opus 4.8 (max reasoning)Anthropic
74.3
$5 / $25
31 Claude Opus 5 (medium reasoning)Anthropic
74.3
$5 / $25
33 Gemini 3.8 Flash (medium reasoning)Google
74.1
$1.50 / $7.50
34 Claude Opus 4.7 (max reasoning)Anthropic
73.6
$5 / $25
35 Gemini 3.8 Flash (low reasoning)Google
73.5
$1.50 / $7.50
36 Qwen3.8-Flash-NextAlibaba
73.1
–
37 Grok 4.5 (high reasoning)xAI
72.4
$2 / $6
38 Muse Spark 1.2 (extra-high reasoning)Meta
72.2
$1.25 / $4.25
39 Kimi K3 (low reasoning)Moonshot AI
72.0
$3 / $15
40 Qwen3.8-2.4T-A95BAlibaba
71.9
$2 / $6
41 Qwen3.8-Max (0803)Alibaba
71.8
–
42 GPT-5.5 (high reasoning)OpenAI
71.6
$5 / $30
43 Claude Sonnet 5 (max reasoning)Anthropic
71.5
$2 / $10
43 Gemini 3.7 Flash (medium reasoning)Google
71.5
$1.50 / $7.50
43 GPT-5.5 (medium reasoning)OpenAI
71.5
$5 / $30
43 GLM-5.3-FlashZ.ai
71.5
$0.15 / $0.50
47 GPT-5.6 Luna (max reasoning)OpenAI
71.4
$0.20 / $1.20
48 Muse Spark 1.1 (extra-high reasoning)Meta
71.3
$1.25 / $4.25
49 GPT-5.4 (extra-high reasoning)OpenAI
71.1
$2.50 / $15
50 Gemini 3.7 Flash (low reasoning)Google
71.0
$1.50 / $7.50
51 GPT-5.6 Terra (extra-high reasoning)OpenAI
70.6
$2 / $12
52 Gemini 3.5 Flash (high reasoning)Google
70.1
$1.50 / $9
53 GPT-5.6 Sol (low reasoning)OpenAI
69.7
$4 / $20
54 Gemini 3.6 Flash (high reasoning)Google
69.2
$1.50 / $7.50
55 DeepSeek-V4-Flash (0731, max reasoning)DeepSeek
69.1
$0.14 / $0.28
56 DeepSeek-V4-Pro (0813, max reasoning)DeepSeek
68.8
$1.32 / $3.96
56 Gemini 3.1 Pro PreviewGoogle
68.8
$2 / $12
56 GLM-5.2 (max reasoning)Z.ai
68.8
$1.40 / $4.40
59 GPT-5.6 Luna (extra-high reasoning)OpenAI
68.6
$0.20 / $1.20
60 Qwen3.8-27B (extra-high reasoning)Alibaba
68.1
$0.50 / $3
61 GPT-5.6 Terra (high reasoning)OpenAI
67.1
$2 / $12
62 Claude Opus 5 (low reasoning)Anthropic
66.9
$5 / $25
63 Claude Sonnet 5 (no reasoning)Anthropic
66.4
$2 / $10
64 Grok 4.6 (low reasoning)xAI
66.3
$2 / $6
65 Qwen3.7-MaxAlibaba
66.0
$1.48 / $4.42
66 GPT-5.6 Sol (no reasoning)OpenAI
65.1
$4 / $20
67 DeepSeek-V4-Flash-Vision-Exp (max reasoning)DeepSeek
65.0
$0.44 / $1.32
68 GPT-5.6 Terra (medium reasoning)OpenAI
64.7
$2 / $12
69 GPT-5.6 Luna (high reasoning)OpenAI
63.3
$0.20 / $1.20
70 Claude Sonnet 4.6 (max reasoning)Anthropic
63.0
$3 / $15
71 Kimi K2.6Moonshot AI
61.8
$0.95 / $4
72 GPT-5.5 (low reasoning)OpenAI
60.9
$5 / $30
73 Kimi K2.7 CodeMoonshot AI
60.8
$0.95 / $4
74 MiMo-V2.5-Pro (reasoning on)Xiaomi
60.2
$0.43 / $0.87
75 DeepSeek-V4-Pro (0423, max reasoning)DeepSeek
59.4
$1.42 / $2.83
76 Hy3Tencent
58.8
$0.14 / $0.58
77 DeepSeek-V4-Pro (0423, high reasoning)DeepSeek
58.7
$1.42 / $2.83
78 Muse SparkMeta
58.6
–
78 MiniMax-M3MiniMax
58.6
$0.30 / $1.20
80 Qwen3.8-27B (low reasoning)Alibaba
58.2
$0.50 / $3
81 GPT-5.6 Terra (low reasoning)OpenAI
58.1
$2 / $12
82 MiMo-V2.5Xiaomi
56.8
$0.17 / $0.34
83 GPT-5.5 (no reasoning)OpenAI
56.5
$5 / $30
84 DeepSeek-V4-Flash (0423, max reasoning)DeepSeek
56.2
$0.14 / $0.28
85 Qwen3.8-27B (medium reasoning)Alibaba
56.1
$0.50 / $3
85 GPT-5.4 mini (extra-high reasoning)OpenAI
56.1
$0.75 / $4.50
85 GPT-5.4 nano (extra-high reasoning)OpenAI
56.1
$0.20 / $1.25
88 Qwen3.7-PlusAlibaba
55.9
$0.32 / $1.28
89 GLM-5.1Z.ai
55.8
$1.38 / $4.40
90 Qwen3.6-PlusAlibaba
54.5
$0.33 / $1.95
91 Qwen3.6-27BAlibaba
53.7
$0.30 / $3.20
92 Inkling SmallThinking Machines
52.9
$0.45 / $1.20
93 Solar Pro 4Upstage
52.7
$0.09 / $0.36
94 MiniMax-M2.7MiniMax
52.6
$0.30 / $1.20
95 GPT-5.6 Terra (no reasoning)OpenAI
52.3
$2 / $12
96 Claude Sonnet 4.5 (reasoning on)Anthropic
52.1
$3 / $15
96 Inkling (extra-high reasoning)Thinking Machines
52.1
$0.95 / $4.05
98 DeepSeek-V4-Flash (0423, high reasoning)DeepSeek
52.0
$0.14 / $0.28
99 Grok Build 0.1xAI
51.5
$1 / $2
100 GPT-5.6 Luna (medium reasoning)OpenAI
50.7
$0.20 / $1.20
101 GPT-5.1 (high reasoning)OpenAI
49.4
$1.25 / $10
102 Gemini 3.5 Flash-LiteGoogle
49.3
$0.30 / $2.50
103 Muse Glimmer (high reasoning)Meta
49.0
–
104 Qwen3.5-397B-A17BAlibaba
48.2
$0.55 / $3.50
105 Mistral Medium 3.5Mistral AI
46.9
$1.50 / $7.50
106 Kimi K2.5Moonshot AI
46.8
$0.57 / $2.85
107 Qwen3.6-27B (no reasoning)Alibaba
46.6
$0.30 / $3.20
108 GLM-5.2 (no reasoning)Z.ai
46.5
$1.40 / $4.40
109 GLM-4.6 (reasoning on)Z.ai
45.8
$0.50 / $2
110 Qwen3.5-122B-A10BAlibaba
45.7
$0.26 / $2.08
111 GLM-4.7Z.ai
45.3
$0.54 / $1.98
112 Qwen3.8-27B (no reasoning)Alibaba
44.6
$0.50 / $3
113 DeepSeek-V3.2 (reasoning on)DeepSeek
44.2
$0.30 / $0.96
113 GPT-5.6 Luna (low reasoning)OpenAI
44.2
$0.20 / $1.20
115 Claude Haiku 4.5 (reasoning on)Anthropic
43.9
$1 / $5
116 DeepSeek-V3.1-Terminus (reasoning on)DeepSeek
43.5
$0.27 / $1
117 Gemma 4 31BGoogle
43.4
$0.14 / $0.40
118 Qwen3.5-122B-A10B (no reasoning)Alibaba
43.3
$0.26 / $2.08
119 Grok 4.3 (high reasoning)xAI
42.2
$1.25 / $2.50
120 Qwen3.6-35B-A3BAlibaba
41.9
$0.10 / $1
121 o1OpenAI
39.7
$15 / $60
122 GPT-5.5 Instant (2026-06-26)OpenAI
39.4
–
123 Gemma 4 26B A4BGoogle
39.3
$0.10 / $0.30
123 GPT-5.6 Luna (no reasoning)OpenAI
39.3
$0.20 / $1.20
125 GPT-5 (high reasoning)OpenAI
37.8
$1.25 / $10
126 Nemotron 3 Super 120B A12BNVIDIA
37.7
$0.085 / $0.40
127 Claude Sonnet 4 (reasoning on)Anthropic
37.6
$3 / $15
128 Qwen3.5-35B-A3B (no reasoning)Alibaba
37.0
$0.16 / $1.30
129 Qwen3-Coder-NextAlibaba
36.2
$0.18 / $0.90
130 Grok 4.3 (no reasoning)xAI
35.2
$1.25 / $2.50
131 Gemini 3.1 Flash-Lite PreviewGoogle
34.7
$0.25 / $1.50
132 Gemini 2.5 ProGoogle
33.3
$1.25 / $10
133 Gemma 4 31B (no reasoning)Google
33.2
$0.14 / $0.40
134 Devstral 2Mistral AI
31.3
$0.40 / $2
135 Mercury 2Inception
31.1
$0.25 / $0.75
136 Gemma 4 12BGoogle
31.0
–
137 gpt-oss-120b (high reasoning)OpenAI
30.4
$0.15 / $0.60
138 Devstral Small 2Mistral AI
29.3
–
139 Qwen3.5-9BAlibaba
28.7
$0.10 / $0.15
140 Qwen3.6-35B-A3B (no reasoning)Alibaba
28.1
$0.10 / $1
141 Mistral Small 4Mistral AI
26.6
$0.15 / $0.60
142 Mistral Small 3.1 24BMistral AI
26.3
$0.35 / $0.56
143 Trinity Large ThinkingArcee AI
25.8
$0.25 / $0.80
144 DeepSeek-R1DeepSeek
24.6
$0.70 / $2.50
145 GPT-4o (2024-05-13)OpenAI
24.2
$5 / $15
146 Qwen3.5-9B (no reasoning)Alibaba
23.5
$0.10 / $0.15
147 Nova 2 Lite (high reasoning)Amazon
23.0
$0.30 / $2.50
147 DeepSeek-V3DeepSeek
23.0
$0.26 / $1.03
149 Qwen3.5-4B (reasoning on)Alibaba
22.6
–
150 Granite 4.2 8BIBM
22.4
$0.06 / $0.25
151 Qwen3-235B-A22B-Thinking-2507Alibaba
22.1
$0.30 / $3
152 Magistral Medium 1.2Mistral AI
21.3
–
153 DeepSeek-V3-0324DeepSeek
21.2
$0.25 / $1
153 gpt-oss-120b (low reasoning)OpenAI
21.2
$0.15 / $0.60
155 gpt-oss-20b (high reasoning)OpenAI
20.7
$0.03 / $0.15
156 Mistral Medium 3.1Mistral AI
20.5
$0.40 / $2
157 Qwen3.5-4B (no reasoning)Alibaba
20.3
–
158 GPT-4.1 miniOpenAI
20.2
$0.40 / $1.60
159 Mistral Large 3Mistral AI
20.1
$0.50 / $1.50
160 DiffusionGemma 26B A4BGoogle
19.7
–
161 Qwen3-Next-80B-A3B-ThinkingAlibaba
17.4
$0.15 / $1.20
162 Llama 4 MaverickMeta
16.3
$0.27 / $0.85
162 o3-mini (high reasoning)OpenAI
16.3
$1.10 / $4.40
164 Solar Pro 3Upstage
16.2
$0.15 / $0.60
165 GPT-5 mini (high reasoning)OpenAI
15.6
$0.25 / $2
166 Qwen3-32B (reasoning on)Alibaba
15.3
$0.14 / $0.40
167 Magistral Small 1.2Mistral AI
14.7
–
168 Ministral 3 14BMistral AI
14.4
$0.20 / $0.20
168 Nemotron 3 Nano 30B A3B (reasoning on)NVIDIA
14.4
$0.05 / $0.20
170 Qwen3-14B (reasoning on)Alibaba
13.8
$0.12 / $0.24
171 Mistral Small 3.2 24BMistral AI
12.5
$0.094 / $0.25
172 Qwen3-30B-A3B-Thinking-2507Alibaba
12.1
$0.20 / $2.40
173 Llama 3.3 70B InstructMeta
11.9
$0.59 / $0.79
174 GPT-4o mini (2024-07-18)OpenAI
11.4
$0.15 / $0.60
175 GPT-4.1 nanoOpenAI
11.1
$0.10 / $0.40
176 Gemma 3 27BGoogle
10.1
$0.12 / $0.20
177 Ministral 3 8BMistral AI
9.7
$0.15 / $0.15
178 Qwen3-8B (reasoning on)Alibaba
9.0
$0.12 / $0.46
179 Llama 4 ScoutMeta
8.2
$0.18 / $0.59
180 Gemma 4 E2BGoogle
7.2
–
181 Gemma 3 12BGoogle
5.8
$0.05 / $0.15
182 Llama 3.1 8B InstructMeta
5.4
$0.05 / $0.08
183 Ministral 3 3BMistral AI
4.8
$0.10 / $0.10
184 Qwen3.5-2B (reasoning on)Alibaba
2.9
–
185 Gemma 3 4BGoogle
2.7
$0.05 / $0.10
186 Qwen3.5-2B (no reasoning)Alibaba
2.4
–
187 Qwen3.5-0.8B (no reasoning)Alibaba
1.2
–
188 Qwen3.5-0.8B (reasoning on)Alibaba
0.0
–

Swipe the table sideways for more columns.

Ranks follow the score as shown, so equal numbers share a rank. Results as published by Artificial Analysis; we do not re-run them.

What it measures

Artificial Analysis's blend of its coding evaluations.

What it does not measure

Not your codebase or tools.

Source

Artificial Analysis · Methodology

282 results from Artificial Analysis not ranked here · show why

We rank a result only when we can tie it to a specific model you can use. These are left out:

  • Not on sale through the API providers we track: 268
  • A different snapshot or variant from the model we list: 13
  • An unusual combination of settings: 1

Data sourced from Artificial Analysis. Licence: Artificial Analysis commercial data licence.