Benchmarks / Artificial Analysis

Reported by Artificial Analysis

Artificial Analysis

Share of expert-written exam questions answered correctly, as run by Artificial Analysis with its own harness and prompts.

Last updated 9 Nov 2026

Results dated
20 Oct 2026 to 9 Nov 2026
Results
419 configurations of 250 models
Unit
% of questions
Licence
Artificial Analysis commercial data licence

Artificial Analysis in brief

What it measures. Artificial Analysis is a third-party benchmark, shown here with credit. Measured here: Share of expert-written exam questions answered correctly, as run by Artificial Analysis with its own harness and prompts.

Latest results. , 419 configurations ranked.

Top 3 on Humanity's Last Exam (% of questions, higher is better):

  1. Claude Opus 5.5 (max reasoning) (Anthropic): 61.4%
  2. Claude Fable 5.1 (max reasoning) (Anthropic): 59.1%
  3. Claude Fable 5.1 (extra-high reasoning) (Anthropic): 58.7%

How to cite. Artificial Analysis, via Spring Prompt, results dated 9 November 2026. https://springprompt.com/benchmarks/artificial-analysis These results belong to Artificial Analysis, not to us. Licence: Artificial Analysis commercial data licence. Credit Artificial Analysis first.

Humanity's Last Exam: Qwen3.5-35B-A3B

Top 15 of 419 results · % of questions, higher is better. Choose a model to highlight it.Clear highlight

  1. 1 Claude Opus 5.5 (max reasoning)Anthropic 61.4%
  2. 2 Claude Fable 5.1 (max reasoning)Anthropic 59.1%
  3. 3 Claude Fable 5.1 (extra-high reasoning)Anthropic 58.7%
  4. 4 Claude Opus 5.5 (extra-high reasoning)Anthropic 57.5%
  5. 5 Gemini 4 Argon (high reasoning)Google 57.1%
  6. 6 Claude Fable 5.1 (high reasoning)Anthropic 55.9%
  7. 7 Claude Opus 5.5 (high reasoning)Anthropic 55.6%
  8. 8 Claude Fable 5 (max reasoning)Anthropic 55.5%
  9. 9 Claude Sonnet 5.5 (max reasoning)Anthropic 55.0%
  10. 10 Claude Opus 5 (max reasoning)Anthropic 54.9%
  11. 11 Claude Opus 5.5 (medium reasoning)Anthropic 54.7%
  12. 11 GPT-6 Astra (max reasoning)OpenAI 54.7%
  13. 13 GPT-6 Astra (extra-high reasoning)OpenAI 54.6%
  14. 14 Claude Opus 5 (extra-high reasoning)Anthropic 54.4%
  15. 15 Claude Fable 5.1 (medium reasoning)Anthropic 53.8%
  16. 196 Qwen3.5-35B-A3BAlibaba 21.0%
  17. 247 Qwen3.5-35B-A3B (no reasoning)Alibaba 13.4%

Full results

Artificial Analysis: Humanity's Last Exam, % of questions, higher is better
#ModelHumanity's Last Exam
% of questions, higher is better
Price
$ per million tokens, in / out
1 Claude Opus 5.5 (max reasoning)Anthropic
61.4%
$4 / $20
2 Claude Fable 5.1 (max reasoning)Anthropic
59.1%
$10 / $50
3 Claude Fable 5.1 (extra-high reasoning)Anthropic
58.7%
$10 / $50
4 Claude Opus 5.5 (extra-high reasoning)Anthropic
57.5%
$4 / $20
5 Gemini 4 Argon (high reasoning)Google
57.1%
$2 / $10
6 Claude Fable 5.1 (high reasoning)Anthropic
55.9%
$10 / $50
7 Claude Opus 5.5 (high reasoning)Anthropic
55.6%
$4 / $20
8 Claude Fable 5 (max reasoning)Anthropic
55.5%
$10 / $50
9 Claude Sonnet 5.5 (max reasoning)Anthropic
55.0%
$2 / $10
10 Claude Opus 5 (max reasoning)Anthropic
54.9%
$5 / $25
11 Claude Opus 5.5 (medium reasoning)Anthropic
54.7%
$4 / $20
11 GPT-6 Astra (max reasoning)OpenAI
54.7%
$10 / $50
13 GPT-6 Astra (extra-high reasoning)OpenAI
54.6%
$10 / $50
14 Claude Opus 5 (extra-high reasoning)Anthropic
54.4%
$5 / $25
15 Claude Fable 5.1 (medium reasoning)Anthropic
53.8%
$10 / $50
16 GPT-6 Astra (high reasoning)OpenAI
53.1%
$10 / $50
17 GPT-6.1 Sol (max reasoning)OpenAI
52.9%
$2 / $10
18 Claude Opus 5 (high reasoning)Anthropic
52.8%
$5 / $25
19 GPT-6 Astra (medium reasoning)OpenAI
52.7%
$10 / $50
20 GPT-6.1 Sol (extra-high reasoning)OpenAI
52.6%
$2 / $10
21 Kimi K3.1 ProMoonshot AI
52.5%
$1.75 / $10
22 GPT-6.1 Sol (high reasoning)OpenAI
51.4%
$2 / $10
23 Claude Opus 5 (medium reasoning)Anthropic
51.3%
$5 / $25
24 Muse Wonder (max reasoning)Meta
50.1%
$4 / $20
25 Claude Sonnet 5.5 (extra-high reasoning)Anthropic
50.0%
$2 / $10
26 GPT-6.1 Sol (medium reasoning)OpenAI
49.9%
$2 / $10
27 GPT-5.6 Sol (max reasoning)OpenAI
49.5%
$4 / $20
28 MiMo-V2.6-ProXiaomi
49.4%
$0.43 / $0.87
29 GPT-6 Astra (low reasoning)OpenAI
49.2%
$10 / $50
30 Claude Fable 5.1 (low reasoning)Anthropic
48.9%
$10 / $50
31 Claude Opus 4.8 (max reasoning)Anthropic
48.7%
$5 / $25
31 Muse Spark 1.3 (max reasoning)Meta
48.7%
$1.25 / $4.25
33 Claude Opus 5.5 (low reasoning)Anthropic
48.3%
$4 / $20
34 MiniMax M3.1 FlashMiniMax
48.0%
$0.15 / $0.60
35 Gemini 3.7 Flash (high reasoning)Google
47.9%
$1.50 / $7.50
35 GPT-6 Sol (max reasoning)OpenAI
47.9%
$2 / $10
37 Gemini 3.8 Flash (high reasoning)Google
47.8%
$1.50 / $7.50
38 Muse Spark 1.3 (extra-high reasoning)Meta
47.5%
$1.25 / $4.25
39 GPT-6.1 Sol (low reasoning)OpenAI
47.4%
$2 / $10
40 GPT-5.6 Sol (extra-high reasoning)OpenAI
47.3%
$4 / $20
41 Gemini 3.1 Pro PreviewGoogle
47.0%
$2 / $12
42 Kimi K3 (max reasoning)Moonshot AI
46.9%
$3 / $15
43 GPT-6 Sol (extra-high reasoning)OpenAI
46.3%
$2 / $10
44 Muse Spark 1.1 (extra-high reasoning)Meta
46.2%
$1.25 / $4.25
44 GPT-6.1 Terra (max reasoning)OpenAI
46.2%
$1 / $5
46 GPT-5.6 Sol (high reasoning)OpenAI
46.0%
$4 / $20
47 Claude Sonnet 5.5 (high reasoning)Anthropic
45.8%
$2 / $10
47 GPT-5.5 (extra-high reasoning)OpenAI
45.8%
$5 / $30
49 Muse Spark 1.2 (extra-high reasoning)Meta
45.5%
$1.25 / $4.25
50 GPT-5.5 (high reasoning)OpenAI
45.0%
$5 / $30
51 Claude Haiku 5.5 (max reasoning)Anthropic
44.4%
$0.10 / $0.50
52 GPT-6 Sol (high reasoning)OpenAI
44.1%
$2 / $10
52 Grok 4.6 (extra-high reasoning)xAI
44.1%
$2 / $6
54 Muse Spark Open (extra-high reasoning)Meta
43.9%
$1.25 / $4.25
55 GPT-5.4 (extra-high reasoning)OpenAI
43.7%
$2.50 / $15
55 GPT-6.1 Terra (extra-high reasoning)OpenAI
43.7%
$1 / $5
57 Claude Opus 5 (low reasoning)Anthropic
43.4%
$5 / $25
58 DeepSeek-V4.1-Flash-1017 (max reasoning)DeepSeek
43.3%
$0.30 / $1.20
58 GPT-6.1 Terra (high reasoning)OpenAI
43.3%
$1 / $5
60 Qwen3.8-Max (0902)Alibaba
43.1%
$2 / $6
60 Grok 4.7 (extra-high reasoning)xAI
43.1%
$2 / $6
62 Qwen3.8-Max (0803)Alibaba
43.0%
–
63 GPT-5.6 Terra (max reasoning)OpenAI
42.9%
$2 / $12
63 Grok 4.6 (high reasoning)xAI
42.9%
$2 / $6
65 Claude Haiku 5.5 (extra-high reasoning)Anthropic
42.7%
$0.10 / $0.50
65 Gemini 3.5 Flash (high reasoning)Google
42.7%
$1.50 / $9
65 Grok 4.5 (high reasoning)xAI
42.7%
$2 / $6
68 GPT-5.3-Codex (extra-high reasoning)OpenAI
42.5%
$1.75 / $14
69 Qwen3.8-2.4T-A95BAlibaba
42.4%
$2 / $6
69 GPT-5.5 (medium reasoning)OpenAI
42.4%
$5 / $30
71 Claude Opus 4.7 (max reasoning)Anthropic
42.3%
$5 / $25
71 Grok 4.7 (high reasoning)xAI
42.3%
$2 / $6
71 GLM-5.3 (max reasoning)Z.ai
42.3%
$1.40 / $4.40
74 GPT-5.6 Sol (medium reasoning)OpenAI
42.2%
$4 / $20
75 Gemini 3.8 Flash (medium reasoning)Google
42.1%
$1.50 / $7.50
75 Grok 4.6 (medium reasoning)xAI
42.1%
$2 / $6
77 GPT-5.6 Terra (extra-high reasoning)OpenAI
41.9%
$2 / $12
78 Claude Sonnet 5 (max reasoning)Anthropic
41.3%
$2 / $10
78 Gemini 3.5 Flash (medium reasoning)Google
41.3%
$1.50 / $9
80 GLM-5.2 (max reasoning)Z.ai
41.1%
$1.40 / $4.40
81 DeepSeek-V4-Pro (0813, max reasoning)DeepSeek
41.0%
$1.32 / $3.96
81 GPT-6 Sol (medium reasoning)OpenAI
41.0%
$2 / $10
83 Gemini 3.6 Flash (high reasoning)Google
40.8%
$1.50 / $7.50
84 Muse SparkMeta
40.7%
–
85 Qwen3.7-MaxAlibaba
40.5%
$1.48 / $4.42
86 GPT-6.1 Terra (medium reasoning)OpenAI
40.2%
$1 / $5
87 Claude Opus 4.6 (max reasoning)Anthropic
39.9%
$5 / $25
87 GLM-5.3-FlashZ.ai
39.9%
$0.15 / $0.50
89 Claude Sonnet 5.5 (medium reasoning)Anthropic
39.8%
$2 / $10
90 Gemini 3 Pro Preview (high reasoning)Google
39.7%
–
91 GPT-5.6 Luna (max reasoning)OpenAI
39.5%
$0.20 / $1.20
92 GPT-5.6 Sol (low reasoning)OpenAI
39.4%
$4 / $20
93 DeepSeek-V4.1-Flash (max reasoning)DeepSeek
39.2%
$0.30 / $1.20
93 Grok 4.7 (low reasoning)xAI
39.2%
$2 / $6
95 Claude Sonnet 5 (extra-high reasoning)Anthropic
39.0%
$2 / $10
95 Gemini 3.7 Flash (medium reasoning)Google
39.0%
$1.50 / $7.50
95 MiniMax-M3MiniMax
39.0%
$0.30 / $1.20
98 DeepSeek-V4-Flash (0731, max reasoning)DeepSeek
38.6%
$0.13 / $0.40
99 GPT-5.6 Terra (high reasoning)OpenAI
38.5%
$2 / $12
99 GPT-6 Luna (max reasoning)OpenAI
38.5%
$0.10 / $0.50
101 Grok Build 0.1xAI
38.3%
$1 / $2
102 Qwen3.8-Flash-NextAlibaba
38.0%
–
103 GPT-5.2 (extra-high reasoning)OpenAI
37.7%
$1.75 / $14
104 DeepSeek-V4-Pro (0423, max reasoning)DeepSeek
37.5%
$1.42 / $2.83
104 Kimi K2.6Moonshot AI
37.5%
$0.95 / $4
106 Claude Haiku 5.5 (high reasoning)Anthropic
37.3%
$0.10 / $0.50
107 Grok 4.3 (high reasoning)xAI
37.2%
$1.25 / $2.50
108 Gemini 3.8 Flash (low reasoning)Google
37.1%
$1.50 / $7.50
109 GPT-5.6 Luna (extra-high reasoning)OpenAI
37.0%
$0.20 / $1.20
110 Gemini 3 Flash Preview (reasoning on)Google
36.6%
$0.50 / $3
110 GLM-5.3 (low reasoning)Z.ai
36.6%
$1.40 / $4.40
112 Claude Sonnet 5.5 (low reasoning)Anthropic
36.2%
$2 / $10
113 GPT-6.1 Terra (low reasoning)OpenAI
35.8%
$1 / $5
114 Claude Sonnet 5 (high reasoning)Anthropic
35.7%
$2 / $10
114 GPT-5.2-Codex (extra-high reasoning)OpenAI
35.7%
$1.75 / $14
114 MiMo-V2.5-Pro (reasoning on)Xiaomi
35.7%
$0.43 / $0.87
117 Qwen3.7-PlusAlibaba
35.6%
$0.32 / $1.28
118 DeepSeek-V4-Pro (0423, high reasoning)DeepSeek
35.2%
$1.42 / $2.83
119 Gemini 3.7 Flash (low reasoning)Google
35.1%
$1.50 / $7.50
119 MiMo-V2.6-FlashXiaomi
35.1%
$0.14 / $0.28
121 Mistral Large 4Mistral AI
35.0%
$1.36 / $4.18
121 Kimi K2.7 CodeMoonshot AI
35.0%
$0.95 / $4
123 GPT-6 Sol (low reasoning)OpenAI
34.9%
$2 / $10
124 DeepSeek-V4-Flash (0423, max reasoning)DeepSeek
34.8%
$0.05 / $0.45
125 Beam 1.0 501B A23BReflection
34.7%
$0.40 / $1.20
126 DeepSeek-V4-Flash-Vision-Exp (max reasoning)DeepSeek
34.5%
$0.22 / $0.65
126 Grok 4.20xAI
34.5%
$1.25 / $2.50
128 GPT-6 Luna (extra-high reasoning)OpenAI
34.3%
$0.10 / $0.50
129 Qwen3.8-27B (extra-high reasoning)Alibaba
33.9%
$0.50 / $3
130 Claude Haiku 5.5 (medium reasoning)Anthropic
33.8%
$0.10 / $0.50
131 Claude Sonnet 4.6 (max reasoning)Anthropic
33.6%
$3 / $15
132 Hy3Tencent
33.5%
$0.14 / $0.58
133 GPT-5.6 Luna (high reasoning)OpenAI
33.4%
$0.20 / $1.20
134 Claude Opus 4.7 (no reasoning)Anthropic
33.3%
$5 / $25
134 GPT-5.6 Terra (medium reasoning)OpenAI
33.3%
$2 / $12
134 Inkling SmallThinking Machines
33.3%
$0.45 / $1.20
137 GPT-6 Luna (high reasoning)OpenAI
32.9%
$0.10 / $0.50
138 GPT-5.5 (low reasoning)OpenAI
32.7%
$5 / $30
139 Grok 4.20 (0309, reasoning)xAI
32.4%
–
140 Inkling (extra-high reasoning)Thinking Machines
31.9%
$1 / $4.05
141 Qwen3.6-Max-PreviewAlibaba
30.8%
–
141 GPT-5.4 (low reasoning)OpenAI
30.8%
$2.50 / $15
143 Kimi K2.5Moonshot AI
30.7%
$0.57 / $2.85
143 Nemotron 3.5 Super VLNVIDIA
30.7%
$0.15 / $0.50
145 DeepSeek-V4-Flash (0423, high reasoning)DeepSeek
30.3%
$0.05 / $0.45
146 Claude Opus 4.5 (reasoning on)Anthropic
30.1%
$5 / $25
146 GLM-5.1Z.ai
30.1%
$1.33 / $4.18
148 Claude Sonnet 5 (medium reasoning)Anthropic
30.0%
$2 / $10
148 Grok 4.3 (medium reasoning)xAI
30.0%
$1.25 / $2.50
150 Solar Pro 4Upstage
29.8%
$0.15 / $0.60
151 MiniMax-M2.7MiniMax
29.6%
$0.30 / $1.20
152 Gemini 3 Pro Preview (low reasoning)Google
29.5%
–
153 GLM-5Z.ai
29.3%
$1 / $3.20
154 GPT-5.6 Terra (low reasoning)OpenAI
29.2%
$2 / $12
155 Qwen3.5-397B-A17BAlibaba
29.0%
$0.55 / $3.50
156 DeepSeek-V3.2-SpecialeDeepSeek
28.7%
–
157 GPT-5.1 (high reasoning)OpenAI
28.5%
$1.25 / $10
157 GPT-5 (high reasoning)OpenAI
28.5%
$1.25 / $10
159 GPT-5.4 nano (extra-high reasoning)OpenAI
28.3%
$0.20 / $1.25
159 GPT-6 Luna (medium reasoning)OpenAI
28.3%
$0.10 / $0.50
161 GPT-5.4 mini (extra-high reasoning)OpenAI
28.1%
$0.75 / $4.50
162 Qwen3-Max-ThinkingAlibaba
28.0%
–
163 Grok 4.20 (no reasoning)xAI
27.9%
$1.25 / $2.50
163 GLM-5.1 (no reasoning)Z.ai
27.9%
$1.33 / $4.18
165 Qwen3.6-PlusAlibaba
27.8%
$0.33 / $1.95
165 GPT-5-Codex (high reasoning)OpenAI
27.8%
–
165 Hy3 Preview (reasoning on)Tencent
27.8%
$0.18 / $0.60
165 GLM-5-TurboZ.ai
27.8%
$1.20 / $4
169 Grok 4.6 (low reasoning)xAI
27.6%
$2 / $6
170 GLM-4.7Z.ai
27.4%
$0.60 / $2.20
171 MiMo-V2.5Xiaomi
27.2%
$0.40 / $2
172 Claude Haiku 5.5 (low reasoning)Anthropic
27.0%
$0.10 / $0.50
173 GPT-5.2 (medium reasoning)OpenAI
26.7%
$1.75 / $14
173 Grok 4xAI
26.7%
–
175 GPT-5.6 Luna (medium reasoning)OpenAI
25.8%
$0.20 / $1.20
176 GPT-5.1-Codex (high reasoning)OpenAI
25.7%
$1.25 / $10
177 GPT-5 (medium reasoning)OpenAI
25.4%
$1.25 / $10
178 Qwen3.5-122B-A10BAlibaba
25.2%
$0.26 / $2.08
179 Kimi K3 (low reasoning)Moonshot AI
25.0%
$3 / $15
180 DeepSeek-V3.2 (reasoning on)DeepSeek
24.6%
$0.28 / $0.42
181 Grok 4.20 (0309, non-reasoning, no reasoning)xAI
24.5%
–
182 Gemini 3.5 Flash (minimal reasoning)Google
24.1%
$1.50 / $9
183 Qwen3.5-27BAlibaba
23.9%
$0.27 / $2.16
184 Kimi K2 ThinkingMoonshot AI
23.8%
$0.60 / $2.50
185 Gemma 4 31BGoogle
23.6%
$0.15 / $0.40
186 MiniMax-M2.1MiniMax
23.2%
–
187 Qwen3.6-27BAlibaba
23.1%
$0.30 / $3.20
188 Gemini 2.5 ProGoogle
22.5%
$1.25 / $10
189 Qwen3.6-35B-A3BAlibaba
22.2%
$0.10 / $0.95
190 Muse Glimmer (high reasoning)Meta
22.0%
–
191 Claude Sonnet 5 (low reasoning)Anthropic
21.9%
$2 / $10
192 GPT-5.5 Instant (2026-05-26)OpenAI
21.6%
–
193 GPT-5 mini (high reasoning)OpenAI
21.5%
$0.25 / $2
194 GPT-6.1 Terra (no reasoning)OpenAI
21.1%
$1 / $5
194 Step 3.5 FlashStepFun
21.1%
$0.10 / $0.30
196 Qwen3.5-35B-A3BAlibaba
21.0%
$0.15 / $1
197 Nemotron 3 Super 120B A12BNVIDIA
20.8%
$0.08 / $0.45
198 MiniMax-M2.5MiniMax
20.5%
$0.29 / $1.20
199 GPT-6 Luna (low reasoning)OpenAI
20.3%
$0.10 / $0.50
200 o3OpenAI
20.1%
$2 / $8
201 GPT-5.5 Instant (2026-06-26)OpenAI
19.9%
–
202 Qwen3.5-397B-A17B (no reasoning)Alibaba
19.8%
$0.55 / $3.50
202 GPT-5.6 Luna (low reasoning)OpenAI
19.8%
$0.20 / $1.20
204 Kimi K2.6 (no reasoning)Moonshot AI
19.6%
$0.95 / $4
204 GPT-5 (low reasoning)OpenAI
19.6%
$1.25 / $10
204 gpt-oss-120b (high reasoning)OpenAI
19.6%
$0.10 / $0.50
207 Gemma 4 26B A4BGoogle
19.3%
$0.09 / $0.30
207 Grok 4.1 Fast (reasoning)xAI
19.3%
–
209 Claude Opus 4.6 (no reasoning)Anthropic
19.1%
$5 / $25
209 Grok 4 Fast (reasoning)xAI
19.1%
–
211 Claude Sonnet 5 (no reasoning)Anthropic
19.0%
$2 / $10
212 Gemini 3.5 Flash-LiteGoogle
18.8%
$0.30 / $2.50
213 GPT-5.4 mini (medium reasoning)OpenAI
18.6%
$0.75 / $4.50
214 GPT-5.1-Codex-Mini (high reasoning)OpenAI
18.5%
$0.25 / $2
215 GPT-6 Sol (no reasoning)OpenAI
18.4%
$2 / $10
215 Grok 4.3 (low reasoning)xAI
18.4%
$1.25 / $2.50
217 Claude Sonnet 4.5 (reasoning on)Anthropic
17.8%
$3 / $15
218 Gemini 3.1 Flash-Lite PreviewGoogle
17.2%
$0.25 / $1.50
219 Mercury 2Inception
17.1%
–
219 GLM-5V-TurboZ.ai
17.1%
$1.20 / $4
221 GPT-5.6 Sol (no reasoning)OpenAI
16.7%
$4 / $20
222 o4-mini (high reasoning)OpenAI
16.5%
–
223 DeepSeek-V3.1-Terminus (reasoning on)DeepSeek
16.4%
$0.27 / $1
224 Qwen3-235B-A22B-Thinking-2507Alibaba
15.9%
$0.45 / $3.50
224 Qwen3.5-122B-A10B (no reasoning)Alibaba
15.9%
$0.26 / $2.08
224 GPT-5.4 nano (medium reasoning)OpenAI
15.9%
$0.20 / $1.25
224 GPT-5 mini (medium reasoning)OpenAI
15.9%
$0.25 / $2
228 Trinity Large ThinkingArcee AI
15.8%
–
228 DeepSeek-R1-0528DeepSeek
15.8%
$0.50 / $2.18
230 Gemma 4 12BGoogle
15.7%
–
231 Qwen3.6-27B (no reasoning)Alibaba
15.1%
$0.30 / $3.20
232 Gemini 3 Flash Preview (no reasoning)Google
15.0%
$0.50 / $3
233 Qwen3.5-9BAlibaba
14.9%
$0.10 / $0.15
233 Qwen3.5-Omni-PlusAlibaba
14.9%
–
233 DeepSeek-V3.2-Exp (reasoning on)DeepSeek
14.9%
$0.27 / $0.41
236 MiMo-V2.5-Pro (no reasoning)Xiaomi
14.8%
$0.43 / $0.87
237 GLM-4.6 (reasoning on)Z.ai
14.5%
$0.50 / $2
238 DeepSeek-V3.1 (reasoning on)DeepSeek
14.3%
$0.27 / $1
239 Qwen3.8-27B (medium reasoning)Alibaba
14.1%
$0.50 / $3
240 Qwen3.8-27B (low reasoning)Alibaba
14.0%
$0.50 / $3
241 Qwen3.5-27B (no reasoning)Alibaba
13.9%
$0.27 / $2.16
241 Qwen3.6-35B-A3B (no reasoning)Alibaba
13.9%
$0.10 / $0.95
243 Gemini 2.5 Flash Preview (09-2025, reasoning on)Google
13.8%
–
243 Mistral Medium 3.5Mistral AI
13.8%
$1.50 / $7.50
245 MiniMax-M2MiniMax
13.7%
–
245 GPT-5.5 (no reasoning)OpenAI
13.7%
$5 / $30
247 Qwen3.5-35B-A3B (no reasoning)Alibaba
13.4%
$0.15 / $1
248 Claude Sonnet 4.6 (no reasoning)Anthropic
13.3%
$3 / $15
249 Claude Opus 4.5 (no reasoning)Anthropic
13.2%
$5 / $25
249 Kimi K2.5 (no reasoning)Moonshot AI
13.2%
$0.57 / $2.85
251 GLM-4.5Z.ai
13.0%
$0.60 / $2.20
252 Qwen3-Max-Thinking-PreviewAlibaba
12.7%
–
253 Qwen3-Next-80B-A3B-ThinkingAlibaba
12.6%
–
254 Claude Opus 4.1 (reasoning on)Anthropic
12.5%
$15 / $75
255 Qwen3.8-27B (no reasoning)Alibaba
12.1%
$0.50 / $3
255 Gemini 2.5 Flash (reasoning on)Google
12.1%
$0.30 / $2.50
257 o3-mini (high reasoning)OpenAI
12.0%
–
258 Qwen3-MaxAlibaba
11.9%
–
258 Qwen3-VL-235B-A22B-ThinkingAlibaba
11.9%
–
260 Gemma 4 31B (no reasoning)Google
11.8%
$0.15 / $0.40
261 Nova 2 Lite (high reasoning)Amazon
11.6%
$0.30 / $2.50
262 DeepSeek-V4.1-Flash-1017 (no reasoning)DeepSeek
11.5%
$0.30 / $1.20
262 Gemma 4 26B A4B (no reasoning)Google
11.5%
$0.09 / $0.30
264 Nemotron 3 Nano 30B A3B (reasoning on)NVIDIA
11.4%
$0.06 / $0.24
264 GPT-5.6 Terra (no reasoning)OpenAI
11.4%
$2 / $12
266 GPT-5.4 (no reasoning)OpenAI
11.3%
$2.50 / $15
267 DeepSeek-V3.2 (no reasoning)DeepSeek
11.2%
$0.28 / $0.42
268 Qwen3-235B-A22B-Instruct-2507Alibaba
11.1%
$0.15 / $0.75
269 Qwen3-235B-A22B (reasoning on)Alibaba
11.0%
–
269 gpt-oss-20b (high reasoning)OpenAI
11.0%
$0.03 / $0.14
271 DeepSeek-V4.1-Flash (no reasoning)DeepSeek
10.8%
$0.30 / $1.20
271 DiffusionGemma 26B A4BGoogle
10.8%
–
273 Claude Sonnet 4 (reasoning on)Anthropic
10.7%
–
274 DeepSeek-V4-Pro (0813, no reasoning)DeepSeek
10.6%
$1.32 / $3.96
275 Claude Haiku 4.5 (reasoning on)Anthropic
10.4%
$1 / $5
276 Qwen3-30B-A3B-Thinking-2507Alibaba
10.3%
–
276 Magistral Medium 1.2Mistral AI
10.3%
–
276 Solar Pro 3Upstage
10.3%
–
279 Qwen3-Coder-NextAlibaba
10.1%
$0.12 / $0.80
279 Qwen3-Max-PreviewAlibaba
10.1%
–
279 Qwen3-VL-32B-ThinkingAlibaba
10.1%
–
282 Qwen3.5-4B (reasoning on)Alibaba
9.9%
–
282 Mistral Small 4Mistral AI
9.9%
$0.15 / $0.60
284 GLM-5.2 (no reasoning)Z.ai
9.8%
$1.40 / $4.40
285 Granite 4.2 8BIBM
9.7%
$0.06 / $0.15
286 GLM-4.6V (reasoning on)Z.ai
9.6%
$0.30 / $0.90
287 GPT-5 nano (high reasoning)OpenAI
9.5%
$0.05 / $0.40
288 Qwen3.5-9B (no reasoning)Alibaba
9.4%
$0.10 / $0.15
289 Nova 2 Lite (medium reasoning)Amazon
9.0%
$0.30 / $2.50
289 DeepSeek-V3.2-Exp (no reasoning)DeepSeek
9.0%
$0.27 / $0.41
291 Qwen3-VL-30B-A3B-ThinkingAlibaba
8.9%
$0.29 / $1
292 DeepSeek-V3.1-Terminus (no reasoning)DeepSeek
8.7%
$0.27 / $1
292 Gemini 2.5 Flash Preview (09-2025, no reasoning)Google
8.7%
–
292 GPT-5 nano (medium reasoning)OpenAI
8.7%
$0.05 / $0.40
295 GPT-6 Luna (no reasoning)OpenAI
8.6%
$0.10 / $0.50
296 DeepSeek-R1DeepSeek
8.5%
–
297 DeepSeek-V4-Pro (0423, no reasoning)DeepSeek
8.2%
$1.42 / $2.83
298 Qwen3.5-4B (no reasoning)Alibaba
8.0%
–
298 GPT-5.2 (no reasoning)OpenAI
8.0%
$1.75 / $14
298 Grok Code Fast 1xAI
8.0%
–
301 o3-miniOpenAI
7.9%
–
302 DeepSeek-V4-Flash (0423, no reasoning)DeepSeek
7.8%
$0.05 / $0.45
303 Qwen3.5-Omni-FlashAlibaba
7.6%
–
303 Qwen3-Next-80B-A3B-InstructAlibaba
7.6%
$0.09 / $1.10
303 GLM-4.7-FlashZ.ai
7.6%
$0.06 / $0.40
303 GLM-5 (no reasoning)Z.ai
7.6%
$1 / $3.20
307 Qwen3-Omni-30B-A3B-ThinkingAlibaba
7.5%
–
308 Qwen3-32B (reasoning on)Alibaba
7.4%
$0.14 / $0.40
308 Kimi K2 (0711)Moonshot AI
7.4%
$0.57 / $2.30
310 Claude Sonnet 4.5 (no reasoning)Anthropic
7.2%
$3 / $15
310 GPT-5.6 Luna (no reasoning)OpenAI
7.2%
$0.20 / $1.20
312 Gemini 2.5 Flash-Lite Preview (09-2025, reasoning on)Google
7.0%
–
312 o1OpenAI
7.0%
–
312 Hy3 Preview (no reasoning)Tencent
7.0%
$0.18 / $0.60
312 GLM-4.5-AirZ.ai
7.0%
$0.14 / $0.86
316 Qwen3-30B-A3B-Instruct-2507Alibaba
6.9%
$0.09 / $0.30
317 Qwen3-VL-32B-InstructAlibaba
6.8%
–
317 Gemini 2.5 Flash-Lite (reasoning on)Google
6.8%
$0.10 / $0.40
317 Grok 4.3 (no reasoning)xAI
6.8%
$1.25 / $2.50
320 DeepSeek-V3.1 (no reasoning)DeepSeek
6.7%
$0.27 / $1
321 Qwen3-VL-235B-A22B-InstructAlibaba
6.6%
$0.21 / $1.90
321 GPT-5 ChatOpenAI
6.6%
–
323 Magistral Small 1.2Mistral AI
6.4%
–
323 Kimi K2 (0905)Moonshot AI
6.4%
$0.60 / $2.50
323 GLM-4.7 (no reasoning)Z.ai
6.4%
$0.60 / $2.20
326 Qwen3-VL-30B-A3B-InstructAlibaba
6.3%
$0.20 / $0.70
326 Gemma 4 12B (no reasoning)Google
6.3%
–
326 GLM-4.5V (reasoning on)Z.ai
6.3%
$0.60 / $1.80
329 Qwen3-30B-A3B (reasoning on)Alibaba
6.2%
$0.12 / $0.50
329 Qwen3-4B-Thinking-2507Alibaba
6.2%
–
331 GPT-5 (minimal reasoning)OpenAI
6.0%
$1.25 / $10
332 GPT-5.4 mini (no reasoning)OpenAI
5.9%
$0.75 / $4.50
332 gpt-oss-120b (low reasoning)OpenAI
5.9%
$0.10 / $0.50
334 Llama 3.2 1B InstructMeta
5.5%
$0.027 / $0.20
334 GLM-4.6 (no reasoning)Z.ai
5.5%
$0.50 / $2
336 Ministral 3 3BMistral AI
5.4%
$0.10 / $0.10
337 Gemma 3 4BGoogle
5.3%
$0.04 / $0.05
337 Llama 3.1 8B InstructMeta
5.3%
$0.05 / $0.08
337 Llama 3.2 3B InstructMeta
5.3%
$0.05 / $0.33
337 GPT-5.1 (no reasoning)OpenAI
5.3%
$1.25 / $10
337 gpt-oss-20b (low reasoning)OpenAI
5.3%
$0.03 / $0.14
342 Qwen3.5-0.8B (no reasoning)Alibaba
5.1%
–
342 Gemini 2.5 Flash-Lite Preview (09-2025, no reasoning)Google
5.1%
–
342 GPT-5 mini (minimal reasoning)OpenAI
5.1%
$0.25 / $2
342 Grok 4.1 Fast (non-reasoning, no reasoning)xAI
5.1%
–
346 Qwen3.5-2B (no reasoning)Alibaba
5.0%
–
346 GPT-4.1 miniOpenAI
5.0%
$0.40 / $1.60
346 GLM-4.7-Flash (no reasoning)Z.ai
5.0%
$0.06 / $0.40
349 Llama 4 MaverickMeta
4.9%
$0.35 / $1
350 Gemma 4 E2BGoogle
4.8%
–
350 Gemma 4 E4B (no reasoning)Google
4.8%
–
352 DeepSeek-V3-0324DeepSeek
4.7%
$0.25 / $1
352 Gemini 2.5 Flash (no reasoning)Google
4.7%
$0.30 / $2.50
352 Gemma 4 E2B (no reasoning)Google
4.7%
–
352 Mistral Medium 3.1Mistral AI
4.7%
$0.40 / $2
356 Qwen3-30B-A3B (no reasoning)Alibaba
4.6%
$0.12 / $0.50
356 Qwen3-Omni-30B-A3B-InstructAlibaba
4.6%
–
356 Qwen3-VL-4B-ThinkingAlibaba
4.6%
–
356 Nova Micro 1.0Amazon
4.6%
$0.035 / $0.14
356 Ministral 3 14BMistral AI
4.6%
$0.20 / $0.20
356 Nemotron 3 Nano 30B A3B (no reasoning)NVIDIA
4.6%
$0.06 / $0.24
362 Qwen3-14B (reasoning on)Alibaba
4.5%
$0.10 / $0.22
362 Qwen3-4B-Instruct-2507Alibaba
4.5%
–
362 Qwen3-Coder-480B-A35BAlibaba
4.5%
$0.30 / $1
362 Llama 3.1 70B InstructMeta
4.5%
$0.72 / $0.72
362 Grok 4 Fast (non-reasoning, no reasoning)xAI
4.5%
–
367 Gemma 3 27BGoogle
4.4%
$0.08 / $0.35
367 Reka Flash 3Reka AI
4.4%
$0.10 / $0.20
369 Nova Lite 1.0Amazon
4.3%
$0.06 / $0.24
369 Claude Sonnet 4 (no reasoning)Anthropic
4.3%
–
369 Ministral 3 8BMistral AI
4.3%
$0.15 / $0.15
369 Mistral Small 3.1 24BMistral AI
4.3%
$0.35 / $0.56
369 Mistral Small 3.2 24BMistral AI
4.3%
$0.094 / $0.25
374 Qwen3-235B-A22B (no reasoning)Alibaba
4.2%
–
374 Claude Haiku 4.5 (no reasoning)Anthropic
4.2%
$1 / $5
374 Gemma 3 12BGoogle
4.2%
$0.05 / $0.15
374 Mistral Large 3Mistral AI
4.2%
$0.50 / $1.50
374 GPT-4.1OpenAI
4.2%
$2 / $8
374 GPT-4o mini (2024-07-18)OpenAI
4.2%
$0.15 / $0.60
380 Qwen3-14B (no reasoning)Alibaba
4.1%
$0.10 / $0.22
380 Qwen3-32B (no reasoning)Alibaba
4.1%
$0.14 / $0.40
380 Mistral Medium 3Mistral AI
4.1%
$0.40 / $2
380 GPT-5.4 nano (no reasoning)OpenAI
4.1%
$0.20 / $1.25
384 Nova 2 Lite (low reasoning)Amazon
4.0%
$0.30 / $2.50
384 Command ACohere
4.0%
$2.50 / $10
384 Mixtral 8x22B InstructMistral AI
4.0%
$2 / $6
384 GPT-5 nano (minimal reasoning)OpenAI
4.0%
$0.05 / $0.40
388 Qwen3-8B (reasoning on)Alibaba
3.9%
–
389 Qwen3-Coder-30B-A3B-InstructAlibaba
3.8%
$0.07 / $0.28
389 Qwen3-VL-8B-ThinkingAlibaba
3.8%
–
389 Gemma 4 E4BGoogle
3.8%
–
389 Llama 4 ScoutMeta
3.8%
$0.10 / $0.30
389 Phi-4Microsoft
3.8%
$0.07 / $0.14
389 Devstral MediumMistral AI
3.8%
–
389 Devstral Small 1.1Mistral AI
3.8%
–
389 Mistral Small 3Mistral AI
3.8%
$0.05 / $0.08
389 Mistral Small 4 (no reasoning)Mistral AI
3.8%
$0.15 / $0.60
389 GPT-4.1 nanoOpenAI
3.8%
$0.10 / $0.40
399 Gemini 2.5 Flash-Lite (no reasoning)Google
3.7%
$0.10 / $0.40
399 GLM-4.6V (no reasoning)Z.ai
3.7%
$0.30 / $0.90
401 Qwen2.5-72B-InstructAlibaba
3.6%
$0.36 / $0.40
401 Qwen3-VL-4B-InstructAlibaba
3.6%
–
401 Gemma 3 270MGoogle
3.6%
–
401 Llama 3.3 70B InstructMeta
3.6%
$0.71 / $0.71
401 Devstral 2Mistral AI
3.6%
$0.40 / $2
406 Qwen2.5-Coder-32B-InstructAlibaba
3.5%
$0.66 / $1
406 Devstral Small 2Mistral AI
3.5%
–
406 GLM-4.5V (no reasoning)Z.ai
3.5%
$0.60 / $1.80
409 Nova Pro 1.0Amazon
3.2%
$0.80 / $3.20
410 Nova 2 Lite (no reasoning)Amazon
2.9%
$0.30 / $2.50
410 DeepSeek-V3DeepSeek
2.9%
$0.26 / $1.03
410 Mistral Large 2 (2407)Mistral AI
2.9%
$2 / $6
413 Qwen3-VL-8B-InstructAlibaba
2.7%
$0.25 / $0.75
414 Qwen3.5-2B (reasoning on)Alibaba
2.6%
–
415 Kimi Linear 48B A3B InstructMoonshot AI
2.5%
–
416 GPT-4o (2024-08-06)OpenAI
2.3%
$2.50 / $10
417 Qwen3-8B (no reasoning)Alibaba
1.9%
–
418 GPT-4o (2024-05-13)OpenAI
1.8%
$5 / $15
419 Qwen3.5-0.8B (reasoning on)Alibaba
1.1%
–

Swipe the table sideways for more columns.

Source: Artificial Analysis, via Spring Prompt, springprompt.com/benchmarks/artificial-analysis. Test your own prompt on these models →

Ranks follow the score as shown, so equal numbers share a rank. Results as published by Artificial Analysis; we do not re-run them.

Progress over time

Humanity's Last Exam, plotted at each model's release date, higher is better. Each model counts once, at its best setting. Scores are today's, not launch day's. Hover or tap a mark for its model.

Best score so far

Every model at its release date. The line moves each time a new release beats every earlier one, and each new best is named where there is room.

-20%0%20%40%60%80% Jul 20242025Jul2026Jul GPT-4o mini (2024-07-18)Llama 3.1 8B Instructo1DeepSeek-R1o3-miniGemini 2.5 ProGrok 4GPT-5Gemini 3 Pro PreviewGPT-5.3-CodexGemini 3.1 Pro PreviewClaude Opus 4.8Claude Fable 5Claude Fable 5.1Claude Opus 5.5

Best score by lab

Each lab's best so far, stepping whenever one of its releases beats its own earlier models. The 6 labs with the best scores today; 19 others not drawn.

AnthropicGoogleOpenAIMoonshot AIMetaXiaomi

-20%0%20%40%60%80% Jul 20242025Jul2026Jul AnthropicGoogleOpenAIMoonshot AIMetaXiaomi

What it measures

Share of expert-written exam questions answered correctly, as run by Artificial Analysis with its own harness and prompts.

What it does not measure

Not everyday work; academic questions at the edge of expertise.

291 results from Artificial Analysis not ranked here · show why

We rank a result only when we can tie it to a specific model you can use. These are left out:

  • Not on sale through the API providers we track: 276
  • A different snapshot or variant from the model we list: 14
  • An unusual combination of settings: 1

Data sourced from Artificial Analysis. Licence: Artificial Analysis commercial data licence.