Benchmarks / Artificial Analysis

Reported by Artificial Analysis

Artificial Analysis

Share of expert-written exam questions answered correctly, as run by Artificial Analysis with its own harness and prompts.

Last updated 20 Oct 2026

Results dated
20 Oct 2026
Results
411 configurations of 248 models
Unit
% of questions
Licence
Artificial Analysis commercial data licence

Humanity's Last Exam: Beam 1.0 501B A23B

Top 15 of 248 results · % of questions, higher is better. Choose a model to highlight it.Clear highlight

  1. 1 Claude Opus 5.5 (max reasoning)Anthropic 61.4%
  2. 2 Claude Fable 5.1 (max reasoning)Anthropic 59.1%
  3. 3 Gemini 4 Argon (high reasoning)Google 57.1%
  4. 4 Claude Fable 5 (max reasoning)Anthropic 55.5%
  5. 5 Claude Sonnet 5.5 (max reasoning)Anthropic 55.0%
  6. 6 Claude Opus 5 (max reasoning)Anthropic 54.9%
  7. 7 GPT-6 Astra (max reasoning)OpenAI 54.7%
  8. 8 GPT-6.1 Sol (max reasoning)OpenAI 52.9%
  9. 9 Muse Wonder (max reasoning)Meta 50.1%
  10. 10 GPT-5.6 Sol (max reasoning)OpenAI 49.5%
  11. 11 MiMo-V2.6-ProXiaomi 49.4%
  12. 12 Claude Opus 4.8 (max reasoning)Anthropic 48.7%
  13. 12 Muse Spark 1.3 (max reasoning)Meta 48.7%
  14. 14 MiniMax M3.1 FlashMiniMax 48.0%
  15. 15 Gemini 3.7 Flash (high reasoning)Google 47.9%
  16. 66 Beam 1.0 501B A23BReflection 34.7%

Full results

Artificial Analysis: Humanity's Last Exam, % of questions, higher is better
#ModelHumanity's Last Exam
% of questions, higher is better		Price
$ per million tokens, in / out
1 Claude Opus 5.5 (max reasoning)Anthropic · best of 5 settings
61.4%
$4 / $20
2 Claude Fable 5.1 (max reasoning)Anthropic · best of 5 settings
59.1%
$10 / $50
3 Gemini 4 Argon (high reasoning)Google
57.1%
$2 / $10
4 Claude Fable 5 (max reasoning)Anthropic
55.5%
$10 / $50
5 Claude Sonnet 5.5 (max reasoning)Anthropic · best of 5 settings
55.0%
$2 / $10
6 Claude Opus 5 (max reasoning)Anthropic · best of 5 settings
54.9%
$5 / $25
7 GPT-6 Astra (max reasoning)OpenAI · best of 5 settings
54.7%
$10 / $50
8 GPT-6.1 Sol (max reasoning)OpenAI · best of 5 settings
52.9%
$2 / $10
9 Muse Wonder (max reasoning)Meta
50.1%
$4 / $20
10 GPT-5.6 Sol (max reasoning)OpenAI · best of 6 settings
49.5%
$4 / $20
11 MiMo-V2.6-ProXiaomi
49.4%
$0.43 / $0.87
12 Claude Opus 4.8 (max reasoning)Anthropic
48.7%
$5 / $25
12 Muse Spark 1.3 (max reasoning)Meta · best of 2 settings
48.7%
$1.25 / $4.25
14 MiniMax M3.1 FlashMiniMax
48.0%
$0.15 / $0.60
15 Gemini 3.7 Flash (high reasoning)Google · best of 3 settings
47.9%
$1.50 / $7.50
15 GPT-6 Sol (max reasoning)OpenAI · best of 6 settings
47.9%
$2 / $10
17 Gemini 3.8 Flash (high reasoning)Google · best of 3 settings
47.8%
$1.50 / $7.50
18 Gemini 3.1 Pro PreviewGoogle
47.0%
$2 / $12
19 Kimi K3 (max reasoning)Moonshot AI · best of 2 settings
46.9%
$3 / $15
20 Muse Spark 1.1 (extra-high reasoning)Meta
46.2%
$1.25 / $4.25
21 GPT-5.5 (extra-high reasoning)OpenAI · best of 5 settings
45.8%
$5 / $30
22 Muse Spark 1.2 (extra-high reasoning)Meta
45.5%
$1.25 / $4.25
23 Claude Haiku 5.5 (max reasoning)Anthropic · best of 5 settings
44.4%
$0.10 / $0.50
24 Grok 4.6 (extra-high reasoning)xAI · best of 4 settings
44.1%
$2 / $6
25 Muse Spark Open (extra-high reasoning)Meta
43.9%
–
26 GPT-5.4 (extra-high reasoning)OpenAI · best of 3 settings
43.7%
$2.50 / $15
27 DeepSeek-V4.1-Flash-1017 (max reasoning)DeepSeek
43.3%
$0.30 / $1.20
28 Qwen3.8-Max (0902)Alibaba
43.1%
$2 / $6
28 Grok 4.7 (extra-high reasoning)xAI · best of 3 settings
43.1%
$2 / $6
30 Qwen3.8-Max (0803)Alibaba
43.0%
–
31 GPT-5.6 Terra (max reasoning)OpenAI · best of 6 settings
42.9%
$2 / $12
32 Gemini 3.5 Flash (high reasoning)Google · best of 3 settings
42.7%
$1.50 / $9
32 Grok 4.5 (high reasoning)xAI
42.7%
$2 / $6
34 GPT-5.3-Codex (extra-high reasoning)OpenAI
42.5%
$1.75 / $14
35 Qwen3.8-2.4T-A95BAlibaba
42.4%
$2 / $6
36 Claude Opus 4.7 (max reasoning)Anthropic · best of 2 settings
42.3%
$5 / $25
36 GLM-5.3 (max reasoning)Z.ai · best of 2 settings
42.3%
$1.40 / $4.40
38 Claude Sonnet 5 (max reasoning)Anthropic · best of 6 settings
41.3%
$2 / $10
39 GLM-5.2 (max reasoning)Z.ai · best of 2 settings
41.1%
$1.40 / $4.40
40 DeepSeek-V4-Pro (0813, max reasoning)DeepSeek · best of 2 settings
41.0%
$1.32 / $3.96
41 Gemini 3.6 Flash (high reasoning)Google
40.8%
$1.50 / $7.50
42 Muse SparkMeta
40.7%
–
43 Qwen3.7-MaxAlibaba
40.5%
$1.48 / $4.42
44 Claude Opus 4.6 (max reasoning)Anthropic · best of 2 settings
39.9%
$5 / $25
44 GLM-5.3-FlashZ.ai
39.9%
$0.15 / $0.50
46 Gemini 3 Pro Preview (high reasoning)Google · best of 2 settings
39.7%
–
47 GPT-5.6 Luna (max reasoning)OpenAI · best of 6 settings
39.5%
$0.20 / $1.20
48 DeepSeek-V4.1-Flash (max reasoning)DeepSeek · best of 2 settings
39.2%
$0.30 / $1.20
49 MiniMax-M3MiniMax
39.0%
$0.30 / $1.20
50 DeepSeek-V4-Flash (0731, max reasoning)DeepSeek
38.6%
$0.14 / $0.28
51 GPT-6 Luna (max reasoning)OpenAI · best of 6 settings
38.5%
$0.10 / $0.50
52 Grok Build 0.1xAI
38.3%
$1 / $2
53 Qwen3.8-Flash-NextAlibaba
38.0%
–
54 GPT-5.2 (extra-high reasoning)OpenAI · best of 3 settings
37.7%
$1.75 / $14
55 DeepSeek-V4-Pro (0423, max reasoning)DeepSeek · best of 3 settings
37.5%
$1.42 / $2.83
55 Kimi K2.6Moonshot AI · best of 2 settings
37.5%
$0.95 / $4
57 Grok 4.3 (high reasoning)xAI · best of 4 settings
37.2%
$1.25 / $2.50
58 Gemini 3 Flash Preview (reasoning on)Google · best of 2 settings
36.6%
$0.50 / $3
59 GPT-5.2-Codex (extra-high reasoning)OpenAI
35.7%
$1.75 / $14
59 MiMo-V2.5-Pro (reasoning on)Xiaomi · best of 2 settings
35.7%
$0.43 / $0.87
61 Qwen3.7-PlusAlibaba
35.6%
$0.32 / $1.28
62 MiMo-V2.6-FlashXiaomi
35.1%
$0.14 / $0.28
63 Mistral Large 4Mistral AI
35.0%
$1.36 / $4.18
63 Kimi K2.7 CodeMoonshot AI
35.0%
$0.95 / $4
65 DeepSeek-V4-Flash (0423, max reasoning)DeepSeek · best of 3 settings
34.8%
$0.14 / $0.28
66 Beam 1.0 501B A23BReflection
34.7%
–
67 DeepSeek-V4-Flash-Vision-Exp (max reasoning)DeepSeek
34.5%
$0.44 / $1.32
67 Grok 4.20xAI · best of 2 settings
34.5%
$1.25 / $2.50
69 Qwen3.8-27B (extra-high reasoning)Alibaba · best of 4 settings
33.9%
$0.50 / $3
70 Claude Sonnet 4.6 (max reasoning)Anthropic · best of 2 settings
33.6%
$3 / $15
71 Hy3Tencent
33.5%
$0.14 / $0.58
72 Inkling SmallThinking Machines
33.3%
$0.45 / $1.20
73 Grok 4.20 (0309, reasoning)xAI
32.4%
–
74 Inkling (extra-high reasoning)Thinking Machines
31.9%
$0.95 / $4.05
75 Qwen3.6-Max-PreviewAlibaba
30.8%
$1.03 / $6.16
76 Kimi K2.5Moonshot AI · best of 2 settings
30.7%
$0.57 / $2.85
76 Nemotron 3.5 Super VLNVIDIA
30.7%
–
78 Claude Opus 4.5 (reasoning on)Anthropic · best of 2 settings
30.1%
$5 / $25
78 GLM-5.1Z.ai · best of 2 settings
30.1%
$1.38 / $4.40
80 Solar Pro 4Upstage
29.8%
$0.09 / $0.36
81 MiniMax-M2.7MiniMax
29.6%
$0.30 / $1.20
82 GLM-5Z.ai · best of 2 settings
29.3%
$0.95 / $2.55
83 Qwen3.5-397B-A17BAlibaba · best of 2 settings
29.0%
$0.55 / $3.50
84 DeepSeek-V3.2-SpecialeDeepSeek
28.7%
–
85 GPT-5.1 (high reasoning)OpenAI · best of 2 settings
28.5%
$1.25 / $10
85 GPT-5 (high reasoning)OpenAI · best of 4 settings
28.5%
$1.25 / $10
87 GPT-5.4 nano (extra-high reasoning)OpenAI · best of 3 settings
28.3%
$0.20 / $1.25
88 GPT-5.4 mini (extra-high reasoning)OpenAI · best of 3 settings
28.1%
$0.75 / $4.50
89 Qwen3-Max-ThinkingAlibaba
28.0%
$0.78 / $3.90
90 Qwen3.6-PlusAlibaba
27.8%
$0.33 / $1.95
90 GPT-5-Codex (high reasoning)OpenAI
27.8%
–
90 Hy3 Preview (reasoning on)Tencent · best of 2 settings
27.8%
$0.18 / $0.60
90 GLM-5-TurboZ.ai
27.8%
$1.20 / $4
94 GLM-4.7Z.ai · best of 2 settings
27.4%
$0.54 / $1.98
95 MiMo-V2.5Xiaomi
27.2%
$0.17 / $0.34
96 Grok 4xAI
26.7%
–
97 GPT-5.1-Codex (high reasoning)OpenAI
25.7%
$1.25 / $10
98 Qwen3.5-122B-A10BAlibaba · best of 2 settings
25.2%
$0.26 / $2.08
99 DeepSeek-V3.2 (reasoning on)DeepSeek · best of 2 settings
24.6%
$0.30 / $0.96
100 Grok 4.20 (0309, non-reasoning, no reasoning)xAI
24.5%
–
101 Qwen3.5-27BAlibaba · best of 2 settings
23.9%
$0.27 / $2.16
102 Kimi K2 ThinkingMoonshot AI
23.8%
$0.60 / $2.50
103 Gemma 4 31BGoogle · best of 2 settings
23.6%
$0.14 / $0.40
104 MiniMax-M2.1MiniMax
23.2%
$0.30 / $1.20
105 Qwen3.6-27BAlibaba · best of 2 settings
23.1%
$0.30 / $3.20
106 Gemini 2.5 ProGoogle
22.5%
$1.25 / $10
107 Qwen3.6-35B-A3BAlibaba · best of 2 settings
22.2%
$0.10 / $1
108 Muse Glimmer (high reasoning)Meta
22.0%
–
109 GPT-5.5 Instant (2026-05-26)OpenAI · best of 2 settings
21.6%
–
110 GPT-5 mini (high reasoning)OpenAI · best of 3 settings
21.5%
$0.25 / $2
111 Step 3.5 FlashStepFun
21.1%
$0.10 / $0.30
112 Qwen3.5-35B-A3BAlibaba · best of 2 settings
21.0%
$0.16 / $1.30
113 Nemotron 3 Super 120B A12BNVIDIA
20.8%
$0.085 / $0.40
114 MiniMax-M2.5MiniMax
20.5%
$0.30 / $1.20
115 o3OpenAI
20.1%
$2 / $8
116 gpt-oss-120b (high reasoning)OpenAI · best of 2 settings
19.6%
$0.15 / $0.60
117 Gemma 4 26B A4BGoogle · best of 2 settings
19.3%
$0.10 / $0.30
117 Grok 4.1 Fast (reasoning)xAI
19.3%
–
119 Grok 4 Fast (reasoning)xAI
19.1%
–
120 Gemini 3.5 Flash-LiteGoogle
18.8%
$0.30 / $2.50
121 GPT-5.1-Codex-Mini (high reasoning)OpenAI
18.5%
$0.25 / $2
122 Claude Sonnet 4.5 (reasoning on)Anthropic · best of 2 settings
17.8%
$3 / $15
123 Gemini 3.1 Flash-Lite PreviewGoogle
17.2%
$0.25 / $1.50
124 Mercury 2Inception
17.1%
$0.25 / $0.75
124 GLM-5V-TurboZ.ai
17.1%
$1.20 / $4
126 o4-mini (high reasoning)OpenAI
16.5%
$1.10 / $4.40
127 DeepSeek-V3.1-Terminus (reasoning on)DeepSeek · best of 2 settings
16.4%
$0.27 / $1
128 Qwen3-235B-A22B-Thinking-2507Alibaba
15.9%
$0.30 / $3
129 Trinity Large ThinkingArcee AI
15.8%
$0.25 / $0.80
129 DeepSeek-R1-0528DeepSeek
15.8%
$0.50 / $2.18
131 Gemma 4 12BGoogle · best of 2 settings
15.7%
–
132 Qwen3.5-9BAlibaba · best of 2 settings
14.9%
$0.10 / $0.15
132 Qwen3.5-Omni-PlusAlibaba
14.9%
–
132 DeepSeek-V3.2-Exp (reasoning on)DeepSeek · best of 2 settings
14.9%
$0.27 / $0.41
135 GLM-4.6 (reasoning on)Z.ai · best of 2 settings
14.5%
$0.50 / $2
136 DeepSeek-V3.1 (reasoning on)DeepSeek · best of 2 settings
14.3%
$0.55 / $1.65
137 Gemini 2.5 Flash Preview (09-2025, reasoning on)Google · best of 2 settings
13.8%
–
137 Mistral Medium 3.5Mistral AI
13.8%
$1.50 / $7.50
139 MiniMax-M2MiniMax
13.7%
$0.30 / $1.20
140 GLM-4.5Z.ai
13.0%
$0.60 / $2.20
141 Qwen3-Max-Thinking-PreviewAlibaba
12.7%
–
142 Qwen3-Next-80B-A3B-ThinkingAlibaba
12.6%
$0.15 / $1.20
143 Claude Opus 4.1 (reasoning on)Anthropic
12.5%
$15 / $75
144 Gemini 2.5 Flash (reasoning on)Google · best of 2 settings
12.1%
$0.30 / $2.50
145 o3-mini (high reasoning)OpenAI · best of 2 settings
12.0%
$1.10 / $4.40
146 Qwen3-MaxAlibaba
11.9%
$0.78 / $3.90
146 Qwen3-VL-235B-A22B-ThinkingAlibaba
11.9%
$0.40 / $4
148 Nova 2 Lite (high reasoning)Amazon · best of 4 settings
11.6%
$0.30 / $2.50
149 Nemotron 3 Nano 30B A3B (reasoning on)NVIDIA · best of 2 settings
11.4%
$0.05 / $0.20
150 Qwen3-235B-A22B-Instruct-2507Alibaba
11.1%
$0.15 / $0.75
151 Qwen3-235B-A22B (reasoning on)Alibaba · best of 2 settings
11.0%
$0.46 / $1.82
151 gpt-oss-20b (high reasoning)OpenAI · best of 2 settings
11.0%
$0.03 / $0.15
153 DiffusionGemma 26B A4BGoogle
10.8%
–
154 Claude Sonnet 4 (reasoning on)Anthropic · best of 2 settings
10.7%
$3 / $15
155 Claude Haiku 4.5 (reasoning on)Anthropic · best of 2 settings
10.4%
$1 / $5
156 Qwen3-30B-A3B-Thinking-2507Alibaba
10.3%
$0.20 / $2.40
156 Magistral Medium 1.2Mistral AI
10.3%
–
156 Solar Pro 3Upstage
10.3%
$0.15 / $0.60
159 Qwen3-Coder-NextAlibaba
10.1%
$0.18 / $0.90
159 Qwen3-Max-PreviewAlibaba
10.1%
–
159 Qwen3-VL-32B-ThinkingAlibaba
10.1%
–
162 Qwen3.5-4B (reasoning on)Alibaba · best of 2 settings
9.9%
–
162 Mistral Small 4Mistral AI · best of 2 settings
9.9%
$0.15 / $0.60
164 Granite 4.2 8BIBM
9.7%
$0.06 / $0.25
165 GLM-4.6V (reasoning on)Z.ai · best of 2 settings
9.6%
$0.30 / $0.90
166 GPT-5 nano (high reasoning)OpenAI · best of 3 settings
9.5%
$0.05 / $0.40
167 Qwen3-VL-30B-A3B-ThinkingAlibaba
8.9%
$0.29 / $1
168 DeepSeek-R1DeepSeek
8.5%
$0.70 / $2.50
169 Grok Code Fast 1xAI
8.0%
–
170 Qwen3.5-Omni-FlashAlibaba
7.6%
–
170 Qwen3-Next-80B-A3B-InstructAlibaba
7.6%
$0.10 / $1.10
170 GLM-4.7-FlashZ.ai · best of 2 settings
7.6%
$0.06 / $0.40
173 Qwen3-Omni-30B-A3B-ThinkingAlibaba
7.5%
–
174 Qwen3-32B (reasoning on)Alibaba · best of 2 settings
7.4%
$0.14 / $0.40
174 Kimi K2 (0711)Moonshot AI
7.4%
$0.57 / $2.30
176 Gemini 2.5 Flash-Lite Preview (09-2025, reasoning on)Google · best of 2 settings
7.0%
–
176 o1OpenAI
7.0%
$15 / $60
176 GLM-4.5-AirZ.ai
7.0%
$0.14 / $0.86
179 Qwen3-30B-A3B-Instruct-2507Alibaba
6.9%
$0.09 / $0.30
180 Qwen3-VL-32B-InstructAlibaba
6.8%
$0.10 / $0.42
180 Gemini 2.5 Flash-Lite (reasoning on)Google · best of 2 settings
6.8%
$0.10 / $0.40
182 Qwen3-VL-235B-A22B-InstructAlibaba
6.6%
$0.30 / $1.50
182 GPT-5 ChatOpenAI
6.6%
–
184 Magistral Small 1.2Mistral AI
6.4%
–
184 Kimi K2 (0905)Moonshot AI
6.4%
$0.60 / $2.50
186 Qwen3-VL-30B-A3B-InstructAlibaba
6.3%
$0.15 / $0.60
186 GLM-4.5V (reasoning on)Z.ai · best of 2 settings
6.3%
$0.60 / $1.80
188 Qwen3-30B-A3B (reasoning on)Alibaba · best of 2 settings
6.2%
$0.12 / $0.50
188 Qwen3-4B-Thinking-2507Alibaba
6.2%
–
190 Llama 3.2 1B InstructMeta
5.5%
$0.027 / $0.20
191 Ministral 3 3BMistral AI
5.4%
$0.10 / $0.10
192 Gemma 3 4BGoogle
5.3%
$0.05 / $0.10
192 Llama 3.1 8B InstructMeta
5.3%
$0.05 / $0.08
192 Llama 3.2 3B InstructMeta
5.3%
$0.05 / $0.33
195 Qwen3.5-0.8B (no reasoning)Alibaba · best of 2 settings
5.1%
–
195 Grok 4.1 Fast (non-reasoning, no reasoning)xAI
5.1%
–
197 Qwen3.5-2B (no reasoning)Alibaba · best of 2 settings
5.0%
–
197 GPT-4.1 miniOpenAI
5.0%
$0.40 / $1.60
199 Llama 4 MaverickMeta
4.9%
$0.27 / $0.85
200 Gemma 4 E2BGoogle · best of 2 settings
4.8%
–
200 Gemma 4 E4B (no reasoning)Google · best of 2 settings
4.8%
–
202 DeepSeek-V3-0324DeepSeek
4.7%
$0.25 / $1
202 Mistral Medium 3.1Mistral AI
4.7%
$0.40 / $2
204 Qwen3-Omni-30B-A3B-InstructAlibaba
4.6%
–
204 Qwen3-VL-4B-ThinkingAlibaba
4.6%
–
204 Nova Micro 1.0Amazon
4.6%
$0.035 / $0.14
204 Ministral 3 14BMistral AI
4.6%
$0.20 / $0.20
208 Qwen3-14B (reasoning on)Alibaba · best of 2 settings
4.5%
$0.12 / $0.24
208 Qwen3-4B-Instruct-2507Alibaba
4.5%
–
208 Qwen3-Coder-480B-A35BAlibaba
4.5%
$0.35 / $1.50
208 Llama 3.1 70B InstructMeta
4.5%
$0.40 / $0.40
208 Grok 4 Fast (non-reasoning, no reasoning)xAI
4.5%
–
213 Gemma 3 27BGoogle
4.4%
$0.12 / $0.20
213 Reka Flash 3Reka AI
4.4%
$0.10 / $0.20
215 Nova Lite 1.0Amazon
4.3%
$0.06 / $0.24
215 Ministral 3 8BMistral AI
4.3%
$0.15 / $0.15
215 Mistral Small 3.1 24BMistral AI
4.3%
$0.35 / $0.56
215 Mistral Small 3.2 24BMistral AI
4.3%
$0.094 / $0.25
219 Gemma 3 12BGoogle
4.2%
$0.05 / $0.15
219 Mistral Large 3Mistral AI
4.2%
$0.50 / $1.50
219 GPT-4.1OpenAI
4.2%
$2 / $8
219 GPT-4o mini (2024-07-18)OpenAI
4.2%
$0.15 / $0.60
223 Mistral Medium 3Mistral AI
4.1%
$0.40 / $2
224 Command ACohere
4.0%
$2.50 / $10
224 Mixtral 8x22B InstructMistral AI
4.0%
$2 / $6
226 Qwen3-8B (reasoning on)Alibaba · best of 2 settings
3.9%
$0.12 / $0.46
227 Qwen3-Coder-30B-A3B-InstructAlibaba
3.8%
$0.07 / $0.28
227 Qwen3-VL-8B-ThinkingAlibaba
3.8%
$0.18 / $2.10
227 Llama 4 ScoutMeta
3.8%
$0.18 / $0.59
227 Phi-4Microsoft
3.8%
$0.07 / $0.14
227 Devstral MediumMistral AI
3.8%
–
227 Devstral Small 1.1Mistral AI
3.8%
–
227 Mistral Small 3Mistral AI
3.8%
$0.05 / $0.08
227 GPT-4.1 nanoOpenAI
3.8%
$0.10 / $0.40
235 Qwen2.5-72B-InstructAlibaba
3.6%
$0.36 / $0.40
235 Qwen3-VL-4B-InstructAlibaba
3.6%
–
235 Gemma 3 270MGoogle
3.6%
–
235 Llama 3.3 70B InstructMeta
3.6%
$0.59 / $0.79
235 Devstral 2Mistral AI
3.6%
$0.40 / $2
240 Qwen2.5-Coder-32B-InstructAlibaba
3.5%
$0.66 / $1
240 Devstral Small 2Mistral AI
3.5%
–
242 Nova Pro 1.0Amazon
3.2%
$0.80 / $3.20
243 DeepSeek-V3DeepSeek
2.9%
$0.26 / $1.03
243 Mistral Large 2 (2407)Mistral AI
2.9%
$2 / $6
245 Qwen3-VL-8B-InstructAlibaba
2.7%
$0.12 / $0.46
246 Kimi Linear 48B A3B InstructMoonshot AI
2.5%
–
247 GPT-4o (2024-08-06)OpenAI
2.3%
$2.50 / $10
248 GPT-4o (2024-05-13)OpenAI
1.8%
$5 / $15

Swipe the table sideways for more columns.

Ranks follow the score as shown, so equal numbers share a rank. Each model is shown at its best setting; show every setting. Results as published by Artificial Analysis; we do not re-run them.

Progress over time

Humanity's Last Exam, plotted at each model's release date, higher is better. Each model counts once, at its best setting. Scores are today's, not launch day's. Hover or tap a mark for its model.

Best score so far

Every model at its release date. The line moves each time a new release beats every earlier one, and each new best is named where there is room.

-20%0%20%40%60%80% Jul 20242025Jul2026Jul GPT-4o mini (2024-07-18)Llama 3.1 8B Instructo1DeepSeek-R1o3-miniGemini 2.5 ProGrok 4GPT-5Gemini 3 Pro PreviewGPT-5.3-CodexGemini 3.1 Pro PreviewClaude Opus 4.8Claude Fable 5Claude Fable 5.1Claude Opus 5.5

Best score by lab

Each lab's best so far, stepping whenever one of its releases beats its own earlier models. The 6 labs with the best scores today; 19 others not drawn.

AnthropicGoogleOpenAIMetaXiaomiMiniMax

-20%0%20%40%60%80% Jul 20242025Jul2026Jul AnthropicGoogleOpenAIMetaXiaomiMiniMax

What it measures

Share of expert-written exam questions answered correctly, as run by Artificial Analysis with its own harness and prompts.

What it does not measure

Not everyday work; academic questions at the edge of expertise.

Source

Artificial Analysis · Methodology

285 results from Artificial Analysis not ranked here · show why

We rank a result only when we can tie it to a specific model you can use. These are left out:

  • Not on sale through the API providers we track: 270
  • A different snapshot or variant from the model we list: 14
  • An unusual combination of settings: 1

Data sourced from Artificial Analysis. Licence: Artificial Analysis commercial data licence.