Benchmarks / Artificial Analysis

Reported by Artificial Analysis

Artificial Analysis

Share of graduate-level science questions answered correctly, as run by Artificial Analysis with its own harness and prompts.

Last updated 20 Oct 2026

Results dated
20 Oct 2026
Results
360 configurations of 232 models
Unit
% of questions
Licence
Artificial Analysis commercial data licence

GPQA Diamond: Muse Spark Open

Top 15 of 360 results · % of questions, higher is better. Choose a model to highlight it.Clear highlight

  1. 1 GPT-6 Astra (extra-high reasoning)OpenAI 96.3%
  2. 2 GPT-6 Astra (max reasoning)OpenAI 96.1%
  3. 3 Gemini 3.8 Flash (high reasoning)Google 95.3%
  4. 4 GPT-6 Astra (high reasoning)OpenAI 94.9%
  5. 4 Grok 4.6 (high reasoning)xAI 94.9%
  6. 6 Gemini 3.7 Flash (high reasoning)Google 94.5%
  7. 7 Gemini 3.1 Pro PreviewGoogle 94.1%
  8. 7 Muse Spark 1.3 (extra-high reasoning)Meta 94.1%
  9. 7 GPT-5.6 Sol (max reasoning)OpenAI 94.1%
  10. 10 GPT-6 Astra (medium reasoning)OpenAI 93.9%
  11. 11 Claude Fable 5.1 (max reasoning)Anthropic 93.7%
  12. 11 Claude Opus 5 (high reasoning)Anthropic 93.7%
  13. 11 Claude Opus 5 (extra-high reasoning)Anthropic 93.7%
  14. 14 Qwen3.8-2.4T-A95BAlibaba 93.5%
  15. 14 Gemini 3.8 Flash (medium reasoning)Google 93.5%
  16. 83 Muse Spark Open (extra-high reasoning)Meta 89.0%

Full results

Artificial Analysis: GPQA Diamond, % of questions, higher is better
#ModelGPQA Diamond
% of questions, higher is better		Price
$ per million tokens, in / out
1 GPT-6 Astra (extra-high reasoning)OpenAI
96.3%
$10 / $50
2 GPT-6 Astra (max reasoning)OpenAI
96.1%
$10 / $50
3 Gemini 3.8 Flash (high reasoning)Google
95.3%
$1.50 / $7.50
4 GPT-6 Astra (high reasoning)OpenAI
94.9%
$10 / $50
4 Grok 4.6 (high reasoning)xAI
94.9%
$2 / $6
6 Gemini 3.7 Flash (high reasoning)Google
94.5%
$1.50 / $7.50
7 Gemini 3.1 Pro PreviewGoogle
94.1%
$2 / $12
7 Muse Spark 1.3 (extra-high reasoning)Meta
94.1%
$1.25 / $4.25
7 GPT-5.6 Sol (max reasoning)OpenAI
94.1%
$4 / $20
10 GPT-6 Astra (medium reasoning)OpenAI
93.9%
$10 / $50
11 Claude Fable 5.1 (max reasoning)Anthropic
93.7%
$10 / $50
11 Claude Opus 5 (high reasoning)Anthropic
93.7%
$5 / $25
11 Claude Opus 5 (extra-high reasoning)Anthropic
93.7%
$5 / $25
14 Qwen3.8-2.4T-A95BAlibaba
93.5%
$2 / $6
14 Gemini 3.8 Flash (medium reasoning)Google
93.5%
$1.50 / $7.50
14 Muse Spark 1.3 (max reasoning)Meta
93.5%
$1.25 / $4.25
14 Kimi K3 (max reasoning)Moonshot AI
93.5%
$3 / $15
14 GPT-5.5 (extra-high reasoning)OpenAI
93.5%
$5 / $30
14 Grok 4.6 (medium reasoning)xAI
93.5%
$2 / $6
14 Grok 4.6 (extra-high reasoning)xAI
93.5%
$2 / $6
21 Claude Fable 5.1 (extra-high reasoning)Anthropic
93.4%
$10 / $50
22 Claude Opus 5 (max reasoning)Anthropic
93.2%
$5 / $25
22 GPT-5.5 (high reasoning)OpenAI
93.2%
$5 / $30
24 GPT-5.6 Sol (extra-high reasoning)OpenAI
93.1%
$4 / $20
24 GPT-6 Astra (low reasoning)OpenAI
93.1%
$10 / $50
24 Grok 4.5 (high reasoning)xAI
93.1%
$2 / $6
27 MiniMax-M3MiniMax
92.9%
$0.30 / $1.20
28 Qwen3.8-Max (0902)Alibaba
92.8%
$2 / $6
28 DeepSeek-V4-Pro (0813, max reasoning)DeepSeek
92.8%
$1.32 / $3.96
28 Gemini 3.6 Flash (high reasoning)Google
92.8%
$1.50 / $7.50
28 GPT-5.6 Sol (high reasoning)OpenAI
92.8%
$4 / $20
32 Qwen3.8-Max (0803)Alibaba
92.7%
–
33 Claude Fable 5 (max reasoning)Anthropic
92.6%
$10 / $50
33 GPT-5.5 (medium reasoning)OpenAI
92.6%
$5 / $30
33 GPT-5.6 Sol (medium reasoning)OpenAI
92.6%
$4 / $20
36 GPT-5.6 Terra (max reasoning)OpenAI
92.5%
$2 / $12
37 Qwen3.7-MaxAlibaba
92.3%
$1.48 / $4.42
37 Qwen3.8-Flash-NextAlibaba
92.3%
–
39 Gemini 3.5 Flash (high reasoning)Google
92.2%
$1.50 / $9
40 Gemini 3.5 Flash (medium reasoning)Google
92.1%
$1.50 / $9
40 Gemini 3.7 Flash (medium reasoning)Google
92.1%
$1.50 / $7.50
42 Claude Opus 4.8 (max reasoning)Anthropic
92.0%
$5 / $25
42 Gemini 3.8 Flash (low reasoning)Google
92.0%
$1.50 / $7.50
42 GPT-5.4 (extra-high reasoning)OpenAI
92.0%
$2.50 / $15
45 Claude Opus 5 (medium reasoning)Anthropic
91.9%
$5 / $25
46 GLM-5.3 (max reasoning)Z.ai
91.7%
$1.40 / $4.40
47 GPT-5.3-Codex (extra-high reasoning)OpenAI
91.5%
$1.75 / $14
48 Claude Opus 4.7 (max reasoning)Anthropic
91.4%
$5 / $25
49 DeepSeek-V4-Flash-Vision-Exp (max reasoning)DeepSeek
91.3%
$0.44 / $1.32
50 GLM-5.3-FlashZ.ai
91.2%
$0.15 / $0.50
51 Claude Sonnet 5 (max reasoning)Anthropic
91.1%
$2 / $10
51 Kimi K2.6Moonshot AI
91.1%
$0.95 / $4
51 GPT-5.6 Luna (max reasoning)OpenAI
91.1%
$0.20 / $1.20
51 Grok 4.20xAI
91.1%
$1.25 / $2.50
55 GPT-5.5 (low reasoning)OpenAI
91.0%
$5 / $30
56 DeepSeek-V4-Flash (0731, max reasoning)DeepSeek
90.8%
$0.14 / $0.28
56 Gemini 3 Pro Preview (high reasoning)Google
90.8%
–
56 GPT-5.6 Terra (extra-high reasoning)OpenAI
90.8%
$2 / $12
59 Claude Fable 5.1 (high reasoning)Anthropic
90.6%
$10 / $50
60 Qwen3.8-27B (extra-high reasoning)Alibaba
90.5%
$0.50 / $3
60 DeepSeek-V4-Pro (0423, high reasoning)DeepSeek
90.5%
$1.42 / $2.83
62 Muse Spark 1.2 (extra-high reasoning)Meta
90.4%
$1.25 / $4.25
63 GPT-5.2 (extra-high reasoning)OpenAI
90.3%
$1.75 / $14
64 Gemini 3.7 Flash (low reasoning)Google
90.1%
$1.50 / $7.50
64 Grok 4.3 (high reasoning)xAI
90.1%
$1.25 / $2.50
66 Qwen3.7-PlusAlibaba
90.0%
$0.32 / $1.28
67 GPT-5.2-Codex (extra-high reasoning)OpenAI
89.9%
$1.75 / $14
68 Gemini 3 Flash Preview (reasoning on)Google
89.8%
$0.50 / $3
68 Muse Spark 1.1 (extra-high reasoning)Meta
89.8%
$1.25 / $4.25
68 GPT-5.6 Sol (low reasoning)OpenAI
89.8%
$4 / $20
71 Hy3Tencent
89.7%
$0.14 / $0.58
72 Claude Opus 4.6 (max reasoning)Anthropic
89.6%
$5 / $25
72 Kimi K2.7 CodeMoonshot AI
89.6%
$0.95 / $4
72 GPT-5.6 Terra (high reasoning)OpenAI
89.6%
$2 / $12
75 GPT-5.6 Luna (extra-high reasoning)OpenAI
89.5%
$0.20 / $1.20
75 Inkling SmallThinking Machines
89.5%
$0.45 / $1.20
75 Grok Build 0.1xAI
89.5%
$1 / $2
75 GLM-5.2 (max reasoning)Z.ai
89.5%
$1.40 / $4.40
79 DeepSeek-V4-Flash (0423, max reasoning)DeepSeek
89.4%
$0.14 / $0.28
80 Qwen3.5-397B-A17BAlibaba
89.3%
$0.55 / $3.50
81 GPT-5.6 Luna (high reasoning)OpenAI
89.2%
$0.20 / $1.20
82 Solar Pro 4Upstage
89.1%
$0.09 / $0.36
83 Muse Spark Open (extra-high reasoning)Meta
89.0%
–
83 Grok 4.3 (medium reasoning)xAI
89.0%
$1.25 / $2.50
85 Claude Opus 5 (low reasoning)Anthropic
88.9%
$5 / $25
86 Qwen3.6-Max-PreviewAlibaba
88.8%
$1.03 / $6.16
86 DeepSeek-V4-Pro (0423, max reasoning)DeepSeek
88.8%
$1.42 / $2.83
88 Gemini 3 Pro Preview (low reasoning)Google
88.7%
–
89 Claude Fable 5.1 (medium reasoning)Anthropic
88.6%
$10 / $50
90 Claude Opus 4.7 (no reasoning)Anthropic
88.5%
$5 / $25
90 Grok 4.20 (0309, reasoning)xAI
88.5%
–
92 Muse SparkMeta
88.4%
–
93 Qwen3.6-PlusAlibaba
88.2%
$0.33 / $1.95
94 Claude Fable 5.1 (low reasoning)Anthropic
88.1%
$10 / $50
95 Kimi K2.5Moonshot AI
87.9%
$0.57 / $2.85
95 Grok 4.6 (low reasoning)xAI
87.9%
$2 / $6
97 Grok 4xAI
87.7%
–
98 Claude Sonnet 4.6 (max reasoning)Anthropic
87.5%
$3 / $15
98 GPT-5.4 mini (extra-high reasoning)OpenAI
87.5%
$0.75 / $4.50
100 MiniMax-M2.7MiniMax
87.4%
$0.30 / $1.20
101 GPT-5.1 (high reasoning)OpenAI
87.3%
$1.25 / $10
102 GPT-5.6 Terra (medium reasoning)OpenAI
87.2%
$2 / $12
102 Inkling (extra-high reasoning)Thinking Machines
87.2%
$0.95 / $4.05
104 DeepSeek-V3.2-SpecialeDeepSeek
87.1%
–
104 GPT-5.4 (low reasoning)OpenAI
87.1%
$2.50 / $15
106 GLM-5.1Z.ai
86.8%
$1.38 / $4.40
107 DeepSeek-V4-Flash (0423, high reasoning)DeepSeek
86.7%
$0.14 / $0.28
107 Hy3 Preview (reasoning on)Tencent
86.7%
$0.18 / $0.60
109 Claude Opus 4.5 (reasoning on)Anthropic
86.6%
$5 / $25
109 MiMo-V2.5-Pro (reasoning on)Xiaomi
86.6%
$0.43 / $0.87
111 GPT-5.2 (medium reasoning)OpenAI
86.4%
$1.75 / $14
112 Qwen3.5-397B-A17B (no reasoning)Alibaba
86.1%
$0.55 / $3.50
112 Qwen3-Max-ThinkingAlibaba
86.1%
$0.78 / $3.90
114 GPT-5.1-Codex (high reasoning)OpenAI
86.0%
$1.25 / $10
115 GPT-5.6 Luna (medium reasoning)OpenAI
85.9%
$0.20 / $1.20
115 GLM-4.7Z.ai
85.9%
$0.54 / $1.98
117 Qwen3.5-27BAlibaba
85.8%
$0.27 / $2.16
118 Qwen3.5-122B-A10BAlibaba
85.7%
$0.26 / $2.08
118 Gemma 4 31BGoogle
85.7%
$0.14 / $0.40
120 GPT-5 (high reasoning)OpenAI
85.4%
$1.25 / $10
121 Grok 4.1 Fast (reasoning)xAI
85.3%
–
122 MiMo-V2.5Xiaomi
84.9%
$0.17 / $0.34
123 MiniMax-M2.5MiniMax
84.8%
$0.30 / $1.20
124 Grok 4 Fast (reasoning)xAI
84.7%
–
124 GLM-5-TurboZ.ai
84.7%
$1.20 / $4
126 GPT-5.5 Instant (2026-05-26)OpenAI
84.6%
–
127 Qwen3.5-35B-A3BAlibaba
84.5%
$0.16 / $1.30
127 Qwen3.8-27B (low reasoning)Alibaba
84.5%
$0.50 / $3
127 Qwen3.8-27B (medium reasoning)Alibaba
84.5%
$0.50 / $3
127 o3-proOpenAI
84.5%
$20 / $80
131 Gemini 2.5 ProGoogle
84.4%
$1.25 / $10
132 GPT-5.6 Terra (low reasoning)OpenAI
84.3%
$2 / $12
132 Grok 4.3 (low reasoning)xAI
84.3%
$1.25 / $2.50
134 Qwen3.5-27B (no reasoning)Alibaba
84.2%
$0.27 / $2.16
134 Qwen3.6-27BAlibaba
84.2%
$0.30 / $3.20
134 Kimi K3 (low reasoning)Moonshot AI
84.2%
$3 / $15
134 GPT-5 (medium reasoning)OpenAI
84.2%
$1.25 / $10
138 Qwen3.6-35B-A3BAlibaba
84.1%
$0.10 / $1
139 Claude Opus 4.6 (no reasoning)Anthropic
84.0%
$5 / $25
139 DeepSeek-V3.2 (reasoning on)DeepSeek
84.0%
$0.30 / $0.96
141 GLM-5.1 (no reasoning)Z.ai
83.9%
$1.38 / $4.40
142 Gemini 3.5 Flash-LiteGoogle
83.8%
$0.30 / $2.50
142 Kimi K2 ThinkingMoonshot AI
83.8%
$0.60 / $2.50
144 GPT-5-Codex (high reasoning)OpenAI
83.7%
–
145 Muse Glimmer (high reasoning)Meta
83.5%
–
145 GPT-5.6 Luna (low reasoning)OpenAI
83.5%
$0.20 / $1.20
147 Claude Sonnet 4.5 (reasoning on)Anthropic
83.4%
$3 / $15
148 Step 3.5 FlashStepFun
83.1%
$0.10 / $0.30
149 MiniMax-M2.1MiniMax
83.0%
$0.30 / $1.20
150 Qwen3.6-27B (no reasoning)Alibaba
82.9%
$0.30 / $3.20
151 Gemini 3.5 Flash (minimal reasoning)Google
82.8%
$1.50 / $9
151 GPT-5 mini (high reasoning)OpenAI
82.8%
$0.25 / $2
153 Qwen3.5-122B-A10B (no reasoning)Alibaba
82.7%
$0.26 / $2.08
153 o3OpenAI
82.7%
$2 / $8
155 Qwen3.5-Omni-PlusAlibaba
82.6%
–
156 GPT-5.4 mini (medium reasoning)OpenAI
82.3%
$0.75 / $4.50
156 GPT-5.5 Instant (2026-06-26)OpenAI
82.3%
–
158 Gemini 3.1 Flash-Lite PreviewGoogle
82.2%
$0.25 / $1.50
159 GLM-5Z.ai
82.0%
$0.95 / $2.55
160 Qwen3.5-35B-A3B (no reasoning)Alibaba
81.9%
$0.16 / $1.30
161 Qwen3.8-27B (no reasoning)Alibaba
81.8%
$0.50 / $3
162 Qwen3.6-35B-A3B (no reasoning)Alibaba
81.7%
$0.10 / $1
162 GPT-5.4 nano (extra-high reasoning)OpenAI
81.7%
$0.20 / $1.25
164 DeepSeek-R1-0528DeepSeek
81.3%
$0.50 / $2.18
164 GPT-5.1-Codex-Mini (high reasoning)OpenAI
81.3%
$0.25 / $2
166 Gemini 3 Flash Preview (no reasoning)Google
81.2%
$0.50 / $3
167 Nova 2 Lite (high reasoning)Amazon
81.1%
$0.30 / $2.50
168 Claude Opus 4.5 (no reasoning)Anthropic
81.0%
$5 / $25
169 Claude Opus 4.1 (reasoning on)Anthropic
80.9%
$15 / $75
169 GLM-5V-TurboZ.ai
80.9%
$1.20 / $4
171 GPT-5 (low reasoning)OpenAI
80.8%
$1.25 / $10
172 Qwen3.5-9BAlibaba
80.6%
$0.10 / $0.15
173 GPT-5 mini (medium reasoning)OpenAI
80.3%
$0.25 / $2
174 Claude Sonnet 5 (no reasoning)Anthropic
80.0%
$2 / $10
174 Nemotron 3 Super 120B A12BNVIDIA
80.0%
$0.085 / $0.40
176 Claude Sonnet 4.6 (no reasoning)Anthropic
79.9%
$3 / $15
177 DeepSeek-V3.2-Exp (reasoning on)DeepSeek
79.7%
$0.27 / $0.41
178 Gemini 2.5 Flash Preview (09-2025, reasoning on)Google
79.3%
–
179 DeepSeek-V3.1-Terminus (reasoning on)DeepSeek
79.2%
$0.27 / $1
179 Gemma 4 26B A4BGoogle
79.2%
$0.10 / $0.30
181 Qwen3-235B-A22B-Thinking-2507Alibaba
79.0%
$0.30 / $3
181 Gemini 2.5 Flash (reasoning on)Google
79.0%
$0.30 / $2.50
181 GPT-5.6 Sol (no reasoning)OpenAI
79.0%
$4 / $20
184 Kimi K2.5 (no reasoning)Moonshot AI
78.9%
$0.57 / $2.85
185 Kimi K2.6 (no reasoning)Moonshot AI
78.8%
$0.95 / $4
186 Qwen3.5-9B (no reasoning)Alibaba
78.6%
$0.10 / $0.15
187 Grok 4.20 (0309, non-reasoning, no reasoning)xAI
78.5%
–
188 o4-mini (high reasoning)OpenAI
78.4%
$1.10 / $4.40
189 gpt-oss-120b (high reasoning)OpenAI
78.2%
$0.15 / $0.60
189 GLM-4.5Z.ai
78.2%
$0.60 / $2.20
191 GLM-4.6 (reasoning on)Z.ai
78.0%
$0.50 / $2
192 DeepSeek-V3.1 (reasoning on)DeepSeek
77.9%
$0.55 / $1.65
193 Claude Sonnet 4 (reasoning on)Anthropic
77.7%
$3 / $15
193 MiniMax-M2MiniMax
77.7%
$0.30 / $1.20
195 Qwen3-Max-Thinking-PreviewAlibaba
77.6%
–
195 Grok 4.20 (no reasoning)xAI
77.6%
$1.25 / $2.50
197 o3-mini (high reasoning)OpenAI
77.3%
$1.10 / $4.40
198 Qwen3-VL-235B-A22B-ThinkingAlibaba
77.2%
$0.40 / $4
199 Qwen3.5-4B (reasoning on)Alibaba
77.1%
–
200 Mercury 2Inception
77.0%
$0.25 / $0.75
201 Mistral Small 4Mistral AI
76.9%
$0.15 / $0.60
202 Nova 2 Lite (medium reasoning)Amazon
76.8%
$0.30 / $2.50
202 GPT-5.5 (no reasoning)OpenAI
76.8%
$5 / $30
204 Kimi K2 (0905)Moonshot AI
76.7%
$0.60 / $2.50
205 Gemini 2.5 Flash Preview (09-2025, no reasoning)Google
76.6%
–
205 Kimi K2 (0711)Moonshot AI
76.6%
$0.57 / $2.30
207 Qwen3-Max-PreviewAlibaba
76.4%
–
207 Qwen3-MaxAlibaba
76.4%
$0.78 / $3.90
209 Gemma 4 31B (no reasoning)Google
76.3%
$0.14 / $0.40
210 MiMo-V2.5-Pro (no reasoning)Xiaomi
76.2%
$0.43 / $0.87
211 GPT-5.4 nano (medium reasoning)OpenAI
76.1%
$0.20 / $1.25
212 Qwen3-Next-80B-A3B-ThinkingAlibaba
75.9%
$0.15 / $1.20
213 Nemotron 3 Nano 30B A3B (reasoning on)NVIDIA
75.7%
$0.05 / $0.20
214 Qwen3-235B-A22B-Instruct-2507Alibaba
75.3%
$0.15 / $0.75
214 Gemma 4 12BGoogle
75.3%
–
216 Trinity Large ThinkingArcee AI
75.2%
$0.25 / $0.80
217 DeepSeek-V3.1-Terminus (no reasoning)DeepSeek
75.1%
$0.27 / $1
217 DeepSeek-V3.2 (no reasoning)DeepSeek
75.1%
$0.30 / $0.96
219 Mistral Medium 3.5Mistral AI
74.8%
$1.50 / $7.50
219 GPT-5.4 (no reasoning)OpenAI
74.8%
$2.50 / $15
219 o3-miniOpenAI
74.8%
$1.10 / $4.40
222 o1OpenAI
74.7%
$15 / $60
223 GPT-5.6 Terra (no reasoning)OpenAI
74.6%
$2 / $12
224 Qwen3.5-Omni-FlashAlibaba
74.2%
–
225 Magistral Medium 1.2Mistral AI
73.9%
–
226 Qwen3-Next-80B-A3B-InstructAlibaba
73.8%
$0.10 / $1.10
226 DeepSeek-V3.2-Exp (no reasoning)DeepSeek
73.8%
$0.27 / $0.41
228 Qwen3-Coder-NextAlibaba
73.7%
$0.18 / $0.90
229 DeepSeek-V3.1 (no reasoning)DeepSeek
73.5%
$0.55 / $1.65
230 Qwen3-VL-32B-ThinkingAlibaba
73.3%
–
230 GLM-4.5-AirZ.ai
73.3%
$0.14 / $0.86
232 Hy3 Preview (no reasoning)Tencent
73.2%
$0.18 / $0.60
233 Claude Sonnet 4.5 (no reasoning)Anthropic
72.7%
$3 / $15
233 Grok Code Fast 1xAI
72.7%
–
235 Qwen3-Omni-30B-A3B-ThinkingAlibaba
72.6%
–
236 Solar Pro 3Upstage
72.4%
$0.15 / $0.60
237 Qwen3-VL-30B-A3B-ThinkingAlibaba
72.0%
$0.29 / $1
238 GLM-4.6V (reasoning on)Z.ai
71.9%
$0.30 / $0.90
239 DeepSeek-V4-Pro (0423, no reasoning)DeepSeek
71.7%
$1.42 / $2.83
240 DeepSeek-V4-Flash (0423, no reasoning)DeepSeek
71.6%
$0.14 / $0.28
241 Gemma 4 26B A4B (no reasoning)Google
71.4%
$0.10 / $0.30
242 Qwen3.5-4B (no reasoning)Alibaba
71.2%
–
242 Qwen3-VL-235B-A22B-InstructAlibaba
71.2%
$0.30 / $1.50
242 GPT-5.2 (no reasoning)OpenAI
71.2%
$1.75 / $14
245 Gemini 2.5 Flash-Lite Preview (09-2025, reasoning on)Google
70.9%
–
246 DeepSeek-R1DeepSeek
70.8%
$0.70 / $2.50
247 Qwen3-30B-A3B-Thinking-2507Alibaba
70.7%
$0.20 / $2.40
248 Qwen3-235B-A22B (reasoning on)Alibaba
70.0%
$0.46 / $1.82
249 Nova 2 Lite (low reasoning)Amazon
69.8%
$0.30 / $2.50
250 Qwen3-VL-30B-A3B-InstructAlibaba
69.5%
$0.15 / $0.60
251 gpt-oss-20b (high reasoning)OpenAI
68.8%
$0.03 / $0.15
252 GPT-5 mini (minimal reasoning)OpenAI
68.7%
$0.25 / $2
253 GPT-5 ChatOpenAI
68.6%
–
253 GLM-5.2 (no reasoning)Z.ai
68.6%
$1.40 / $4.40
255 GLM-4.5V (reasoning on)Z.ai
68.4%
$0.60 / $1.80
256 Claude Sonnet 4 (no reasoning)Anthropic
68.3%
$3 / $15
256 Gemini 2.5 Flash (no reasoning)Google
68.3%
$0.30 / $2.50
258 Mistral Large 3Mistral AI
68.0%
$0.50 / $1.50
259 GPT-5 nano (high reasoning)OpenAI
67.6%
$0.05 / $0.40
260 GPT-5 (minimal reasoning)OpenAI
67.3%
$1.25 / $10
261 Claude Haiku 4.5 (reasoning on)Anthropic
67.2%
$1 / $5
261 gpt-oss-120b (low reasoning)OpenAI
67.2%
$0.15 / $0.60
263 Qwen3-VL-32B-InstructAlibaba
67.1%
$0.10 / $0.42
263 Llama 4 MaverickMeta
67.1%
$0.27 / $0.85
265 GPT-5 nano (medium reasoning)OpenAI
67.0%
$0.05 / $0.40
266 DiffusionGemma 26B A4BGoogle
66.9%
–
267 Qwen3-32B (reasoning on)Alibaba
66.8%
$0.14 / $0.40
268 Qwen3-4B-Thinking-2507Alibaba
66.7%
–
269 GPT-4.1OpenAI
66.6%
$2 / $8
269 GLM-5 (no reasoning)Z.ai
66.6%
$0.95 / $2.55
271 GPT-4.1 miniOpenAI
66.4%
$0.40 / $1.60
271 GLM-4.7 (no reasoning)Z.ai
66.4%
$0.54 / $1.98
273 Magistral Small 1.2Mistral AI
66.3%
–
274 Gemma 4 12B (no reasoning)Google
66.1%
–
275 Qwen3-30B-A3B-Instruct-2507Alibaba
65.9%
$0.09 / $0.30
276 Grok 4.3 (no reasoning)xAI
65.8%
$1.25 / $2.50
277 DeepSeek-V3-0324DeepSeek
65.5%
$0.25 / $1
278 Gemini 2.5 Flash-Lite Preview (09-2025, no reasoning)Google
65.1%
–
279 Claude Haiku 4.5 (no reasoning)Anthropic
64.6%
$1 / $5
280 GPT-5.6 Luna (no reasoning)OpenAI
64.5%
$0.20 / $1.20
281 GPT-5.1 (no reasoning)OpenAI
64.3%
$1.25 / $10
282 Grok 4.1 Fast (non-reasoning, no reasoning)xAI
63.7%
–
283 GLM-4.6 (no reasoning)Z.ai
63.2%
$0.50 / $2
284 Granite 4.2 8BIBM
63.1%
$0.06 / $0.25
285 Gemini 2.5 Flash-Lite (reasoning on)Google
62.5%
$0.10 / $0.40
286 Qwen3-Omni-30B-A3B-InstructAlibaba
62.0%
–
287 Qwen3-Coder-480B-A35BAlibaba
61.8%
$0.35 / $1.50
288 Qwen3-30B-A3B (reasoning on)Alibaba
61.6%
$0.12 / $0.50
289 Qwen3-235B-A22B (no reasoning)Alibaba
61.3%
$0.46 / $1.82
290 gpt-oss-20b (low reasoning)OpenAI
61.1%
$0.03 / $0.15
291 GPT-5.4 mini (no reasoning)OpenAI
60.6%
$0.75 / $4.50
291 Grok 4 Fast (non-reasoning, no reasoning)xAI
60.6%
–
293 Qwen3-14B (reasoning on)Alibaba
60.4%
$0.12 / $0.24
294 Nova 2 Lite (no reasoning)Amazon
60.3%
$0.30 / $2.50
295 Devstral 2Mistral AI
59.4%
$0.40 / $2
296 Qwen3-8B (reasoning on)Alibaba
58.9%
$0.12 / $0.46
297 Mistral Medium 3.1Mistral AI
58.8%
$0.40 / $2
298 Llama 4 ScoutMeta
58.7%
$0.18 / $0.59
299 GLM-4.7-FlashZ.ai
58.1%
$0.06 / $0.40
300 Qwen3-VL-8B-ThinkingAlibaba
57.9%
$0.18 / $2.10
301 Mistral Medium 3Mistral AI
57.8%
$0.40 / $2
302 Gemma 4 E4BGoogle
57.6%
–
303 Phi-4Microsoft
57.5%
$0.07 / $0.14
304 GLM-4.5V (no reasoning)Z.ai
57.3%
$0.60 / $1.80
305 Ministral 3 14BMistral AI
57.2%
$0.20 / $0.20
306 Mistral Small 4 (no reasoning)Mistral AI
57.1%
$0.15 / $0.60
307 GLM-4.6V (no reasoning)Z.ai
56.6%
$0.30 / $0.90
308 GPT-5.4 nano (no reasoning)OpenAI
55.8%
$0.20 / $1.25
309 DeepSeek-V3DeepSeek
55.7%
$0.26 / $1.03
310 Gemma 4 E4B (no reasoning)Google
54.9%
–
311 Qwen3-32B (no reasoning)Alibaba
53.5%
$0.14 / $0.40
312 Devstral Small 2Mistral AI
53.2%
–
313 Reka Flash 3Reka AI
52.9%
$0.10 / $0.20
314 Command ACohere
52.7%
$2.50 / $10
315 GPT-4o (2024-05-13)OpenAI
52.6%
$5 / $15
316 GPT-4o (2024-08-06)OpenAI
52.1%
$2.50 / $10
317 Qwen3-4B-Instruct-2507Alibaba
51.7%
–
318 Qwen3-Coder-30B-A3B-InstructAlibaba
51.6%
$0.07 / $0.28
319 Qwen3-30B-A3B (no reasoning)Alibaba
51.5%
$0.12 / $0.50
320 GPT-4.1 nanoOpenAI
51.2%
$0.10 / $0.40
321 Mistral Small 3.2 24BMistral AI
50.5%
$0.094 / $0.25
322 Nova Pro 1.0Amazon
49.9%
$0.80 / $3.20
323 Llama 3.3 70B InstructMeta
49.8%
$0.59 / $0.79
324 Qwen3-VL-4B-ThinkingAlibaba
49.4%
–
325 Devstral MediumMistral AI
49.2%
–
326 Qwen2.5-72B-InstructAlibaba
49.1%
$0.36 / $0.40
327 Gemini 2.5 Flash-Lite (no reasoning)Google
47.4%
$0.10 / $0.40
328 Mistral Large 2 (2407)Mistral AI
47.2%
$2 / $6
329 Ministral 3 8BMistral AI
47.1%
$0.15 / $0.15
330 Qwen3-14B (no reasoning)Alibaba
47.0%
$0.12 / $0.24
331 Mistral Small 3Mistral AI
46.2%
$0.05 / $0.08
332 Qwen3.5-2B (reasoning on)Alibaba
45.6%
–
333 Mistral Small 3.1 24BMistral AI
45.4%
$0.35 / $0.56
334 Qwen3-8B (no reasoning)Alibaba
45.2%
$0.12 / $0.46
334 GLM-4.7-Flash (no reasoning)Z.ai
45.2%
$0.06 / $0.40
336 Qwen3.5-2B (no reasoning)Alibaba
43.8%
–
337 Nova Lite 1.0Amazon
43.3%
$0.06 / $0.24
337 Gemma 4 E2BGoogle
43.3%
–
339 Gemma 3 27BGoogle
42.8%
$0.12 / $0.20
339 GPT-5 nano (minimal reasoning)OpenAI
42.8%
$0.05 / $0.40
341 Qwen3-VL-8B-InstructAlibaba
42.7%
$0.12 / $0.46
342 GPT-4o mini (2024-07-18)OpenAI
42.6%
$0.15 / $0.60
343 Qwen2.5-Coder-32B-InstructAlibaba
41.7%
$0.66 / $1
344 Devstral Small 1.1Mistral AI
41.4%
–
345 Kimi Linear 48B A3B InstructMoonshot AI
41.2%
–
346 Llama 3.1 70B InstructMeta
40.9%
$0.40 / $0.40
347 Gemma 4 E2B (no reasoning)Google
40.5%
–
348 Nemotron 3 Nano 30B A3B (no reasoning)NVIDIA
39.9%
$0.05 / $0.20
349 Qwen3-VL-4B-InstructAlibaba
37.1%
–
350 Nova Micro 1.0Amazon
35.8%
$0.035 / $0.14
350 Ministral 3 3BMistral AI
35.8%
$0.10 / $0.10
352 Gemma 3 12BGoogle
34.9%
$0.05 / $0.15
353 Mixtral 8x22B InstructMistral AI
33.2%
$2 / $6
354 Gemma 3 4BGoogle
29.1%
$0.05 / $0.10
355 Llama 3.1 8B InstructMeta
25.9%
$0.05 / $0.08
356 Llama 3.2 3B InstructMeta
25.5%
$0.05 / $0.33
357 Qwen3.5-0.8B (no reasoning)Alibaba
23.6%
–
358 Gemma 3 270MGoogle
22.4%
–
359 Llama 3.2 1B InstructMeta
19.6%
$0.027 / $0.20
360 Qwen3.5-0.8B (reasoning on)Alibaba
11.1%
–

Swipe the table sideways for more columns.

Ranks follow the score as shown, so equal numbers share a rank. Results as published by Artificial Analysis; we do not re-run them.

Progress over time

GPQA Diamond, plotted at each model's release date, higher is better. Each model counts once, at its best setting. Scores are today's, not launch day's. Hover or tap a mark for its model.

Best score so far

Every model at its release date. The line moves each time a new release beats every earlier one, and each new best is named where there is room.

0%50%100% Jul 20242025Jul2026Jul Mixtral 8x22B InstructGPT-4o (2024-05-13)Phi-4o1o3-miniGemini 2.5 Proo3-proGrok 4GPT-5.3-CodexGemini 3.1 Pro PreviewGemini 3.8 FlashGPT-6 Astra

Best score by lab

Each lab's best so far, stepping whenever one of its releases beats its own earlier models. The 6 labs with the best scores today; 18 others not drawn.

OpenAIGooglexAIMetaAnthropicAlibaba

20%40%60%80%100% Jul 20242025Jul2026Jul OpenAIGooglexAIMetaAnthropicAlibaba

What it measures

Share of graduate-level science questions answered correctly, as run by Artificial Analysis with its own harness and prompts.

What it does not measure

Not applied work; multiple-choice science questions.

Source

Artificial Analysis · Methodology

285 results from Artificial Analysis not ranked here · show why

We rank a result only when we can tie it to a specific model you can use. These are left out:

  • Not on sale through the API providers we track: 270
  • A different snapshot or variant from the model we list: 14
  • An unusual combination of settings: 1

Data sourced from Artificial Analysis. Licence: Artificial Analysis commercial data licence.