Benchmarks / Artificial Analysis

Reported by Artificial Analysis

Artificial Analysis

Share of graduate-level science questions answered correctly, as run by Artificial Analysis with its own harness and prompts.

Results dated
7 Oct 2026
Models
359
Unit
% of questions
Licence
Artificial Analysis commercial data licence

GPQA Diamond: Grok Build 0.1

Top 15 of 359 results · % of questions, higher is better. Choose a model to highlight it.Clear highlight

  1. 1 GPT-6 Astra (xhigh reasoning)OpenAI 96.3%
  2. 2 GPT-6 Astra (max)OpenAI 96.1%
  3. 3 Gemini 3.8 Flash (high)Google 95.3%
  4. 4 GPT-6 Astra (high reasoning)OpenAI 94.9%
  5. 4 Grok 4.6 (high)xAI 94.9%
  6. 6 Gemini 3.7 Flash (high)Google 94.5%
  7. 7 Gemini 3.1 Pro PreviewGoogle 94.1%
  8. 7 Muse Spark 1.3 (xhigh)Meta 94.1%
  9. 7 GPT-5.6 Sol (max)OpenAI 94.1%
  10. 10 GPT-6 Astra (medium reasoning)OpenAI 93.9%
  11. 11 Claude Fable 5.1 (max)Anthropic 93.7%
  12. 11 Claude Opus 5 (high)Anthropic 93.7%
  13. 11 Claude Opus 5 (xhigh)Anthropic 93.7%
  14. 14 Qwen3.8 2.4T A95BAlibaba 93.5%
  15. 14 Gemini 3.8 Flash (medium reasoning)Google 93.5%
  16. 75 Grok Build 0.1xAI 89.5%

Full results

Artificial Analysis: GPQA Diamond, % of questions, higher is better
#ModelArtificial Analysis: GPQA Diamond
% of questions, higher is better
1 GPT-6 Astra (xhigh reasoning)OpenAI
96.3%
2 GPT-6 Astra (max)OpenAI
96.1%
3 Gemini 3.8 Flash (high)Google
95.3%
4 GPT-6 Astra (high reasoning)OpenAI
94.9%
4 Grok 4.6 (high)xAI
94.9%
6 Gemini 3.7 Flash (high)Google
94.5%
7 Gemini 3.1 Pro PreviewGoogle
94.1%
7 Muse Spark 1.3 (xhigh)Meta
94.1%
7 GPT-5.6 Sol (max)OpenAI
94.1%
10 GPT-6 Astra (medium reasoning)OpenAI
93.9%
11 Claude Fable 5.1 (max)Anthropic
93.7%
11 Claude Opus 5 (high)Anthropic
93.7%
11 Claude Opus 5 (xhigh)Anthropic
93.7%
14 Qwen3.8 2.4T A95BAlibaba
93.5%
14 Gemini 3.8 Flash (medium reasoning)Google
93.5%
14 Muse Spark 1.3 (max)Meta
93.5%
14 Kimi K3 (max)Moonshot AI
93.5%
14 GPT-5.5 (xhigh reasoning)OpenAI
93.5%
14 Grok 4.6 (medium)xAI
93.5%
14 Grok 4.6 (xhigh)xAI
93.5%
21 Claude Fable 5.1 (xhigh)Anthropic
93.4%
22 Claude Opus 5 (max)Anthropic
93.2%
22 GPT-5.5 (high)OpenAI
93.2%
24 GPT-5.6 Sol (xhigh)OpenAI
93.1%
24 GPT-6 Astra (low reasoning)OpenAI
93.1%
24 Grok 4.5 (high)xAI
93.1%
27 MiniMax M3MiniMax
92.9%
28 Qwen3.8 Max (0902)Alibaba
92.8%
28 DeepSeek V4 Pro 0423 (max)DeepSeek
92.8%
28 Gemini 3.6 Flash (high)Google
92.8%
28 GPT-5.6 Sol (high reasoning)OpenAI
92.8%
32 Qwen3.8 Max (0803)Alibaba
92.7%
33 Claude Fable 5 (max reasoning)Anthropic
92.6%
33 GPT-5.5 (medium reasoning)OpenAI
92.6%
33 GPT-5.6 Sol (medium reasoning)OpenAI
92.6%
36 GPT-5.6 Terra (max)OpenAI
92.5%
37 Qwen3.7 MaxAlibaba
92.3%
37 Qwen3.8 Flash NextAlibaba
92.3%
39 Gemini 3.5 Flash (high)Google
92.2%
40 Gemini 3.5 Flash (medium)Google
92.1%
40 Gemini 3.7 Flash (medium reasoning)Google
92.1%
42 Claude Opus 4.8 (max reasoning)Anthropic
92.0%
42 Gemini 3.8 Flash (low reasoning)Google
92.0%
42 GPT-5.4 (xhigh reasoning)OpenAI
92.0%
45 Claude Opus 5 (medium)Anthropic
91.9%
46 GLM 5.3 (max)Z.ai
91.7%
47 GPT-5.3-Codex (xhigh)OpenAI
91.5%
48 Claude Opus 4.7 (max reasoning)Anthropic
91.4%
49 DeepSeek V4 Flash Vision (experimental, max)DeepSeek
91.3%
50 GLM 5.3 FlashZ.ai
91.2%
51 Claude Sonnet 5 (max reasoning)Anthropic
91.1%
51 Kimi K2.6Moonshot AI
91.1%
51 GPT-5.6 Luna (max)OpenAI
91.1%
51 Grok 4.20xAI
91.1%
55 GPT-5.5 (low reasoning)OpenAI
91.0%
56 DeepSeek V4 Flash 0423 (max)DeepSeek
90.8%
56 gemini-3-pro (high)Google
90.8%
56 GPT-5.6 Terra (xhigh)OpenAI
90.8%
59 Claude Fable 5.1 (high reasoning)Anthropic
90.6%
60 Qwen3.8 27B (xhigh)Alibaba
90.5%
60 deepseek-v4-pro-preview (high reasoning)DeepSeek
90.5%
62 Muse Spark 1.2Meta
90.4%
63 GPT-5.2 (xhigh)OpenAI
90.3%
64 Gemini 3.7 Flash (low reasoning)Google
90.1%
64 Grok 4.3 (high)xAI
90.1%
66 Qwen3.7 PlusAlibaba
90.0%
67 GPT-5.2-Codex (xhigh)OpenAI
89.9%
68 gemini-3-flash (thinking reasoning)Google
89.8%
68 Muse Spark 1.1 (xhigh)Meta
89.8%
68 GPT-5.6 Sol (low reasoning)OpenAI
89.8%
71 Hy3Tencent
89.7%
72 Claude Opus 4.6 (max reasoning)Anthropic
89.6%
72 Kimi K2.7 CodeMoonshot AI
89.6%
72 GPT-5.6 Terra (high reasoning)OpenAI
89.6%
75 GPT-5.6 Luna (xhigh)OpenAI
89.5%
75 Inkling SmallThinkingmachines
89.5%
75 Grok Build 0.1xAI
89.5%
75 GLM 5.2 (max)Z.ai
89.5%
79 deepseek-v4-flash-preview (max reasoning)DeepSeek
89.4%
80 Qwen3.5 397B A17BAlibaba
89.3%
81 GPT-5.6 Luna (high reasoning)OpenAI
89.2%
82 Solar Pro 4Upstage
89.1%
83 Grok 4.3 (medium)xAI
89.0%
84 Claude Opus 5 (low)Anthropic
88.9%
85 Qwen3.6 Max PreviewAlibaba
88.8%
85 deepseek-v4-pro-preview (max reasoning)DeepSeek
88.8%
87 gemini-3-pro (low)Google
88.7%
88 Claude Fable 5.1 (medium reasoning)Anthropic
88.6%
89 Claude Opus 4.7 (off)Anthropic
88.5%
89 grok-4.20-0309-reasoningxAI
88.5%
91 muse-sparkMeta
88.4%
92 Qwen3.6 PlusAlibaba
88.2%
93 Claude Fable 5.1 (low reasoning)Anthropic
88.1%
94 Kimi K2.5Moonshot AI
87.9%
94 Grok 4.6 (low)xAI
87.9%
96 grok-4xAI
87.7%
97 Claude Sonnet 4.6 (max reasoning)Anthropic
87.5%
97 GPT-5.4 Mini (xhigh)OpenAI
87.5%
99 MiniMax M2.7MiniMax
87.4%
100 GPT-5.1 (high)OpenAI
87.3%
101 GPT-5.6 Terra (medium reasoning)OpenAI
87.2%
101 Inkling (xhigh)Thinkingmachines
87.2%
103 deepseek-v3.2-specialeDeepSeek
87.1%
103 GPT-5.4 (low reasoning)OpenAI
87.1%
105 GLM 5.1Z.ai
86.8%
106 deepseek-v4-flash-preview (high reasoning)DeepSeek
86.7%
106 Hy3 preview (thinking reasoning)Tencent
86.7%
108 Claude Opus 4.5 (thinking reasoning)Anthropic
86.6%
108 MiMo-V2.5-Pro (thinking reasoning)Xiaomi
86.6%
110 GPT-5.2 (medium reasoning)OpenAI
86.4%
111 Qwen3.5 397B A17B (no reasoning)Alibaba
86.1%
111 Qwen3 Max ThinkingAlibaba
86.1%
113 GPT-5.1-Codex (high)OpenAI
86.0%
114 GPT-5.6 Luna (medium reasoning)OpenAI
85.9%
114 GLM 4.7Z.ai
85.9%
116 Qwen3.5-27BAlibaba
85.8%
117 Qwen3.5-122B-A10BAlibaba
85.7%
117 Gemma 4 31BGoogle
85.7%
119 GPT-5 (high)OpenAI
85.4%
120 grok-4-1-fast-reasoningxAI
85.3%
121 MiMo-V2.5Xiaomi
84.9%
122 MiniMax M2.5MiniMax
84.8%
123 grok-4-fast-reasoningxAI
84.7%
123 GLM 5 TurboZ.ai
84.7%
125 GPT-5.5 Instant (26 May)OpenAI
84.6%
126 Qwen3.5-35B-A3BAlibaba
84.5%
126 Qwen3.8 27B (low)Alibaba
84.5%
126 Qwen3.8 27B (medium)Alibaba
84.5%
126 o3 ProOpenAI
84.5%
130 Gemini 2.5 ProGoogle
84.4%
131 GPT-5.6 Terra (low reasoning)OpenAI
84.3%
131 Grok 4.3 (low)xAI
84.3%
133 Qwen3.5-27B (no reasoning)Alibaba
84.2%
133 Qwen3.6 27BAlibaba
84.2%
133 Kimi K3 (low reasoning)Moonshot AI
84.2%
133 GPT-5 (medium)OpenAI
84.2%
137 Qwen3.6 35B A3BAlibaba
84.1%
138 Claude Opus 4.6 (off)Anthropic
84.0%
138 DeepSeek V3.2DeepSeek
84.0%
140 GLM 5.1 (no reasoning)Z.ai
83.9%
141 Gemini 3.5 Flash LiteGoogle
83.8%
141 Kimi K2 ThinkingMoonshot AI
83.8%
143 GPT-5-Codex (high)OpenAI
83.7%
144 muse-glimmer (high)Meta
83.5%
144 GPT-5.6 Luna (low reasoning)OpenAI
83.5%
146 Claude Sonnet 4.5 (thinking reasoning)Anthropic
83.4%
147 Step 3.5 FlashStepfun
83.1%
148 MiniMax M2.1MiniMax
83.0%
149 Qwen3.6 27B (no reasoning)Alibaba
82.9%
150 Gemini 3.5 Flash (minimal reasoning)Google
82.8%
150 GPT-5 Mini (high)OpenAI
82.8%
152 Qwen3.5-122B-A10B (no reasoning)Alibaba
82.7%
152 o3OpenAI
82.7%
154 Qwen3.5 Omni PlusAlibaba
82.6%
155 GPT-5.4 Mini (medium)OpenAI
82.3%
155 GPT-5.5 Instant (26 June)OpenAI
82.3%
157 Gemini 3.1 Flash Lite PreviewGoogle
82.2%
158 GLM 5Z.ai
82.0%
159 Qwen3.5-35B-A3B (no reasoning)Alibaba
81.9%
160 Qwen3.8 27B (off)Alibaba
81.8%
161 Qwen3.6 35B A3B (no reasoning)Alibaba
81.7%
161 GPT-5.4 Nano (xhigh)OpenAI
81.7%
163 R1 0528DeepSeek
81.3%
163 GPT-5.1-Codex-Mini (high)OpenAI
81.3%
165 gemini-3-flash (off)Google
81.2%
166 Nova 2 Lite (high reasoning)Amazon
81.1%
167 Claude Opus 4.5 (no reasoning)Anthropic
81.0%
168 Claude Opus 4.1 (thinking reasoning)Anthropic
80.9%
168 GLM 5V TurboZ.ai
80.9%
170 GPT-5 (low reasoning)OpenAI
80.8%
171 Qwen3.5-9BAlibaba
80.6%
172 GPT-5 Mini (medium)OpenAI
80.3%
173 Claude Sonnet 5 (off)Anthropic
80.0%
173 Nemotron 3 SuperNVIDIA
80.0%
175 Claude Sonnet 4.6 (off)Anthropic
79.9%
176 DeepSeek V3.2 ExpDeepSeek
79.7%
177 gemini-2.5-flash-preview-09-2025 (thinking reasoning)Google
79.3%
178 DeepSeek V3.1 TerminusDeepSeek
79.2%
178 Gemma 4 26B A4BGoogle
79.2%
180 Qwen3 235B A22B Thinking 2507Alibaba
79.0%
180 Gemini 2.5 Flash (thinking reasoning)Google
79.0%
180 GPT-5.6 Sol (no reasoning)OpenAI
79.0%
183 Kimi K2.5Moonshot AI
78.9%
184 Kimi K2.6 (no reasoning)Moonshot AI
78.8%
185 Qwen3.5-9B (no reasoning)Alibaba
78.6%
186 grok-4.20-0309-non-reasoning (no reasoning)xAI
78.5%
187 o4 Mini (high reasoning)OpenAI
78.4%
188 gpt-oss-120b (high)OpenAI
78.2%
188 GLM 4.5Z.ai
78.2%
190 GLM 4.6 (thinking reasoning)Z.ai
78.0%
191 DeepSeek V3.1DeepSeek
77.9%
192 Claude Sonnet 4 (thinking reasoning)Anthropic
77.7%
192 MiniMax M2MiniMax
77.7%
194 Qwen3 Max Thinking (preview)Alibaba
77.6%
194 Grok 4.20 (off)xAI
77.6%
196 o3 Mini HighOpenAI
77.3%
197 Qwen3 VL 235B A22B ThinkingAlibaba
77.2%
198 qwen3.5-4b (thinking reasoning)Alibaba
77.1%
199 Mercury 2Inception
77.0%
200 Mistral Small 4Mistral
76.9%
201 Nova 2 Lite (medium reasoning)Amazon
76.8%
201 GPT-5.5 (no reasoning)OpenAI
76.8%
203 Kimi K2 0905Moonshot AI
76.7%
204 gemini-2.5-flash-preview-09-2025 (no reasoning)Google
76.6%
204 Kimi K2 0711Moonshot AI
76.6%
206 qwen3-max-previewAlibaba
76.4%
206 Qwen3 MaxAlibaba
76.4%
208 Gemma 4 31B (off)Google
76.3%
209 MiMo-V2.5-Pro (no reasoning)Xiaomi
76.2%
210 GPT-5.4 Nano (medium)OpenAI
76.1%
211 Qwen3 Next 80B A3B ThinkingAlibaba
75.9%
212 Nemotron 3 Nano 30B A3B (thinking reasoning)NVIDIA
75.7%
213 Qwen3 235B A22B Instruct 2507Alibaba
75.3%
213 gemma-4-12b-itGoogle
75.3%
215 Trinity Large ThinkingArcee Ai
75.2%
216 DeepSeek V3.1 Terminus (no reasoning)DeepSeek
75.1%
216 DeepSeek V3.2 (no reasoning)DeepSeek
75.1%
218 Mistral Medium 3.5Mistral
74.8%
218 GPT-5.4 (no reasoning)OpenAI
74.8%
218 o3 MiniOpenAI
74.8%
221 o1OpenAI
74.7%
222 GPT-5.6 Terra (no reasoning)OpenAI
74.6%
223 Qwen3.5 Omni FlashAlibaba
74.2%
224 Magistral Medium 1.2Mistral
73.9%
225 Qwen3 Next 80B A3B InstructAlibaba
73.8%
225 DeepSeek V3.2 Exp (no reasoning)DeepSeek
73.8%
227 Qwen3 Coder NextAlibaba
73.7%
228 DeepSeek V3.1 (no reasoning)DeepSeek
73.5%
229 qwen3-vl-32b-thinkingAlibaba
73.3%
229 GLM 4.5 AirZ.ai
73.3%
231 Hy3 preview (no reasoning)Tencent
73.2%
232 Claude Sonnet 4.5 (no reasoning)Anthropic
72.7%
232 Grok Code Fast 1xAI
72.7%
234 qwen3-omni-30b-a3b-thinkingAlibaba
72.6%
235 Solar Pro 3Upstage
72.4%
236 Qwen3 VL 30B A3B ThinkingAlibaba
72.0%
237 GLM 4.6V (thinking reasoning)Z.ai
71.9%
238 deepseek-v4-pro-preview (no reasoning)DeepSeek
71.7%
239 deepseek-v4-flash-preview (no reasoning)DeepSeek
71.6%
240 Gemma 4 26B A4B (off)Google
71.4%
241 qwen3.5-4b (no reasoning)Alibaba
71.2%
241 Qwen3 VL 235B A22B InstructAlibaba
71.2%
241 GPT-5.2 (no reasoning)OpenAI
71.2%
244 gemini-2.5-flash-lite-preview-09-2025 (thinking reasoning)Google
70.9%
245 R1DeepSeek
70.8%
246 Qwen3 30B A3B Thinking 2507Alibaba
70.7%
247 Qwen3 235B A22B (thinking reasoning)Alibaba
70.0%
248 Nova 2 Lite (low reasoning)Amazon
69.8%
249 Qwen3 VL 30B A3B InstructAlibaba
69.5%
250 gpt-oss-20b (high reasoning)OpenAI
68.8%
251 GPT-5 Mini (minimal)OpenAI
68.7%
252 gpt-5-chatOpenAI
68.6%
252 GLM 5.2 (no reasoning)Z.ai
68.6%
254 GLM 4.5V (thinking reasoning)Z.ai
68.4%
255 Claude Sonnet 4 (no reasoning)Anthropic
68.3%
255 Gemini 2.5 Flash (no reasoning)Google
68.3%
257 Mistral Large 3 2512Mistral
68.0%
258 GPT-5 Nano (high)OpenAI
67.6%
259 GPT-5 (minimal reasoning)OpenAI
67.3%
260 Claude Haiku 4.5 (thinking reasoning)Anthropic
67.2%
260 gpt-oss-120b (low)OpenAI
67.2%
262 Qwen3 VL 32B InstructAlibaba
67.1%
262 Llama 4 MaverickMeta
67.1%
264 GPT-5 Nano (medium)OpenAI
67.0%
265 DiffusionGemma 26B A4BGoogle
66.9%
266 Qwen3 32B (thinking reasoning)Alibaba
66.8%
267 qwen3-4b-thinking-2507Alibaba
66.7%
268 GPT-4.1OpenAI
66.6%
268 GLM 5 (no reasoning)Z.ai
66.6%
270 GPT-4.1 MiniOpenAI
66.4%
270 GLM 4.7 (no reasoning)Z.ai
66.4%
272 magistral-small-2509Mistral
66.3%
273 gemma-4-12b-it (no reasoning)Google
66.1%
274 Qwen3 30B A3B Instruct 2507Alibaba
65.9%
275 Grok 4.3 (off)xAI
65.8%
276 DeepSeek V3 0324DeepSeek
65.5%
277 gemini-2.5-flash-lite-preview-09-2025 (no reasoning)Google
65.1%
278 Claude Haiku 4.5 (no reasoning)Anthropic
64.6%
279 GPT-5.6 Luna (no reasoning)OpenAI
64.5%
280 GPT-5.1 (off)OpenAI
64.3%
281 grok-4-1-fast-non-reasoning (no reasoning)xAI
63.7%
282 GLM 4.6 (no reasoning)Z.ai
63.2%
283 Granite 4.2 8BIBM
63.1%
284 Gemini 2.5 Flash Lite (thinking reasoning)Google
62.5%
285 Qwen3 Omni 30B A3B InstructAlibaba
62.0%
286 Qwen3 Coder 480B A35BAlibaba
61.8%
287 Qwen3 30B A3B (thinking reasoning)Alibaba
61.6%
288 Qwen3 235B A22BAlibaba
61.3%
289 gpt-oss-20b (low reasoning)OpenAI
61.1%
290 GPT-5.4 Mini (no reasoning)OpenAI
60.6%
290 grok-4-fast-non-reasoning (no reasoning)xAI
60.6%
292 Qwen3 14B (thinking reasoning)Alibaba
60.4%
293 Nova 2 Lite (no reasoning)Amazon
60.3%
294 Devstral 2 2512Mistral
59.4%
295 Qwen3 8B (thinking reasoning)Alibaba
58.9%
296 Mistral Medium 3.1Mistral
58.8%
297 Llama 4 ScoutMeta
58.7%
298 GLM 4.7 FlashZ.ai
58.1%
299 Qwen3 VL 8B ThinkingAlibaba
57.9%
300 Mistral Medium 3Mistral
57.8%
301 gemma-4-e4b-itGoogle
57.6%
302 Phi 4Microsoft
57.5%
303 GLM 4.5V (off)Z.ai
57.3%
304 Ministral 3 14B 2512Mistral
57.2%
305 Mistral Small 4 (no reasoning)Mistral
57.1%
306 GLM 4.6V (no reasoning)Z.ai
56.6%
307 GPT-5.4 Nano (no reasoning)OpenAI
55.8%
308 DeepSeek V3DeepSeek
55.7%
309 gemma-4-e4b-it (no reasoning)Google
54.9%
310 Qwen3 32B (no reasoning)Alibaba
53.5%
311 devstral-small-2-24b-instruct-2512Mistral
53.2%
312 Reka Flash 3Rekaai
52.9%
313 Command ACohere
52.7%
314 GPT-4o (2024-05-13)OpenAI
52.6%
315 GPT-4o (2024-08-06)OpenAI
52.1%
316 qwen3-4b-instruct-2507Alibaba
51.7%
317 Qwen3 Coder 30B A3B InstructAlibaba
51.6%
318 Qwen3 30B A3B (no reasoning)Alibaba
51.5%
319 GPT-4.1 NanoOpenAI
51.2%
320 Mistral Small 3.2 24BMistral
50.5%
321 Nova Pro 1.0Amazon
49.9%
322 Llama 3.3 70B InstructMeta
49.8%
323 qwen3-vl-4b-thinkingAlibaba
49.4%
324 Devstral MediumMistral
49.2%
325 Qwen2.5 72B InstructAlibaba
49.1%
326 Gemini 2.5 Flash Lite (no reasoning)Google
47.4%
327 Mistral Large 2407Mistral
47.2%
328 Ministral 3 8B 2512Mistral
47.1%
329 Qwen3 14B (no reasoning)Alibaba
47.0%
330 Mistral Small 3Mistral
46.2%
331 qwen3.5-2b (thinking reasoning)Alibaba
45.6%
332 Mistral Small 3.1 24BMistral
45.4%
333 Qwen3 8B (no reasoning)Alibaba
45.2%
333 GLM 4.7 Flash (no reasoning)Z.ai
45.2%
335 qwen3.5-2b (no reasoning)Alibaba
43.8%
336 Nova Lite 1.0Amazon
43.3%
336 gemma-4-e2b-itGoogle
43.3%
338 Gemma 3 27BGoogle
42.8%
338 GPT-5 Nano (minimal)OpenAI
42.8%
340 Qwen3 VL 8B InstructAlibaba
42.7%
341 GPT-4o-mini (2024-07-18)OpenAI
42.6%
342 Qwen2.5 Coder 32B InstructAlibaba
41.7%
343 Devstral Small 1.1Mistral
41.4%
344 kimi-linear-48b-a3b-instructMoonshot AI
41.2%
345 Llama 3.1 70B InstructMeta
40.9%
346 gemma-4-e2b-it (no reasoning)Google
40.5%
347 Nemotron 3 Nano 30B A3B (no reasoning)NVIDIA
39.9%
348 qwen3-vl-4b-instructAlibaba
37.1%
349 Nova Micro 1.0Amazon
35.8%
349 Ministral 3 3B 2512Mistral
35.8%
351 Gemma 3 12BGoogle
34.9%
352 Mixtral 8x22B InstructMistral
33.2%
353 Gemma 3 4BGoogle
29.1%
354 Llama 3.1 8B InstructMeta
25.9%
355 Llama 3.2 3B InstructMeta
25.5%
356 qwen3.5-0.8b (no reasoning)Alibaba
23.6%
357 Gemma 3 270MGoogle
22.4%
358 Llama 3.2 1B InstructMeta
19.6%
359 qwen3.5-0.8b (thinking reasoning)Alibaba
11.1%

Results as published by Artificial Analysis; we do not re-run them.

What it measures

Share of graduate-level science questions answered correctly, as run by Artificial Analysis with its own harness and prompts.

What it does not measure

Not applied work; multiple-choice science questions.

Source

Artificial Analysis · Methodology

Failures

Failures count against a model: a product with no usable output is a failed listing. They are listed here so you can see why.

Not ranked

  • GPT-4 Turbo: AA dates its GPT-4 Turbo 6 Nov 2023 (gpt-4-1106-preview); OpenRouter's gpt-4-turbo is the 2024-04-09 snapshot.
  • QwQ-32B-Preview: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • a-x-k2: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • apertus-70b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • apertus-8b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • apodex-1-1: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • apriel-v1-5-15b-thinker: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • apriel-v1-6-15b-thinker: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • arctic-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • celeris-1: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-2: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-21: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-3-5-haiku: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-3-7-sonnet: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-3-7-sonnet-thinking: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-3-haiku: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-3-opus: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-3-sonnet: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-35-sonnet: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-35-sonnet-june-24: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-4-opus: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-4-opus-thinking: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-instant: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-sonnet-4-6-non-reasoning-low-effort: non-standard setting combination
  • cogito-v2-1-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • command-a-plus: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • command-r-03-2024: Command R (March 2024); OpenRouter sells only the 08-2024 snapshot.
  • command-r-plus-04-2024: Command R+ (April 2024); OpenRouter sells only the 08-2024 snapshot.
  • dbrx: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • deephermes-3-llama-3-1-8b-preview: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • deephermes-3-mistral-24b-preview: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • deepseek-coder-v2: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • deepseek-coder-v2-lite: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • deepseek-llm-67b-chat: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • deepseek-r1-distill-llama-70b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • deepseek-r1-distill-llama-8b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • deepseek-r1-distill-qwen-1-5b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • deepseek-r1-distill-qwen-14b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • deepseek-r1-distill-qwen-32b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • deepseek-r1-qwen3-8b: A distilled Qwen3 8B, not DeepSeek R1 itself.
  • deepseek-v2: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • deepseek-v2-5: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • deepseek-v2-5-sep-2024: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • devstral-small-2505: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • doubao-seed-code: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ernie-4-5-300b-a47b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ernie-5-0-thinking-preview: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • exaone-4-0-1-2b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • exaone-4-0-1-2b-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • exaone-4-0-32b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • exaone-4-0-32b-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • exaone-4-5-33b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • falcon-h1r-7b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • g9v3-39a5b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • g9v3-3b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-1-0-pro: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-1-0-ultra: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-1-5-flash: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-1-5-flash-8b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-1-5-flash-may-2024: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-1-5-pro: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-1-5-pro-may-2024: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-2-0-flash: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-2-0-flash-experimental: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-2-0-flash-lite-001: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-2-0-flash-lite-preview: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-2-0-flash-thinking-exp-0121: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-2-0-flash-thinking-exp-1219: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-2-0-pro-experimental-02-05: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-2-5-flash-04-2025: Gemini 2.5 Flash preview (April 2025), an earlier snapshot than the stable model.
  • gemini-2-5-flash-reasoning-04-2025: Gemini 2.5 Flash preview (April 2025), an earlier snapshot than the stable model.
  • gemini-2-5-pro-03-25: Gemini 2.5 Pro preview 03-25; OpenRouter's gemini-2.5-pro-preview is the 06-05 preview.
  • gemini-2-5-pro-05-06: Gemini 2.5 Pro preview 05-06; OpenRouter's gemini-2.5-pro-preview is the 06-05 preview.
  • gemma-3-1b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemma-3n-e2b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemma-3n-e4b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemma-3n-e4b-preview-0520: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gpt-35-turbo: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gpt-4: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gpt-4-5: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gpt-4o: GPT-4o (Nov '24, 2024-11-20); OpenRouter prices only the May and August 2024 snapshots.
  • gpt-4o-chatgpt: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gpt-4o-chatgpt-03-25: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • granite-3-3-8b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • granite-4-0-350m: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • granite-4-0-h-350m: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • granite-4-0-h-nano-1b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • granite-4-0-h-small: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • granite-4-0-micro: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • granite-4-0-nano-1b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • granite-4-1-30b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • granite-4-1-3b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • granite-4-1-8b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • granite-4-2-30b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • granite-4-2-3b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • grok-1: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • grok-2-1212: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • grok-3: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • grok-3-mini-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • grok-3-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • grok-beta: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • hermes-3-llama-3-1-70b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • hermes-4-llama-3-1-405b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • hermes-4-llama-3-1-405b-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • hermes-4-llama-3-1-70b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • hermes-4-llama-3-1-70b-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • hyperclova-x-seed-think-32b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • hypernova-60b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • intellect-3: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • jamba-1-5-large: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • jamba-1-5-mini: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • jamba-1-6-large: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • jamba-1-6-mini: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • jamba-1-7-large: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • jamba-1-7-mini: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • jamba-reasoning-3b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • jt-35b-flash: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • jt-4-1-flash-236b-a21b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • jt-4-1-flash-236b-a21b-non-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • jt-mini: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • k-exaone: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • k-exaone-2-0-0803: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • k-exaone-non-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • k2-horizon-0-9b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • k2-horizon-3-7b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • k2-horizon-375b-a23b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • k2-horizon-7b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • k2-horizon-mova-36b-a4b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • k2-think-v2: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • k2-v2: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • k2-v2-low: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • k2-v2-medium: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • kat-coder-pro-v1: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • kat-coder-pro-v2: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • lfm-40b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • lfm2-1-2b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • lfm2-2-6b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • lfm2-24b-a2b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • lfm2-5-1-2b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • lfm2-5-1-2b-thinking: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • lfm2-5-2-6b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • lfm2-5-8b-a1b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • lfm2-5-vl-1-6b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • lfm2-8b-a1b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ling-1t: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ling-2-6-1t: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ling-2-6-flash: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ling-3-0-flash: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ling-3-0-flash-fin: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ling-3-0-flash-vl: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ling-3-0-tiny: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ling-3-1-flash: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ling-flash-2-0: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ling-mini-2-0: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-2-chat-13b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-2-chat-70b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-2-chat-7b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-3-1-instruct-405b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-3-1-nemotron-instruct-70b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-3-1-nemotron-nano-4b-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-3-1-nemotron-ultra-253b-v1-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-3-2-instruct-11b-vision: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-3-2-instruct-90b-vision: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-3-3-nemotron-super-49b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-3-3-nemotron-super-49b-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-3-instruct-70b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-3-instruct-8b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-65b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-nemotron-super-49b-v1-5: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-nemotron-super-49b-v1-5-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • longcat-2-0: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • longcat-flash-lite: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • magistral-medium: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • magistral-small: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mercury-2-5: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mi-dm-k-2-5-pro-dec28: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • midm-250-pro-rsnsft: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mimo-v2-0206: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mimo-v2-flash: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mimo-v2-flash-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mimo-v2-omni: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mimo-v2-omni-0327: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mimo-v2-pro: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • minicpm-v4-6-1-3b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • minicpm5-1b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • minicpm5-1b-non-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • minicpm5-2b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • minimax-m1-40k: MiniMax M1 40k and 80k are separate checkpoints; which one OpenRouter's minimax-m1 serves is not stated.
  • minimax-m1-80k: MiniMax M1 40k and 80k are separate checkpoints; which one OpenRouter's minimax-m1 serves is not stated.
  • mistral-7b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mistral-large: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mistral-large-2: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mistral-medium: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mistral-saba: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mistral-small: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mistral-small-2402: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mixtral-8x7b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • molmo-7b-d: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • molmo2-8b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • motif-0714: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • motif-2-12-7b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • motif-3: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nanbeige4-1-3b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nemotron-3-5-lightning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nemotron-3-nano-omni-30b-a3b: Nemotron 3 Nano Omni, a separate multimodal model from Nemotron 3 Nano.
  • nemotron-cascade-2-30b-a3b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nex-n2-pro: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • north-mini-code: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nova-2-0-omni: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nova-2-0-omni-reasoning-low: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nova-2-0-omni-reasoning-medium: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nova-2-0-pro: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nova-2-0-pro-reasoning-low: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nova-2-0-pro-reasoning-medium: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nova-premier: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nvidia-nemotron-3-nano-4b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nvidia-nemotron-3-ultra-550b-a55b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nvidia-nemotron-nano-12b-v2-vl: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nvidia-nemotron-nano-12b-v2-vl-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nvidia-nemotron-nano-9b-v2: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nvidia-nemotron-nano-9b-v2-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • o1-mini: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • o1-preview: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • o1-pro: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • olmo-2-32b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • olmo-2-7b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • olmo-3-1-32b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • olmo-3-1-32b-think: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • olmo-3-32b-think: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • olmo-3-7b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • olmo-3-7b-think: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • openchat-35: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • palm-2: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • phi-3-mini: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • phi-4-mini: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • phi-4-multimodal: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • pixtral-large-2411: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • quasar-438b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen-2-5-max: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen-chat-14b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen-chat-72b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen-turbo: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen1.5-110b-chat: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen2-5-coder-7b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen2-72b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen2.5-32b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen3-0.6b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen3-0.6b-instruct-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen3-1.7b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen3-1.7b-instruct-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen3-4b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen3-4b-instruct-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwq-32b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • r1-1776: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • reka-flash: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ring-1t: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ring-2-6-1t: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ring-flash-2-0: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • sarvam-105b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • sarvam-30b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • sarvam-m-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • seed-oss-36b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • solar-mini: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • solar-mini4: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • solar-open-100b-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • solar-open2-250b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • solar-pro-2: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • solar-pro-2-preview: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • solar-pro-2-preview-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • solar-pro-2-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • sonar: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • sonar-pro: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • sonar-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • sonar-reasoning-pro: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • step-3-5-flash: Step 3.5 Flash 2603, a later snapshot; whether OpenRouter's step-3.5-flash serves it is not stated.
  • step-3-7-flash: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • step-3-vl-10b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • step-5: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • tiny-aya-global: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • tri-21b-think-preview: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • tri-21b-think-v0-5: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • tulu3-405b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.

Data sourced from Artificial Analysis. Licence: Artificial Analysis commercial data licence.