Benchmarks / Artificial Analysis

Reported by Artificial Analysis

Artificial Analysis

Share of expert-written exam questions answered correctly, as run by Artificial Analysis with its own harness and prompts.

Results dated
7 Oct 2026
Models
400
Unit
% of questions
Licence
Artificial Analysis commercial data licence

Humanity's Last Exam: GLM 5 Turbo

Top 15 of 400 results · % of questions, higher is better. Choose a model to highlight it.Clear highlight

  1. 1 Claude Opus 5.5 (max reasoning)Anthropic 61.4%
  2. 2 Claude Fable 5.1 (max)Anthropic 59.1%
  3. 3 Claude Fable 5.1 (xhigh)Anthropic 58.7%
  4. 4 Claude Opus 5.5 (xhigh reasoning)Anthropic 57.5%
  5. 5 Gemini 4 Argon (high)Google 57.1%
  6. 6 Claude Fable 5.1 (high reasoning)Anthropic 55.9%
  7. 7 Claude Opus 5.5 (high)Anthropic 55.6%
  8. 8 Claude Fable 5 (max reasoning)Anthropic 55.5%
  9. 9 Claude Sonnet 5.5 (max)Anthropic 55.0%
  10. 10 Claude Opus 5 (max)Anthropic 54.9%
  11. 11 Claude Opus 5.5 (medium reasoning)Anthropic 54.7%
  12. 11 GPT-6 Astra (max)OpenAI 54.7%
  13. 13 GPT-6 Astra (xhigh reasoning)OpenAI 54.6%
  14. 14 Claude Opus 5 (xhigh)Anthropic 54.4%
  15. 15 Claude Fable 5.1 (medium reasoning)Anthropic 53.8%
  16. 149 GLM 5 TurboZ.ai 27.8%

Full results

Artificial Analysis: Humanity's Last Exam, % of questions, higher is better
#ModelArtificial Analysis: Humanity's Last Exam
% of questions, higher is better
1 Claude Opus 5.5 (max reasoning)Anthropic
61.4%
2 Claude Fable 5.1 (max)Anthropic
59.1%
3 Claude Fable 5.1 (xhigh)Anthropic
58.7%
4 Claude Opus 5.5 (xhigh reasoning)Anthropic
57.5%
5 Gemini 4 Argon (high)Google
57.1%
6 Claude Fable 5.1 (high reasoning)Anthropic
55.9%
7 Claude Opus 5.5 (high)Anthropic
55.6%
8 Claude Fable 5 (max reasoning)Anthropic
55.5%
9 Claude Sonnet 5.5 (max)Anthropic
55.0%
10 Claude Opus 5 (max)Anthropic
54.9%
11 Claude Opus 5.5 (medium reasoning)Anthropic
54.7%
11 GPT-6 Astra (max)OpenAI
54.7%
13 GPT-6 Astra (xhigh reasoning)OpenAI
54.6%
14 Claude Opus 5 (xhigh)Anthropic
54.4%
15 Claude Fable 5.1 (medium reasoning)Anthropic
53.8%
16 GPT-6 Astra (high reasoning)OpenAI
53.1%
17 GPT-6.1 Sol (max)OpenAI
52.9%
18 Claude Opus 5 (high)Anthropic
52.8%
19 GPT-6 Astra (medium reasoning)OpenAI
52.7%
20 GPT-6.1 Sol (xhigh)OpenAI
52.6%
21 GPT-6.1 Sol (high)OpenAI
51.4%
22 Claude Opus 5 (medium)Anthropic
51.3%
23 Claude Sonnet 5.5 (xhigh)Anthropic
50.0%
24 GPT-6.1 Sol (medium)OpenAI
49.9%
25 GPT-5.6 Sol (max)OpenAI
49.5%
26 MiMo-V2.6-ProXiaomi
49.4%
27 GPT-6 Astra (low reasoning)OpenAI
49.2%
28 Claude Fable 5.1 (low reasoning)Anthropic
48.9%
29 Claude Opus 4.8 (max reasoning)Anthropic
48.7%
29 Muse Spark 1.3 (max)Meta
48.7%
31 Claude Opus 5.5 (low reasoning)Anthropic
48.3%
32 Gemini 3.7 Flash (high)Google
47.9%
32 GPT-6 Sol (max)OpenAI
47.9%
34 Gemini 3.8 Flash (high)Google
47.8%
35 Muse Spark 1.3 (xhigh)Meta
47.5%
36 GPT-6.1 Sol (low)OpenAI
47.4%
37 GPT-5.6 Sol (xhigh)OpenAI
47.3%
38 Gemini 3.1 Pro PreviewGoogle
47.0%
39 Kimi K3 (max)Moonshot AI
46.9%
40 GPT-6 Sol (xhigh)OpenAI
46.3%
41 Muse Spark 1.1 (xhigh)Meta
46.2%
42 GPT-5.6 Sol (high reasoning)OpenAI
46.0%
43 Claude Sonnet 5.5 (high)Anthropic
45.8%
43 GPT-5.5 (xhigh reasoning)OpenAI
45.8%
45 Muse Spark 1.2Meta
45.5%
46 GPT-5.5 (high)OpenAI
45.0%
47 GPT-6 Sol (high)OpenAI
44.1%
47 Grok 4.6 (xhigh)xAI
44.1%
49 GPT-5.4 (xhigh reasoning)OpenAI
43.7%
50 Claude Opus 5 (low)Anthropic
43.4%
51 Qwen3.8 Max (0902)Alibaba
43.1%
51 Grok 4.7 (xhigh)xAI
43.1%
53 Qwen3.8 Max (0803)Alibaba
43.0%
54 GPT-5.6 Terra (max)OpenAI
42.9%
54 Grok 4.6 (high)xAI
42.9%
56 Gemini 3.5 Flash (high)Google
42.7%
56 Grok 4.5 (high)xAI
42.7%
58 GPT-5.3-Codex (xhigh)OpenAI
42.5%
59 Qwen3.8 2.4T A95BAlibaba
42.4%
59 GPT-5.5 (medium reasoning)OpenAI
42.4%
61 Claude Opus 4.7 (max reasoning)Anthropic
42.3%
61 Grok 4.7 (high)xAI
42.3%
61 GLM 5.3 (max)Z.ai
42.3%
64 GPT-5.6 Sol (medium reasoning)OpenAI
42.2%
65 Gemini 3.8 Flash (medium reasoning)Google
42.1%
65 Grok 4.6 (medium)xAI
42.1%
67 GPT-5.6 Terra (xhigh)OpenAI
41.9%
68 Claude Sonnet 5 (max reasoning)Anthropic
41.3%
68 Gemini 3.5 Flash (medium)Google
41.3%
70 GLM 5.2 (max)Z.ai
41.1%
71 DeepSeek V4 Pro 0423 (max)DeepSeek
41.0%
71 GPT-6 Sol (medium)OpenAI
41.0%
73 Gemini 3.6 Flash (high)Google
40.8%
74 muse-sparkMeta
40.7%
75 Qwen3.7 MaxAlibaba
40.5%
76 Claude Opus 4.6 (max reasoning)Anthropic
39.9%
76 GLM 5.3 FlashZ.ai
39.9%
78 Claude Sonnet 5.5 (medium)Anthropic
39.8%
79 gemini-3-pro (high)Google
39.7%
80 GPT-5.6 Luna (max)OpenAI
39.5%
81 GPT-5.6 Sol (low reasoning)OpenAI
39.4%
82 DeepSeek V4.1 Flash (max)DeepSeek
39.2%
82 Grok 4.7 (low)xAI
39.2%
84 Claude Sonnet 5 (xhigh reasoning)Anthropic
39.0%
84 Gemini 3.7 Flash (medium reasoning)Google
39.0%
84 MiniMax M3MiniMax
39.0%
87 DeepSeek V4 Flash 0423 (max)DeepSeek
38.6%
88 GPT-5.6 Terra (high reasoning)OpenAI
38.5%
88 GPT-6 Luna (max)OpenAI
38.5%
90 Grok Build 0.1xAI
38.3%
91 Qwen3.8 Flash NextAlibaba
38.0%
92 GPT-5.2 (xhigh)OpenAI
37.7%
93 deepseek-v4-pro-preview (max reasoning)DeepSeek
37.5%
93 Kimi K2.6Moonshot AI
37.5%
95 Grok 4.3 (high)xAI
37.2%
96 Gemini 3.8 Flash (low reasoning)Google
37.1%
97 GPT-5.6 Luna (xhigh)OpenAI
37.0%
98 gemini-3-flash (thinking reasoning)Google
36.6%
98 GLM 5.3 (low reasoning)Z.ai
36.6%
100 Claude Sonnet 5.5 (low reasoning)Anthropic
36.2%
101 Claude Sonnet 5 (high)Anthropic
35.7%
101 GPT-5.2-Codex (xhigh)OpenAI
35.7%
101 MiMo-V2.5-Pro (thinking reasoning)Xiaomi
35.7%
104 Qwen3.7 PlusAlibaba
35.6%
105 deepseek-v4-pro-preview (high reasoning)DeepSeek
35.2%
106 Gemini 3.7 Flash (low reasoning)Google
35.1%
106 MiMo-V2.6-FlashXiaomi
35.1%
108 Mistral Large 4Mistral
35.0%
108 Kimi K2.7 CodeMoonshot AI
35.0%
110 GPT-6 Sol (low)OpenAI
34.9%
111 deepseek-v4-flash-preview (max reasoning)DeepSeek
34.8%
112 DeepSeek V4 Flash Vision (experimental, max)DeepSeek
34.5%
112 Grok 4.20xAI
34.5%
114 GPT-6 Luna (xhigh)OpenAI
34.3%
115 Qwen3.8 27B (xhigh)Alibaba
33.9%
116 Claude Sonnet 4.6 (max reasoning)Anthropic
33.6%
117 Hy3Tencent
33.5%
118 GPT-5.6 Luna (high reasoning)OpenAI
33.4%
119 Claude Opus 4.7 (off)Anthropic
33.3%
119 GPT-5.6 Terra (medium reasoning)OpenAI
33.3%
119 Inkling SmallThinkingmachines
33.3%
122 GPT-6 Luna (high)OpenAI
32.9%
123 GPT-5.5 (low reasoning)OpenAI
32.7%
124 grok-4.20-0309-reasoningxAI
32.4%
125 Inkling (xhigh)Thinkingmachines
31.9%
126 Qwen3.6 Max PreviewAlibaba
30.8%
126 GPT-5.4 (low reasoning)OpenAI
30.8%
128 Kimi K2.5Moonshot AI
30.7%
129 deepseek-v4-flash-preview (high reasoning)DeepSeek
30.3%
130 Claude Opus 4.5 (thinking reasoning)Anthropic
30.1%
130 GLM 5.1Z.ai
30.1%
132 Claude Sonnet 5 (medium reasoning)Anthropic
30.0%
132 Grok 4.3 (medium)xAI
30.0%
134 MiniMax M2.7MiniMax
29.6%
135 gemini-3-pro (low)Google
29.5%
136 GLM 5Z.ai
29.3%
137 GPT-5.6 Terra (low reasoning)OpenAI
29.2%
137 Solar Pro 4Upstage
29.2%
139 Qwen3.5 397B A17BAlibaba
29.0%
140 deepseek-v3.2-specialeDeepSeek
28.7%
141 GPT-5.1 (high)OpenAI
28.5%
141 GPT-5 (high)OpenAI
28.5%
143 GPT-5.4 Nano (xhigh)OpenAI
28.3%
143 GPT-6 Luna (medium)OpenAI
28.3%
145 GPT-5.4 Mini (xhigh)OpenAI
28.1%
146 Qwen3 Max ThinkingAlibaba
28.0%
147 Grok 4.20 (off)xAI
27.9%
147 GLM 5.1 (no reasoning)Z.ai
27.9%
149 Qwen3.6 PlusAlibaba
27.8%
149 GPT-5-Codex (high)OpenAI
27.8%
149 Hy3 preview (thinking reasoning)Tencent
27.8%
149 GLM 5 TurboZ.ai
27.8%
153 Grok 4.6 (low)xAI
27.6%
154 GLM 4.7Z.ai
27.4%
155 MiMo-V2.5Xiaomi
27.2%
156 GPT-5.2 (medium reasoning)OpenAI
26.7%
156 grok-4xAI
26.7%
158 GPT-5.6 Luna (medium reasoning)OpenAI
25.8%
159 GPT-5.1-Codex (high)OpenAI
25.7%
160 GPT-5 (medium)OpenAI
25.4%
161 Qwen3.5-122B-A10BAlibaba
25.2%
162 Kimi K3 (low reasoning)Moonshot AI
25.0%
163 DeepSeek V3.2DeepSeek
24.6%
164 grok-4.20-0309-non-reasoning (no reasoning)xAI
24.5%
165 Gemini 3.5 Flash (minimal reasoning)Google
24.1%
166 Qwen3.5-27BAlibaba
23.9%
167 Kimi K2 ThinkingMoonshot AI
23.8%
168 Gemma 4 31BGoogle
23.6%
169 MiniMax M2.1MiniMax
23.2%
170 Qwen3.6 27BAlibaba
23.1%
171 Gemini 2.5 ProGoogle
22.5%
172 Qwen3.6 35B A3BAlibaba
22.2%
173 muse-glimmer (high)Meta
22.0%
174 Claude Sonnet 5 (low reasoning)Anthropic
21.9%
175 GPT-5.5 Instant (26 May)OpenAI
21.6%
176 GPT-5 Mini (high)OpenAI
21.5%
177 Step 3.5 FlashStepfun
21.1%
178 Qwen3.5-35B-A3BAlibaba
21.0%
179 Nemotron 3 SuperNVIDIA
20.8%
180 MiniMax M2.5MiniMax
20.5%
181 GPT-6 Luna (low)OpenAI
20.3%
182 o3OpenAI
20.1%
183 GPT-5.5 Instant (26 June)OpenAI
19.9%
184 Qwen3.5 397B A17B (no reasoning)Alibaba
19.8%
184 GPT-5.6 Luna (low reasoning)OpenAI
19.8%
186 Kimi K2.6 (no reasoning)Moonshot AI
19.6%
186 GPT-5 (low reasoning)OpenAI
19.6%
186 gpt-oss-120b (high)OpenAI
19.6%
189 Gemma 4 26B A4BGoogle
19.3%
189 grok-4-1-fast-reasoningxAI
19.3%
191 Claude Opus 4.6 (off)Anthropic
19.1%
191 grok-4-fast-reasoningxAI
19.1%
193 Claude Sonnet 5 (off)Anthropic
19.0%
194 Gemini 3.5 Flash LiteGoogle
18.8%
195 GPT-5.4 Mini (medium)OpenAI
18.6%
196 GPT-5.1-Codex-Mini (high)OpenAI
18.5%
197 GPT-6 Sol (no reasoning)OpenAI
18.4%
197 Grok 4.3 (low)xAI
18.4%
199 Claude Sonnet 4.5 (thinking reasoning)Anthropic
17.8%
200 Gemini 3.1 Flash Lite PreviewGoogle
17.2%
201 Mercury 2Inception
17.1%
201 GLM 5V TurboZ.ai
17.1%
203 GPT-5.6 Sol (no reasoning)OpenAI
16.7%
204 o4 Mini (high reasoning)OpenAI
16.5%
205 DeepSeek V3.1 TerminusDeepSeek
16.4%
206 Qwen3 235B A22B Thinking 2507Alibaba
15.9%
206 Qwen3.5-122B-A10B (no reasoning)Alibaba
15.9%
206 GPT-5.4 Nano (medium)OpenAI
15.9%
206 GPT-5 Mini (medium)OpenAI
15.9%
210 Trinity Large ThinkingArcee Ai
15.8%
210 R1 0528DeepSeek
15.8%
212 gemma-4-12b-itGoogle
15.7%
213 Qwen3.6 27B (no reasoning)Alibaba
15.1%
214 gemini-3-flash (off)Google
15.0%
215 Qwen3.5-9BAlibaba
14.9%
215 Qwen3.5 Omni PlusAlibaba
14.9%
215 DeepSeek V3.2 ExpDeepSeek
14.9%
218 MiMo-V2.5-Pro (no reasoning)Xiaomi
14.8%
219 GLM 4.6 (thinking reasoning)Z.ai
14.5%
220 DeepSeek V3.1DeepSeek
14.3%
221 Qwen3.8 27B (medium)Alibaba
14.1%
222 Qwen3.8 27B (low)Alibaba
14.0%
223 Qwen3.5-27B (no reasoning)Alibaba
13.9%
223 Qwen3.6 35B A3B (no reasoning)Alibaba
13.9%
225 gemini-2.5-flash-preview-09-2025 (thinking reasoning)Google
13.8%
225 Mistral Medium 3.5Mistral
13.8%
227 MiniMax M2MiniMax
13.7%
227 GPT-5.5 (no reasoning)OpenAI
13.7%
229 Qwen3.5-35B-A3B (no reasoning)Alibaba
13.4%
230 Claude Sonnet 4.6 (off)Anthropic
13.3%
231 Claude Opus 4.5 (no reasoning)Anthropic
13.2%
231 Kimi K2.5Moonshot AI
13.2%
233 GLM 4.5Z.ai
13.0%
234 Qwen3 Max Thinking (preview)Alibaba
12.7%
235 Qwen3 Next 80B A3B ThinkingAlibaba
12.6%
236 Claude Opus 4.1 (thinking reasoning)Anthropic
12.5%
237 Qwen3.8 27B (off)Alibaba
12.1%
237 Gemini 2.5 Flash (thinking reasoning)Google
12.1%
239 o3 Mini HighOpenAI
12.0%
240 Qwen3 MaxAlibaba
11.9%
240 Qwen3 VL 235B A22B ThinkingAlibaba
11.9%
242 Gemma 4 31B (off)Google
11.8%
243 Nova 2 Lite (high reasoning)Amazon
11.6%
244 Gemma 4 26B A4B (off)Google
11.5%
245 Nemotron 3 Nano 30B A3B (thinking reasoning)NVIDIA
11.4%
245 GPT-5.6 Terra (no reasoning)OpenAI
11.4%
247 GPT-5.4 (no reasoning)OpenAI
11.3%
248 DeepSeek V3.2 (no reasoning)DeepSeek
11.2%
249 Qwen3 235B A22B Instruct 2507Alibaba
11.1%
250 Qwen3 235B A22B (thinking reasoning)Alibaba
11.0%
250 gpt-oss-20b (high reasoning)OpenAI
11.0%
252 DeepSeek V4.1 Flash (off)DeepSeek
10.8%
252 DiffusionGemma 26B A4BGoogle
10.8%
254 Claude Sonnet 4 (thinking reasoning)Anthropic
10.7%
255 DeepSeek V4 Pro 0423 (no reasoning)DeepSeek
10.6%
256 Claude Haiku 4.5 (thinking reasoning)Anthropic
10.4%
257 Qwen3 30B A3B Thinking 2507Alibaba
10.3%
257 Magistral Medium 1.2Mistral
10.3%
257 Solar Pro 3Upstage
10.3%
260 Qwen3 Coder NextAlibaba
10.1%
260 qwen3-max-previewAlibaba
10.1%
260 qwen3-vl-32b-thinkingAlibaba
10.1%
263 qwen3.5-4b (thinking reasoning)Alibaba
9.9%
263 Mistral Small 4Mistral
9.9%
265 GLM 5.2 (no reasoning)Z.ai
9.8%
266 Granite 4.2 8BIBM
9.7%
267 GLM 4.6V (thinking reasoning)Z.ai
9.6%
268 GPT-5 Nano (high)OpenAI
9.5%
269 Qwen3.5-9B (no reasoning)Alibaba
9.4%
270 Nova 2 Lite (medium reasoning)Amazon
9.0%
270 DeepSeek V3.2 Exp (no reasoning)DeepSeek
9.0%
272 Qwen3 VL 30B A3B ThinkingAlibaba
8.9%
273 DeepSeek V3.1 Terminus (no reasoning)DeepSeek
8.7%
273 gemini-2.5-flash-preview-09-2025 (no reasoning)Google
8.7%
273 GPT-5 Nano (medium)OpenAI
8.7%
276 GPT-6 Luna (no reasoning)OpenAI
8.6%
277 R1DeepSeek
8.5%
278 deepseek-v4-pro-preview (no reasoning)DeepSeek
8.2%
279 qwen3.5-4b (no reasoning)Alibaba
8.0%
279 GPT-5.2 (no reasoning)OpenAI
8.0%
279 Grok Code Fast 1xAI
8.0%
282 o3 MiniOpenAI
7.9%
283 deepseek-v4-flash-preview (no reasoning)DeepSeek
7.8%
284 Qwen3.5 Omni FlashAlibaba
7.6%
284 Qwen3 Next 80B A3B InstructAlibaba
7.6%
284 GLM 4.7 FlashZ.ai
7.6%
284 GLM 5 (no reasoning)Z.ai
7.6%
288 qwen3-omni-30b-a3b-thinkingAlibaba
7.5%
289 Qwen3 32B (thinking reasoning)Alibaba
7.4%
289 Kimi K2 0711Moonshot AI
7.4%
291 Claude Sonnet 4.5 (no reasoning)Anthropic
7.2%
291 GPT-5.6 Luna (no reasoning)OpenAI
7.2%
293 gemini-2.5-flash-lite-preview-09-2025 (thinking reasoning)Google
7.0%
293 o1OpenAI
7.0%
293 Hy3 preview (no reasoning)Tencent
7.0%
293 GLM 4.5 AirZ.ai
7.0%
297 Qwen3 30B A3B Instruct 2507Alibaba
6.9%
298 Qwen3 VL 32B InstructAlibaba
6.8%
298 Gemini 2.5 Flash Lite (thinking reasoning)Google
6.8%
298 Grok 4.3 (off)xAI
6.8%
301 DeepSeek V3.1 (no reasoning)DeepSeek
6.7%
302 Qwen3 VL 235B A22B InstructAlibaba
6.6%
302 gpt-5-chatOpenAI
6.6%
304 magistral-small-2509Mistral
6.4%
304 Kimi K2 0905Moonshot AI
6.4%
304 GLM 4.7 (no reasoning)Z.ai
6.4%
307 Qwen3 VL 30B A3B InstructAlibaba
6.3%
307 gemma-4-12b-it (no reasoning)Google
6.3%
307 GLM 4.5V (thinking reasoning)Z.ai
6.3%
310 Qwen3 30B A3B (thinking reasoning)Alibaba
6.2%
310 qwen3-4b-thinking-2507Alibaba
6.2%
312 GPT-5 (minimal reasoning)OpenAI
6.0%
313 GPT-5.4 Mini (no reasoning)OpenAI
5.9%
313 gpt-oss-120b (low)OpenAI
5.9%
315 Llama 3.2 1B InstructMeta
5.5%
315 GLM 4.6 (no reasoning)Z.ai
5.5%
317 Ministral 3 3B 2512Mistral
5.4%
318 Gemma 3 4BGoogle
5.3%
318 Llama 3.1 8B InstructMeta
5.3%
318 Llama 3.2 3B InstructMeta
5.3%
318 GPT-5.1 (off)OpenAI
5.3%
318 gpt-oss-20b (low reasoning)OpenAI
5.3%
323 qwen3.5-0.8b (no reasoning)Alibaba
5.1%
323 gemini-2.5-flash-lite-preview-09-2025 (no reasoning)Google
5.1%
323 GPT-5 Mini (minimal)OpenAI
5.1%
323 grok-4-1-fast-non-reasoning (no reasoning)xAI
5.1%
327 qwen3.5-2b (no reasoning)Alibaba
5.0%
327 GPT-4.1 MiniOpenAI
5.0%
327 GLM 4.7 Flash (no reasoning)Z.ai
5.0%
330 Llama 4 MaverickMeta
4.9%
331 gemma-4-e2b-itGoogle
4.8%
331 gemma-4-e4b-it (no reasoning)Google
4.8%
333 DeepSeek V3 0324DeepSeek
4.7%
333 Gemini 2.5 Flash (no reasoning)Google
4.7%
333 gemma-4-e2b-it (no reasoning)Google
4.7%
333 Mistral Medium 3.1Mistral
4.7%
337 Qwen3 30B A3B (no reasoning)Alibaba
4.6%
337 Qwen3 Omni 30B A3B InstructAlibaba
4.6%
337 qwen3-vl-4b-thinkingAlibaba
4.6%
337 Nova Micro 1.0Amazon
4.6%
337 Ministral 3 14B 2512Mistral
4.6%
337 Nemotron 3 Nano 30B A3B (no reasoning)NVIDIA
4.6%
343 Qwen3 14B (thinking reasoning)Alibaba
4.5%
343 qwen3-4b-instruct-2507Alibaba
4.5%
343 Qwen3 Coder 480B A35BAlibaba
4.5%
343 Llama 3.1 70B InstructMeta
4.5%
343 grok-4-fast-non-reasoning (no reasoning)xAI
4.5%
348 Gemma 3 27BGoogle
4.4%
348 Reka Flash 3Rekaai
4.4%
350 Nova Lite 1.0Amazon
4.3%
350 Claude Sonnet 4 (no reasoning)Anthropic
4.3%
350 Ministral 3 8B 2512Mistral
4.3%
350 Mistral Small 3.1 24BMistral
4.3%
350 Mistral Small 3.2 24BMistral
4.3%
355 Qwen3 235B A22BAlibaba
4.2%
355 Claude Haiku 4.5 (no reasoning)Anthropic
4.2%
355 Gemma 3 12BGoogle
4.2%
355 Mistral Large 3 2512Mistral
4.2%
355 GPT-4.1OpenAI
4.2%
355 GPT-4o-mini (2024-07-18)OpenAI
4.2%
361 Qwen3 14B (no reasoning)Alibaba
4.1%
361 Qwen3 32B (no reasoning)Alibaba
4.1%
361 Mistral Medium 3Mistral
4.1%
361 GPT-5.4 Nano (no reasoning)OpenAI
4.1%
365 Nova 2 Lite (low reasoning)Amazon
4.0%
365 Command ACohere
4.0%
365 Mixtral 8x22B InstructMistral
4.0%
365 GPT-5 Nano (minimal)OpenAI
4.0%
369 Qwen3 8B (thinking reasoning)Alibaba
3.9%
370 Qwen3 Coder 30B A3B InstructAlibaba
3.8%
370 Qwen3 VL 8B ThinkingAlibaba
3.8%
370 gemma-4-e4b-itGoogle
3.8%
370 Llama 4 ScoutMeta
3.8%
370 Phi 4Microsoft
3.8%
370 Devstral MediumMistral
3.8%
370 Devstral Small 1.1Mistral
3.8%
370 Mistral Small 3Mistral
3.8%
370 Mistral Small 4 (no reasoning)Mistral
3.8%
370 GPT-4.1 NanoOpenAI
3.8%
380 Gemini 2.5 Flash Lite (no reasoning)Google
3.7%
380 GLM 4.6V (no reasoning)Z.ai
3.7%
382 Qwen2.5 72B InstructAlibaba
3.6%
382 qwen3-vl-4b-instructAlibaba
3.6%
382 Gemma 3 270MGoogle
3.6%
382 Llama 3.3 70B InstructMeta
3.6%
382 Devstral 2 2512Mistral
3.6%
387 Qwen2.5 Coder 32B InstructAlibaba
3.5%
387 devstral-small-2-24b-instruct-2512Mistral
3.5%
387 GLM 4.5V (off)Z.ai
3.5%
390 Nova Pro 1.0Amazon
3.2%
391 Nova 2 Lite (no reasoning)Amazon
2.9%
391 DeepSeek V3DeepSeek
2.9%
391 Mistral Large 2407Mistral
2.9%
394 Qwen3 VL 8B InstructAlibaba
2.7%
395 qwen3.5-2b (thinking reasoning)Alibaba
2.6%
396 kimi-linear-48b-a3b-instructMoonshot AI
2.5%
397 GPT-4o (2024-08-06)OpenAI
2.3%
398 Qwen3 8B (no reasoning)Alibaba
1.9%
399 GPT-4o (2024-05-13)OpenAI
1.8%
400 qwen3.5-0.8b (thinking reasoning)Alibaba
1.1%

Results as published by Artificial Analysis; we do not re-run them.

What it measures

Share of expert-written exam questions answered correctly, as run by Artificial Analysis with its own harness and prompts.

What it does not measure

Not everyday work; academic questions at the edge of expertise.

Source

Artificial Analysis · Methodology

Failures

Failures count against a model: a product with no usable output is a failed listing. They are listed here so you can see why.

Not ranked

  • GPT-4 Turbo: AA dates its GPT-4 Turbo 6 Nov 2023 (gpt-4-1106-preview); OpenRouter's gpt-4-turbo is the 2024-04-09 snapshot.
  • QwQ-32B-Preview: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • a-x-k2: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • apertus-70b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • apertus-8b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • apodex-1-1: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • apriel-v1-5-15b-thinker: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • apriel-v1-6-15b-thinker: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • arctic-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • celeris-1: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-2: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-21: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-3-5-haiku: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-3-7-sonnet: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-3-7-sonnet-thinking: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-3-haiku: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-3-opus: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-3-sonnet: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-35-sonnet: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-35-sonnet-june-24: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-4-opus: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-4-opus-thinking: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-instant: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • claude-sonnet-4-6-non-reasoning-low-effort: non-standard setting combination
  • cogito-v2-1-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • command-a-plus: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • command-r-03-2024: Command R (March 2024); OpenRouter sells only the 08-2024 snapshot.
  • command-r-plus-04-2024: Command R+ (April 2024); OpenRouter sells only the 08-2024 snapshot.
  • dbrx: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • deephermes-3-llama-3-1-8b-preview: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • deephermes-3-mistral-24b-preview: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • deepseek-coder-v2: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • deepseek-coder-v2-lite: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • deepseek-llm-67b-chat: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • deepseek-r1-distill-llama-70b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • deepseek-r1-distill-llama-8b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • deepseek-r1-distill-qwen-1-5b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • deepseek-r1-distill-qwen-14b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • deepseek-r1-distill-qwen-32b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • deepseek-r1-qwen3-8b: A distilled Qwen3 8B, not DeepSeek R1 itself.
  • deepseek-v2: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • deepseek-v2-5: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • deepseek-v2-5-sep-2024: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • devstral-small-2505: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • doubao-seed-code: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ernie-4-5-300b-a47b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ernie-5-0-thinking-preview: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • exaone-4-0-1-2b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • exaone-4-0-1-2b-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • exaone-4-0-32b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • exaone-4-0-32b-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • exaone-4-5-33b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • falcon-h1r-7b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • g9v3-39a5b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • g9v3-3b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-1-0-pro: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-1-0-ultra: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-1-5-flash: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-1-5-flash-8b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-1-5-flash-may-2024: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-1-5-pro: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-1-5-pro-may-2024: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-2-0-flash: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-2-0-flash-experimental: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-2-0-flash-lite-001: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-2-0-flash-lite-preview: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-2-0-flash-thinking-exp-0121: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-2-0-flash-thinking-exp-1219: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-2-0-pro-experimental-02-05: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemini-2-5-flash-04-2025: Gemini 2.5 Flash preview (April 2025), an earlier snapshot than the stable model.
  • gemini-2-5-flash-reasoning-04-2025: Gemini 2.5 Flash preview (April 2025), an earlier snapshot than the stable model.
  • gemini-2-5-pro-03-25: Gemini 2.5 Pro preview 03-25; OpenRouter's gemini-2.5-pro-preview is the 06-05 preview.
  • gemini-2-5-pro-05-06: Gemini 2.5 Pro preview 05-06; OpenRouter's gemini-2.5-pro-preview is the 06-05 preview.
  • gemma-3-1b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemma-3n-e2b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemma-3n-e4b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gemma-3n-e4b-preview-0520: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gpt-35-turbo: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gpt-4: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gpt-4-5: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gpt-4o: GPT-4o (Nov '24, 2024-11-20); OpenRouter prices only the May and August 2024 snapshots.
  • gpt-4o-chatgpt: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • gpt-4o-chatgpt-03-25: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • granite-3-3-8b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • granite-4-0-350m: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • granite-4-0-h-350m: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • granite-4-0-h-nano-1b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • granite-4-0-h-small: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • granite-4-0-micro: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • granite-4-0-nano-1b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • granite-4-1-30b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • granite-4-1-3b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • granite-4-1-8b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • granite-4-2-30b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • granite-4-2-3b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • grok-1: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • grok-2-1212: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • grok-3: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • grok-3-mini-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • grok-3-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • grok-beta: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • hermes-3-llama-3-1-70b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • hermes-4-llama-3-1-405b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • hermes-4-llama-3-1-405b-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • hermes-4-llama-3-1-70b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • hermes-4-llama-3-1-70b-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • hyperclova-x-seed-think-32b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • hypernova-60b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • intellect-3: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • jamba-1-5-large: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • jamba-1-5-mini: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • jamba-1-6-large: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • jamba-1-6-mini: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • jamba-1-7-large: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • jamba-1-7-mini: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • jamba-reasoning-3b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • jt-35b-flash: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • jt-4-1-flash-236b-a21b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • jt-4-1-flash-236b-a21b-non-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • jt-mini: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • k-exaone: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • k-exaone-2-0-0803: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • k-exaone-non-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • k2-horizon-0-9b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • k2-horizon-3-7b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • k2-horizon-375b-a23b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • k2-horizon-7b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • k2-horizon-mova-36b-a4b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • k2-think-v2: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • k2-v2: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • k2-v2-low: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • k2-v2-medium: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • kat-coder-pro-v1: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • kat-coder-pro-v2: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • lfm-40b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • lfm2-1-2b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • lfm2-2-6b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • lfm2-24b-a2b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • lfm2-5-1-2b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • lfm2-5-1-2b-thinking: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • lfm2-5-2-6b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • lfm2-5-8b-a1b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • lfm2-5-vl-1-6b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • lfm2-8b-a1b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ling-1t: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ling-2-6-1t: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ling-2-6-flash: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ling-3-0-flash: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ling-3-0-flash-fin: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ling-3-0-flash-vl: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ling-3-0-tiny: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ling-3-1-flash: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ling-flash-2-0: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ling-mini-2-0: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-2-chat-13b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-2-chat-70b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-2-chat-7b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-3-1-instruct-405b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-3-1-nemotron-instruct-70b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-3-1-nemotron-nano-4b-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-3-1-nemotron-ultra-253b-v1-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-3-2-instruct-11b-vision: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-3-2-instruct-90b-vision: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-3-3-nemotron-super-49b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-3-3-nemotron-super-49b-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-3-instruct-70b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-3-instruct-8b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-65b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-nemotron-super-49b-v1-5: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • llama-nemotron-super-49b-v1-5-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • longcat-2-0: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • longcat-flash-lite: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • magistral-medium: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • magistral-small: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mercury-2-5: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mi-dm-k-2-5-pro-dec28: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • midm-250-pro-rsnsft: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mimo-v2-0206: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mimo-v2-flash: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mimo-v2-flash-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mimo-v2-omni: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mimo-v2-omni-0327: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mimo-v2-pro: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • minicpm-v4-6-1-3b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • minicpm5-1b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • minicpm5-1b-non-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • minicpm5-2b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • minimax-m1-40k: MiniMax M1 40k and 80k are separate checkpoints; which one OpenRouter's minimax-m1 serves is not stated.
  • minimax-m1-80k: MiniMax M1 40k and 80k are separate checkpoints; which one OpenRouter's minimax-m1 serves is not stated.
  • mistral-7b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mistral-large: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mistral-large-2: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mistral-medium: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mistral-saba: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mistral-small: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mistral-small-2402: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • mixtral-8x7b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • molmo-7b-d: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • molmo2-8b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • motif-0714: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • motif-2-12-7b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • motif-3: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nanbeige4-1-3b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nemotron-3-5-lightning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nemotron-3-nano-omni-30b-a3b: Nemotron 3 Nano Omni, a separate multimodal model from Nemotron 3 Nano.
  • nemotron-cascade-2-30b-a3b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nex-n2-pro: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • north-mini-code: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nova-2-0-omni: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nova-2-0-omni-reasoning-low: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nova-2-0-omni-reasoning-medium: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nova-2-0-pro: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nova-2-0-pro-reasoning-low: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nova-2-0-pro-reasoning-medium: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nova-premier: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nvidia-nemotron-3-nano-4b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nvidia-nemotron-3-ultra-550b-a55b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nvidia-nemotron-nano-12b-v2-vl: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nvidia-nemotron-nano-12b-v2-vl-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nvidia-nemotron-nano-9b-v2: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • nvidia-nemotron-nano-9b-v2-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • o1-mini: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • o1-preview: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • o1-pro: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • olmo-2-32b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • olmo-2-7b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • olmo-3-1-32b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • olmo-3-1-32b-think: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • olmo-3-32b-think: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • olmo-3-7b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • olmo-3-7b-think: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • openchat-35: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • palm-2: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • phi-3-mini: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • phi-4-mini: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • phi-4-multimodal: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • pixtral-large-2411: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • quasar-438b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen-2-5-max: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen-chat-14b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen-chat-72b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen-turbo: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen1.5-110b-chat: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen2-5-coder-7b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen2-72b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen2.5-32b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen3-0.6b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen3-0.6b-instruct-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen3-1.7b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen3-1.7b-instruct-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen3-4b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwen3-4b-instruct-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • qwq-32b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • r1-1776: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • reka-flash: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ring-1t: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ring-2-6-1t: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • ring-flash-2-0: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • sarvam-105b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • sarvam-30b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • sarvam-m-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • seed-oss-36b-instruct: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • solar-mini: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • solar-mini4: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • solar-open-100b-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • solar-open2-250b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • solar-pro-2: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • solar-pro-2-preview: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • solar-pro-2-preview-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • solar-pro-2-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • sonar: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • sonar-pro: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • sonar-reasoning: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • sonar-reasoning-pro: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • step-3-5-flash: Step 3.5 Flash 2603, a later snapshot; whether OpenRouter's step-3.5-flash serves it is not stated.
  • step-3-7-flash: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • step-3-vl-10b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • step-5: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • tiny-aya-global: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • tri-21b-think-preview: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • tri-21b-think-v0-5: Not in the site's price list (content/prices.json); out of scope until the model is on sale.
  • tulu3-405b: Not in the site's price list (content/prices.json); out of scope until the model is on sale.

Data sourced from Artificial Analysis. Licence: Artificial Analysis commercial data licence.