Benchmarks / Artificial Analysis
Reported by Artificial Analysis
Artificial Analysis
Share of graduate-level science questions answered correctly, as run by Artificial Analysis with its own harness and prompts.
- Results dated
- 1 Oct 2026
- Models
- 276
- Unit
- % of questions
Full results
| # | Model | Artificial Analysis: GPQA Diamond % of questions, higher is better |
|---|---|---|
| 1 | GPT-6 Astra (xhigh reasoning)OpenAI |
96.3%
|
| 2 | GPT-6 Astra (max)OpenAI |
96.1%
|
| 3 | Gemini 3.8 Flash (high)Google |
95.3%
|
| 4 | GPT-6 Astra (high reasoning)OpenAI |
94.9%
|
| 4 | Grok 4.6 (high)xAI |
94.9%
|
| 6 | Gemini 3.7 Flash (high)Google |
94.5%
|
| 7 | Gemini 3.1 Pro PreviewGoogle |
94.1%
|
| 7 | Muse Spark 1.3 (xhigh)Meta |
94.1%
|
| 7 | GPT-5.6 Sol (max)OpenAI |
94.1%
|
| 10 | GPT-6 Astra (medium reasoning)OpenAI |
93.9%
|
| 11 | Claude Fable 5.1 (max)Anthropic |
93.7%
|
| 11 | Claude Opus 5 (high)Anthropic |
93.7%
|
| 11 | Claude Opus 5 (xhigh)Anthropic |
93.7%
|
| 14 | Qwen3.8 2.4T A95BAlibaba |
93.5%
|
| 14 | Gemini 3.8 Flash (medium reasoning)Google |
93.5%
|
| 14 | Muse Spark 1.3 (max)Meta |
93.5%
|
| 14 | Kimi K3 (max)Moonshot AI |
93.5%
|
| 14 | GPT-5.5 (xhigh reasoning)OpenAI |
93.5%
|
| 14 | Grok 4.6 (medium)xAI |
93.5%
|
| 14 | Grok 4.6 (xhigh)xAI |
93.5%
|
| 21 | Claude Fable 5.1 (xhigh)Anthropic |
93.4%
|
| 22 | Claude Opus 5 (max)Anthropic |
93.2%
|
| 22 | GPT-5.5 (high)OpenAI |
93.2%
|
| 24 | GPT-5.6 Sol (xhigh)OpenAI |
93.1%
|
| 24 | GPT-6 Astra (low reasoning)OpenAI |
93.1%
|
| 24 | Grok 4.5 (high)xAI |
93.1%
|
| 27 | Qwen3.8 Max (0902)Alibaba |
92.8%
|
| 27 | DeepSeek V4 Pro 0423 (max)DeepSeek |
92.8%
|
| 27 | Gemini 3.6 Flash (high)Google |
92.8%
|
| 27 | GPT-5.6 Sol (high reasoning)OpenAI |
92.8%
|
| 31 | Qwen3.8 Max (0803)Alibaba |
92.7%
|
| 32 | Claude Fable 5 (max reasoning)Anthropic |
92.6%
|
| 32 | GPT-5.5 (medium reasoning)OpenAI |
92.6%
|
| 32 | GPT-5.6 Sol (medium reasoning)OpenAI |
92.6%
|
| 35 | GPT-5.6 Terra (max)OpenAI |
92.5%
|
| 36 | Qwen3.7 MaxAlibaba |
92.3%
|
| 36 | Qwen3.8 Flash NextAlibaba |
92.3%
|
| 38 | Gemini 3.5 Flash (high)Google |
92.2%
|
| 39 | Gemini 3.5 Flash (medium)Google |
92.1%
|
| 39 | Gemini 3.7 Flash (medium reasoning)Google |
92.1%
|
| 41 | Claude Opus 4.8 (max reasoning)Anthropic |
92.0%
|
| 41 | Gemini 3.8 Flash (low reasoning)Google |
92.0%
|
| 41 | GPT-5.4 (xhigh reasoning)OpenAI |
92.0%
|
| 44 | Claude Opus 5 (medium)Anthropic |
91.9%
|
| 45 | GLM 5.3 (max)Z.ai |
91.7%
|
| 46 | GPT-5.3-Codex (xhigh)OpenAI |
91.5%
|
| 47 | Claude Opus 4.7 (max reasoning)Anthropic |
91.4%
|
| 48 | DeepSeek V4 Flash Vision (experimental, max)DeepSeek |
91.3%
|
| 49 | GLM 5.3 FlashZ.ai |
91.2%
|
| 50 | Claude Sonnet 5 (max reasoning)Anthropic |
91.1%
|
| 50 | Kimi K2.6Moonshot AI |
91.1%
|
| 50 | GPT-5.6 Luna (max)OpenAI |
91.1%
|
| 50 | Grok 4.20xAI |
91.1%
|
| 54 | GPT-5.5 (low reasoning)OpenAI |
91.0%
|
| 55 | DeepSeek V4 Flash 0423 (max)DeepSeek |
90.8%
|
| 55 | gemini-3-pro (high)Google |
90.8%
|
| 55 | GPT-5.6 Terra (xhigh)OpenAI |
90.8%
|
| 58 | Claude Fable 5.1 (high reasoning)Anthropic |
90.6%
|
| 59 | Qwen3.8 27B (xhigh)Alibaba |
90.5%
|
| 59 | deepseek-v4-pro-preview (high reasoning)DeepSeek |
90.5%
|
| 61 | Muse Spark 1.2Meta |
90.4%
|
| 62 | GPT-5.2 (xhigh)OpenAI |
90.3%
|
| 63 | Gemini 3.7 Flash (low reasoning)Google |
90.1%
|
| 63 | Grok 4.3 (high)xAI |
90.1%
|
| 65 | Qwen3.7 PlusAlibaba |
90.0%
|
| 66 | GPT-5.2-Codex (xhigh)OpenAI |
89.9%
|
| 67 | gemini-3-flash (thinking reasoning)Google |
89.8%
|
| 67 | Muse Spark 1.1 (xhigh)Meta |
89.8%
|
| 67 | GPT-5.6 Sol (low reasoning)OpenAI |
89.8%
|
| 70 | Claude Opus 4.6 (max reasoning)Anthropic |
89.6%
|
| 70 | Kimi K2.7 CodeMoonshot AI |
89.6%
|
| 70 | GPT-5.6 Terra (high reasoning)OpenAI |
89.6%
|
| 73 | GPT-5.6 Luna (xhigh)OpenAI |
89.5%
|
| 73 | Grok Build 0.1xAI |
89.5%
|
| 73 | GLM 5.2 (max)Z.ai |
89.5%
|
| 76 | deepseek-v4-flash-preview (max reasoning)DeepSeek |
89.4%
|
| 77 | Qwen3.5 397B A17BAlibaba |
89.3%
|
| 78 | GPT-5.6 Luna (high reasoning)OpenAI |
89.2%
|
| 79 | Grok 4.3 (medium)xAI |
89.0%
|
| 80 | Claude Opus 5 (low)Anthropic |
88.9%
|
| 81 | Qwen3.6 Max PreviewAlibaba |
88.8%
|
| 81 | deepseek-v4-pro-preview (max reasoning)DeepSeek |
88.8%
|
| 83 | gemini-3-pro (low)Google |
88.7%
|
| 84 | Claude Fable 5.1 (medium reasoning)Anthropic |
88.6%
|
| 85 | Claude Opus 4.7 (off)Anthropic |
88.5%
|
| 85 | grok-4.20-0309-reasoningxAI |
88.5%
|
| 87 | muse-sparkMeta |
88.4%
|
| 88 | Qwen3.6 PlusAlibaba |
88.2%
|
| 89 | Claude Fable 5.1 (low reasoning)Anthropic |
88.1%
|
| 90 | Kimi K2.5Moonshot AI |
87.9%
|
| 90 | Grok 4.6 (low)xAI |
87.9%
|
| 92 | grok-4xAI |
87.7%
|
| 93 | Claude Sonnet 4.6 (max reasoning)Anthropic |
87.5%
|
| 93 | GPT-5.4 Mini (xhigh)OpenAI |
87.5%
|
| 95 | GPT-5.1 (high)OpenAI |
87.3%
|
| 96 | GPT-5.6 Terra (medium reasoning)OpenAI |
87.2%
|
| 97 | deepseek-v3.2-specialeDeepSeek |
87.1%
|
| 97 | GPT-5.4 (low reasoning)OpenAI |
87.1%
|
| 99 | GLM 5.1Z.ai |
86.8%
|
| 100 | deepseek-v4-flash-preview (high reasoning)DeepSeek |
86.7%
|
| 101 | Claude Opus 4.5 (thinking reasoning)Anthropic |
86.6%
|
| 102 | GPT-5.2 (medium reasoning)OpenAI |
86.4%
|
| 103 | Qwen3.5 397B A17B (no reasoning)Alibaba |
86.1%
|
| 103 | Qwen3 Max ThinkingAlibaba |
86.1%
|
| 105 | GPT-5.1-Codex (high)OpenAI |
86.0%
|
| 106 | GPT-5.6 Luna (medium reasoning)OpenAI |
85.9%
|
| 106 | GLM 4.7Z.ai |
85.9%
|
| 108 | Qwen3.5-27BAlibaba |
85.8%
|
| 109 | Qwen3.5-122B-A10BAlibaba |
85.7%
|
| 109 | Gemma 4 31BGoogle |
85.7%
|
| 111 | GPT-5 (high)OpenAI |
85.4%
|
| 112 | grok-4-1-fast-reasoningxAI |
85.3%
|
| 113 | grok-4-fast-reasoningxAI |
84.7%
|
| 113 | GLM 5 TurboZ.ai |
84.7%
|
| 115 | GPT-5.5 Instant (26 May)OpenAI |
84.6%
|
| 116 | Qwen3.5-35B-A3BAlibaba |
84.5%
|
| 116 | Qwen3.8 27B (low)Alibaba |
84.5%
|
| 116 | Qwen3.8 27B (medium)Alibaba |
84.5%
|
| 119 | GPT-5.6 Terra (low reasoning)OpenAI |
84.3%
|
| 119 | Grok 4.3 (low)xAI |
84.3%
|
| 121 | Qwen3.5-27B (no reasoning)Alibaba |
84.2%
|
| 121 | Qwen3.6 27BAlibaba |
84.2%
|
| 121 | Kimi K3 (low reasoning)Moonshot AI |
84.2%
|
| 121 | GPT-5 (medium)OpenAI |
84.2%
|
| 125 | Qwen3.6 35B A3BAlibaba |
84.1%
|
| 126 | Claude Opus 4.6 (off)Anthropic |
84.0%
|
| 126 | DeepSeek V3.2DeepSeek |
84.0%
|
| 128 | GLM 5.1 (no reasoning)Z.ai |
83.9%
|
| 129 | Gemini 3.5 Flash LiteGoogle |
83.8%
|
| 129 | Kimi K2 ThinkingMoonshot AI |
83.8%
|
| 131 | GPT-5-Codex (high)OpenAI |
83.7%
|
| 132 | muse-glimmer (high)Meta |
83.5%
|
| 132 | GPT-5.6 Luna (low reasoning)OpenAI |
83.5%
|
| 134 | Claude Sonnet 4.5 (thinking reasoning)Anthropic |
83.4%
|
| 135 | Qwen3.6 27B (no reasoning)Alibaba |
82.9%
|
| 136 | Gemini 3.5 Flash (minimal reasoning)Google |
82.8%
|
| 136 | GPT-5 Mini (high)OpenAI |
82.8%
|
| 138 | Qwen3.5-122B-A10B (no reasoning)Alibaba |
82.7%
|
| 139 | Qwen3.5 Omni PlusAlibaba |
82.6%
|
| 140 | GPT-5.4 Mini (medium)OpenAI |
82.3%
|
| 140 | GPT-5.5 Instant (26 June)OpenAI |
82.3%
|
| 142 | Gemini 3.1 Flash Lite PreviewGoogle |
82.2%
|
| 143 | GLM 5Z.ai |
82.0%
|
| 144 | Qwen3.5-35B-A3B (no reasoning)Alibaba |
81.9%
|
| 145 | Qwen3.8 27B (off)Alibaba |
81.8%
|
| 146 | Qwen3.6 35B A3B (no reasoning)Alibaba |
81.7%
|
| 146 | GPT-5.4 Nano (xhigh)OpenAI |
81.7%
|
| 148 | GPT-5.1-Codex-Mini (high)OpenAI |
81.3%
|
| 149 | gemini-3-flash (off)Google |
81.2%
|
| 150 | Claude Opus 4.5 (no reasoning)Anthropic |
81.0%
|
| 151 | Claude Opus 4.1 (thinking reasoning)Anthropic |
80.9%
|
| 151 | GLM 5V TurboZ.ai |
80.9%
|
| 153 | GPT-5 (low reasoning)OpenAI |
80.8%
|
| 154 | Qwen3.5-9BAlibaba |
80.6%
|
| 155 | GPT-5 Mini (medium)OpenAI |
80.3%
|
| 156 | Claude Sonnet 5 (off)Anthropic |
80.0%
|
| 157 | Claude Sonnet 4.6 (off)Anthropic |
79.9%
|
| 158 | DeepSeek V3.2 ExpDeepSeek |
79.7%
|
| 159 | gemini-2.5-flash-preview-09-2025 (thinking reasoning)Google |
79.3%
|
| 160 | DeepSeek V3.1 TerminusDeepSeek |
79.2%
|
| 160 | Gemma 4 26B A4BGoogle |
79.2%
|
| 162 | Qwen3 235B A22B Thinking 2507Alibaba |
79.0%
|
| 162 | GPT-5.6 Sol (no reasoning)OpenAI |
79.0%
|
| 164 | Kimi K2.5Moonshot AI |
78.9%
|
| 165 | Kimi K2.6 (no reasoning)Moonshot AI |
78.8%
|
| 166 | Qwen3.5-9B (no reasoning)Alibaba |
78.6%
|
| 167 | grok-4.20-0309-non-reasoning (no reasoning)xAI |
78.5%
|
| 168 | gpt-oss-120b (high)OpenAI |
78.2%
|
| 168 | GLM 4.5Z.ai |
78.2%
|
| 170 | GLM 4.6 (thinking reasoning)Z.ai |
78.0%
|
| 171 | DeepSeek V3.1DeepSeek |
77.9%
|
| 172 | Qwen3 Max Thinking (preview)Alibaba |
77.6%
|
| 172 | Grok 4.20 (off)xAI |
77.6%
|
| 174 | Qwen3 VL 235B A22B ThinkingAlibaba |
77.2%
|
| 175 | qwen3.5-4b (thinking reasoning)Alibaba |
77.1%
|
| 176 | Mistral Small 4Mistral |
76.9%
|
| 177 | GPT-5.5 (no reasoning)OpenAI |
76.8%
|
| 178 | Kimi K2 0905Moonshot AI |
76.7%
|
| 179 | gemini-2.5-flash-preview-09-2025 (no reasoning)Google |
76.6%
|
| 179 | Kimi K2 0711Moonshot AI |
76.6%
|
| 181 | qwen3-max-previewAlibaba |
76.4%
|
| 181 | Qwen3 MaxAlibaba |
76.4%
|
| 183 | Gemma 4 31B (off)Google |
76.3%
|
| 184 | GPT-5.4 Nano (medium)OpenAI |
76.1%
|
| 185 | Qwen3 Next 80B A3B ThinkingAlibaba |
75.9%
|
| 186 | Qwen3 235B A22B Instruct 2507Alibaba |
75.3%
|
| 186 | gemma-4-12b-itGoogle |
75.3%
|
| 188 | DeepSeek V3.1 Terminus (no reasoning)DeepSeek |
75.1%
|
| 188 | DeepSeek V3.2 (no reasoning)DeepSeek |
75.1%
|
| 190 | Mistral Medium 3.5Mistral |
74.8%
|
| 190 | GPT-5.4 (no reasoning)OpenAI |
74.8%
|
| 192 | GPT-5.6 Terra (no reasoning)OpenAI |
74.6%
|
| 193 | Qwen3.5 Omni FlashAlibaba |
74.2%
|
| 194 | Magistral Medium 1.2Mistral |
73.9%
|
| 195 | Qwen3 Next 80B A3B InstructAlibaba |
73.8%
|
| 195 | DeepSeek V3.2 Exp (no reasoning)DeepSeek |
73.8%
|
| 197 | Qwen3 Coder NextAlibaba |
73.7%
|
| 198 | DeepSeek V3.1 (no reasoning)DeepSeek |
73.5%
|
| 199 | qwen3-vl-32b-thinkingAlibaba |
73.3%
|
| 199 | GLM 4.5 AirZ.ai |
73.3%
|
| 201 | Claude Sonnet 4.5 (no reasoning)Anthropic |
72.7%
|
| 201 | Grok Code Fast 1xAI |
72.7%
|
| 203 | qwen3-omni-30b-a3b-thinkingAlibaba |
72.6%
|
| 204 | Qwen3 VL 30B A3B ThinkingAlibaba |
72.0%
|
| 205 | GLM 4.6V (thinking reasoning)Z.ai |
71.9%
|
| 206 | deepseek-v4-pro-preview (no reasoning)DeepSeek |
71.7%
|
| 207 | deepseek-v4-flash-preview (no reasoning)DeepSeek |
71.6%
|
| 208 | Gemma 4 26B A4B (off)Google |
71.4%
|
| 209 | qwen3.5-4b (no reasoning)Alibaba |
71.2%
|
| 209 | Qwen3 VL 235B A22B InstructAlibaba |
71.2%
|
| 209 | GPT-5.2 (no reasoning)OpenAI |
71.2%
|
| 212 | gemini-2.5-flash-lite-preview-09-2025 (thinking reasoning)Google |
70.9%
|
| 213 | Qwen3 30B A3B Thinking 2507Alibaba |
70.7%
|
| 214 | Qwen3 VL 30B A3B InstructAlibaba |
69.5%
|
| 215 | gpt-oss-20b (high reasoning)OpenAI |
68.8%
|
| 216 | GPT-5 Mini (minimal)OpenAI |
68.7%
|
| 217 | gpt-5-chatOpenAI |
68.6%
|
| 217 | GLM 5.2 (no reasoning)Z.ai |
68.6%
|
| 219 | GLM 4.5V (thinking reasoning)Z.ai |
68.4%
|
| 220 | Mistral Large 3 2512Mistral |
68.0%
|
| 221 | GPT-5 Nano (high)OpenAI |
67.6%
|
| 222 | GPT-5 (minimal reasoning)OpenAI |
67.3%
|
| 223 | Claude Haiku 4.5 (thinking reasoning)Anthropic |
67.2%
|
| 223 | gpt-oss-120b (low)OpenAI |
67.2%
|
| 225 | Qwen3 VL 32B InstructAlibaba |
67.1%
|
| 226 | GPT-5 Nano (medium)OpenAI |
67.0%
|
| 227 | DiffusionGemma 26B A4BGoogle |
66.9%
|
| 228 | qwen3-4b-thinking-2507Alibaba |
66.7%
|
| 229 | GLM 5 (no reasoning)Z.ai |
66.6%
|
| 230 | GLM 4.7 (no reasoning)Z.ai |
66.4%
|
| 231 | magistral-small-2509Mistral |
66.3%
|
| 232 | gemma-4-12b-it (no reasoning)Google |
66.1%
|
| 233 | Qwen3 30B A3B Instruct 2507Alibaba |
65.9%
|
| 234 | Grok 4.3 (off)xAI |
65.8%
|
| 235 | gemini-2.5-flash-lite-preview-09-2025 (no reasoning)Google |
65.1%
|
| 236 | Claude Haiku 4.5 (no reasoning)Anthropic |
64.6%
|
| 237 | GPT-5.6 Luna (no reasoning)OpenAI |
64.5%
|
| 238 | GPT-5.1 (off)OpenAI |
64.3%
|
| 239 | grok-4-1-fast-non-reasoning (no reasoning)xAI |
63.7%
|
| 240 | GLM 4.6 (no reasoning)Z.ai |
63.2%
|
| 241 | Qwen3 Omni 30B A3B InstructAlibaba |
62.0%
|
| 242 | Qwen3 Coder 480B A35BAlibaba |
61.8%
|
| 243 | gpt-oss-20b (low reasoning)OpenAI |
61.1%
|
| 244 | GPT-5.4 Mini (no reasoning)OpenAI |
60.6%
|
| 244 | grok-4-fast-non-reasoning (no reasoning)xAI |
60.6%
|
| 246 | Devstral 2 2512Mistral |
59.4%
|
| 247 | Mistral Medium 3.1Mistral |
58.8%
|
| 248 | GLM 4.7 FlashZ.ai |
58.1%
|
| 249 | Qwen3 VL 8B ThinkingAlibaba |
57.9%
|
| 250 | gemma-4-e4b-itGoogle |
57.6%
|
| 251 | GLM 4.5V (off)Z.ai |
57.3%
|
| 252 | Ministral 3 14B 2512Mistral |
57.2%
|
| 253 | Mistral Small 4 (no reasoning)Mistral |
57.1%
|
| 254 | GLM 4.6V (no reasoning)Z.ai |
56.6%
|
| 255 | GPT-5.4 Nano (no reasoning)OpenAI |
55.8%
|
| 256 | gemma-4-e4b-it (no reasoning)Google |
54.9%
|
| 257 | devstral-small-2-24b-instruct-2512Mistral |
53.2%
|
| 258 | qwen3-4b-instruct-2507Alibaba |
51.7%
|
| 259 | Qwen3 Coder 30B A3B InstructAlibaba |
51.6%
|
| 260 | qwen3-vl-4b-thinkingAlibaba |
49.4%
|
| 261 | Devstral MediumMistral |
49.2%
|
| 262 | Ministral 3 8B 2512Mistral |
47.1%
|
| 263 | qwen3.5-2b (thinking reasoning)Alibaba |
45.6%
|
| 264 | GLM 4.7 Flash (no reasoning)Z.ai |
45.2%
|
| 265 | qwen3.5-2b (no reasoning)Alibaba |
43.8%
|
| 266 | gemma-4-e2b-itGoogle |
43.3%
|
| 267 | GPT-5 Nano (minimal)OpenAI |
42.8%
|
| 268 | Qwen3 VL 8B InstructAlibaba |
42.7%
|
| 269 | Devstral Small 1.1Mistral |
41.4%
|
| 270 | kimi-linear-48b-a3b-instructMoonshot AI |
41.2%
|
| 271 | gemma-4-e2b-it (no reasoning)Google |
40.5%
|
| 272 | qwen3-vl-4b-instructAlibaba |
37.1%
|
| 273 | Ministral 3 3B 2512Mistral |
35.8%
|
| 274 | qwen3.5-0.8b (no reasoning)Alibaba |
23.6%
|
| 275 | Gemma 3 270MGoogle |
22.4%
|
| 276 | qwen3.5-0.8b (thinking reasoning)Alibaba |
11.1%
|
Results as published by Artificial Analysis; we do not re-run them.
What it measures
Share of graduate-level science questions answered correctly, as run by Artificial Analysis with its own harness and prompts.
What it does not measure
Not applied work; multiple-choice science questions.
Source
Failures
Failures count against a model: a product with no usable output is a failed listing. They are listed here so you can see why.
Not ranked
- Command A: creator outside the providers the catalogue covers
- GPT-4 Turbo: released before 2025-07-01
- GPT-4o (2024-05-13): released before 2025-07-01
- GPT-4o (2024-08-06): released before 2025-07-01
- Hy3: creator outside the providers the catalogue covers
- Hy3 preview: creator outside the providers the catalogue covers
- Inkling: creator outside the providers the catalogue covers
- Inkling Small: creator outside the providers the catalogue covers
- Llama 4 Maverick: released before 2025-07-01
- Llama 4 Scout: released before 2025-07-01
- Mercury 2: creator outside the providers the catalogue covers
- MiniMax M2: creator outside the providers the catalogue covers
- MiniMax M3: creator outside the providers the catalogue covers
- Mistral Large 2407: released before 2025-07-01
- Mistral Medium 3: released before 2025-07-01
- Phi 4: creator outside the providers the catalogue covers
- QwQ-32B-Preview: released before 2025-07-01
- R1: released before 2025-07-01
- Reka Flash 3: creator outside the providers the catalogue covers
- Solar Pro 3: creator outside the providers the catalogue covers
- Solar Pro 4: creator outside the providers the catalogue covers
- Trinity Large Thinking: creator outside the providers the catalogue covers
- a-x-k2: creator outside the providers the catalogue covers
- apertus-70b-instruct: creator outside the providers the catalogue covers
- apertus-8b-instruct: creator outside the providers the catalogue covers
- apodex-1-1: creator outside the providers the catalogue covers
- apriel-v1-5-15b-thinker: creator outside the providers the catalogue covers
- apriel-v1-6-15b-thinker: creator outside the providers the catalogue covers
- arctic-instruct: creator outside the providers the catalogue covers
- celeris-1: creator outside the providers the catalogue covers
- claude-2: released before 2025-07-01
- claude-21: released before 2025-07-01
- claude-3-5-haiku: released before 2025-07-01
- claude-3-7-sonnet: released before 2025-07-01
- claude-3-7-sonnet-thinking: released before 2025-07-01
- claude-3-haiku: released before 2025-07-01
- claude-3-opus: released before 2025-07-01
- claude-3-sonnet: released before 2025-07-01
- claude-35-sonnet: released before 2025-07-01
- claude-35-sonnet-june-24: released before 2025-07-01
- claude-4-opus: released before 2025-07-01
- claude-4-opus-thinking: released before 2025-07-01
- claude-4-sonnet: released before 2025-07-01
- claude-4-sonnet-thinking: released before 2025-07-01
- claude-instant: released before 2025-07-01
- claude-sonnet-4-6-non-reasoning-low-effort: non-standard setting combination
- cogito-v2-1-reasoning: creator outside the providers the catalogue covers
- command-a-plus: creator outside the providers the catalogue covers
- command-r-03-2024: creator outside the providers the catalogue covers
- command-r-plus-04-2024: creator outside the providers the catalogue covers
- dbrx: creator outside the providers the catalogue covers
- deephermes-3-llama-3-1-8b-preview: creator outside the providers the catalogue covers
- deephermes-3-mistral-24b-preview: creator outside the providers the catalogue covers
- deepseek-coder-v2: released before 2025-07-01
- deepseek-coder-v2-lite: released before 2025-07-01
- deepseek-llm-67b-chat: released before 2025-07-01
- deepseek-r1-0120: released before 2025-07-01
- deepseek-r1-distill-llama-70b: released before 2025-07-01
- deepseek-r1-distill-llama-8b: released before 2025-07-01
- deepseek-r1-distill-qwen-1-5b: released before 2025-07-01
- deepseek-r1-distill-qwen-14b: released before 2025-07-01
- deepseek-r1-distill-qwen-32b: released before 2025-07-01
- deepseek-r1-qwen3-8b: released before 2025-07-01
- deepseek-v2: released before 2025-07-01
- deepseek-v2-5: released before 2025-07-01
- deepseek-v2-5-sep-2024: released before 2025-07-01
- deepseek-v3: released before 2025-07-01
- deepseek-v3-0324: released before 2025-07-01
- devstral-small-2505: released before 2025-07-01
- doubao-seed-code: creator outside the providers the catalogue covers
- ernie-4-5-300b-a47b: creator outside the providers the catalogue covers
- ernie-5-0-thinking-preview: creator outside the providers the catalogue covers
- exaone-4-0-1-2b: creator outside the providers the catalogue covers
- exaone-4-0-1-2b-reasoning: creator outside the providers the catalogue covers
- exaone-4-0-32b: creator outside the providers the catalogue covers
- exaone-4-0-32b-reasoning: creator outside the providers the catalogue covers
- exaone-4-5-33b: creator outside the providers the catalogue covers
- falcon-h1r-7b: creator outside the providers the catalogue covers
- g9v3-39a5b: creator outside the providers the catalogue covers
- g9v3-3b: creator outside the providers the catalogue covers
- gemini-1-0-pro: released before 2025-07-01
- gemini-1-0-ultra: released before 2025-07-01
- gemini-1-5-flash: released before 2025-07-01
- gemini-1-5-flash-8b: released before 2025-07-01
- gemini-1-5-flash-may-2024: released before 2025-07-01
- gemini-1-5-pro: released before 2025-07-01
- gemini-1-5-pro-may-2024: released before 2025-07-01
- gemini-2-0-flash: released before 2025-07-01
- gemini-2-0-flash-experimental: released before 2025-07-01
- gemini-2-0-flash-lite-001: released before 2025-07-01
- gemini-2-0-flash-lite-preview: released before 2025-07-01
- gemini-2-0-flash-thinking-exp-0121: released before 2025-07-01
- gemini-2-0-flash-thinking-exp-1219: released before 2025-07-01
- gemini-2-0-pro-experimental-02-05: released before 2025-07-01
- gemini-2-5-flash: released before 2025-07-01
- gemini-2-5-flash-04-2025: released before 2025-07-01
- gemini-2-5-flash-lite: released before 2025-07-01
- gemini-2-5-flash-lite-reasoning: released before 2025-07-01
- gemini-2-5-flash-reasoning: released before 2025-07-01
- gemini-2-5-flash-reasoning-04-2025: released before 2025-07-01
- gemini-2-5-pro: released before 2025-07-01
- gemini-2-5-pro-03-25: released before 2025-07-01
- gemini-2-5-pro-05-06: released before 2025-07-01
- gemma-3-12b: released before 2025-07-01
- gemma-3-1b: released before 2025-07-01
- gemma-3-27b: released before 2025-07-01
- gemma-3-4b: released before 2025-07-01
- gemma-3n-e2b: released before 2025-07-01
- gemma-3n-e4b: released before 2025-07-01
- gemma-3n-e4b-preview-0520: released before 2025-07-01
- gpt-35-turbo: released before 2025-07-01
- gpt-4: released before 2025-07-01
- gpt-4-1: released before 2025-07-01
- gpt-4-1-mini: released before 2025-07-01
- gpt-4-1-nano: released before 2025-07-01
- gpt-4-5: released before 2025-07-01
- gpt-4o: released before 2025-07-01
- gpt-4o-chatgpt: released before 2025-07-01
- gpt-4o-chatgpt-03-25: released before 2025-07-01
- gpt-4o-mini: released before 2025-07-01
- granite-3-3-8b-instruct: creator outside the providers the catalogue covers
- granite-4-0-350m: creator outside the providers the catalogue covers
- granite-4-0-h-350m: creator outside the providers the catalogue covers
- granite-4-0-h-nano-1b: creator outside the providers the catalogue covers
- granite-4-0-h-small: creator outside the providers the catalogue covers
- granite-4-0-micro: creator outside the providers the catalogue covers
- granite-4-0-nano-1b: creator outside the providers the catalogue covers
- granite-4-1-30b: creator outside the providers the catalogue covers
- granite-4-1-3b: creator outside the providers the catalogue covers
- granite-4-1-8b: creator outside the providers the catalogue covers
- granite-4-2-30b: creator outside the providers the catalogue covers
- granite-4-2-3b: creator outside the providers the catalogue covers
- granite-4-2-8b: creator outside the providers the catalogue covers
- grok-1: released before 2025-07-01
- grok-2-1212: released before 2025-07-01
- grok-3: released before 2025-07-01
- grok-3-mini-reasoning: released before 2025-07-01
- grok-3-reasoning: released before 2025-07-01
- grok-beta: released before 2025-07-01
- hermes-3-llama-3-1-70b: creator outside the providers the catalogue covers
- hermes-4-llama-3-1-405b: creator outside the providers the catalogue covers
- hermes-4-llama-3-1-405b-reasoning: creator outside the providers the catalogue covers
- hermes-4-llama-3-1-70b: creator outside the providers the catalogue covers
- hermes-4-llama-3-1-70b-reasoning: creator outside the providers the catalogue covers
- hy3-non-reasoning: creator outside the providers the catalogue covers
- hyperclova-x-seed-think-32b: creator outside the providers the catalogue covers
- hypernova-60b: creator outside the providers the catalogue covers
- intellect-3: creator outside the providers the catalogue covers
- jamba-1-5-large: creator outside the providers the catalogue covers
- jamba-1-5-mini: creator outside the providers the catalogue covers
- jamba-1-6-large: creator outside the providers the catalogue covers
- jamba-1-6-mini: creator outside the providers the catalogue covers
- jamba-1-7-large: creator outside the providers the catalogue covers
- jamba-1-7-mini: creator outside the providers the catalogue covers
- jamba-reasoning-3b: creator outside the providers the catalogue covers
- jt-35b-flash: creator outside the providers the catalogue covers
- jt-4-1-flash-236b-a21b: creator outside the providers the catalogue covers
- jt-mini: creator outside the providers the catalogue covers
- jt236b: creator outside the providers the catalogue covers
- k-exaone: creator outside the providers the catalogue covers
- k-exaone-2-0-0803: creator outside the providers the catalogue covers
- k-exaone-non-reasoning: creator outside the providers the catalogue covers
- k2-horizon-0-9b: creator outside the providers the catalogue covers
- k2-horizon-3-7b: creator outside the providers the catalogue covers
- k2-horizon-375b-a23b: creator outside the providers the catalogue covers
- k2-horizon-7b: creator outside the providers the catalogue covers
- k2-horizon-mova-36b-a4b: creator outside the providers the catalogue covers
- k2-think-v2: creator outside the providers the catalogue covers
- k2-v2: creator outside the providers the catalogue covers
- k2-v2-low: creator outside the providers the catalogue covers
- k2-v2-medium: creator outside the providers the catalogue covers
- kat-coder-pro-v1: creator outside the providers the catalogue covers
- kat-coder-pro-v2: creator outside the providers the catalogue covers
- lfm-40b: creator outside the providers the catalogue covers
- lfm2-1-2b: creator outside the providers the catalogue covers
- lfm2-2-6b: creator outside the providers the catalogue covers
- lfm2-24b-a2b: creator outside the providers the catalogue covers
- lfm2-5-1-2b-instruct: creator outside the providers the catalogue covers
- lfm2-5-1-2b-thinking: creator outside the providers the catalogue covers
- lfm2-5-2-6b: creator outside the providers the catalogue covers
- lfm2-5-8b-a1b: creator outside the providers the catalogue covers
- lfm2-5-vl-1-6b: creator outside the providers the catalogue covers
- lfm2-8b-a1b: creator outside the providers the catalogue covers
- ling-1t: creator outside the providers the catalogue covers
- ling-2-6-1t: creator outside the providers the catalogue covers
- ling-2-6-flash: creator outside the providers the catalogue covers
- ling-3-0-flash: creator outside the providers the catalogue covers
- ling-3-0-flash-fin: creator outside the providers the catalogue covers
- ling-3-0-flash-vl: creator outside the providers the catalogue covers
- ling-3-0-tiny: creator outside the providers the catalogue covers
- ling-flash-2-0: creator outside the providers the catalogue covers
- ling-mini-2-0: creator outside the providers the catalogue covers
- llama-2-chat-13b: released before 2025-07-01
- llama-2-chat-70b: released before 2025-07-01
- llama-2-chat-7b: released before 2025-07-01
- llama-3-1-instruct-405b: released before 2025-07-01
- llama-3-1-instruct-70b: released before 2025-07-01
- llama-3-1-instruct-8b: released before 2025-07-01
- llama-3-1-nemotron-instruct-70b: creator outside the providers the catalogue covers
- llama-3-1-nemotron-nano-4b-reasoning: creator outside the providers the catalogue covers
- llama-3-1-nemotron-ultra-253b-v1-reasoning: creator outside the providers the catalogue covers
- llama-3-2-instruct-11b-vision: released before 2025-07-01
- llama-3-2-instruct-1b: released before 2025-07-01
- llama-3-2-instruct-3b: released before 2025-07-01
- llama-3-2-instruct-90b-vision: released before 2025-07-01
- llama-3-3-instruct-70b: released before 2025-07-01
- llama-3-3-nemotron-super-49b: creator outside the providers the catalogue covers
- llama-3-3-nemotron-super-49b-reasoning: creator outside the providers the catalogue covers
- llama-3-instruct-70b: released before 2025-07-01
- llama-3-instruct-8b: released before 2025-07-01
- llama-65b: released before 2025-07-01
- llama-nemotron-super-49b-v1-5: creator outside the providers the catalogue covers
- llama-nemotron-super-49b-v1-5-reasoning: creator outside the providers the catalogue covers
- longcat-2-0: creator outside the providers the catalogue covers
- longcat-flash-lite: creator outside the providers the catalogue covers
- magistral-medium: released before 2025-07-01
- magistral-small: released before 2025-07-01
- mercury-2-5: creator outside the providers the catalogue covers
- mi-dm-k-2-5-pro-dec28: creator outside the providers the catalogue covers
- midm-250-pro-rsnsft: creator outside the providers the catalogue covers
- mimo-v2-0206: creator outside the providers the catalogue covers
- mimo-v2-5-0424: creator outside the providers the catalogue covers
- mimo-v2-5-pro: creator outside the providers the catalogue covers
- mimo-v2-5-pro-non-reasoning: creator outside the providers the catalogue covers
- mimo-v2-6-flash: creator outside the providers the catalogue covers
- mimo-v2-6-pro: creator outside the providers the catalogue covers
- mimo-v2-flash: creator outside the providers the catalogue covers
- mimo-v2-flash-reasoning: creator outside the providers the catalogue covers
- mimo-v2-omni: creator outside the providers the catalogue covers
- mimo-v2-omni-0327: creator outside the providers the catalogue covers
- mimo-v2-pro: creator outside the providers the catalogue covers
- minicpm-v4-6-1-3b: creator outside the providers the catalogue covers
- minicpm5-1b: creator outside the providers the catalogue covers
- minicpm5-1b-non-reasoning: creator outside the providers the catalogue covers
- minicpm5-2b: creator outside the providers the catalogue covers
- minimax-m1-40k: creator outside the providers the catalogue covers
- minimax-m1-80k: creator outside the providers the catalogue covers
- minimax-m2-1: creator outside the providers the catalogue covers
- minimax-m2-5: creator outside the providers the catalogue covers
- minimax-m2-7: creator outside the providers the catalogue covers
- mistral-7b-instruct: released before 2025-07-01
- mistral-8x22b-instruct: released before 2025-07-01
- mistral-large: released before 2025-07-01
- mistral-large-2: released before 2025-07-01
- mistral-medium: released before 2025-07-01
- mistral-saba: released before 2025-07-01
- mistral-small: released before 2025-07-01
- mistral-small-2402: released before 2025-07-01
- mistral-small-3: released before 2025-07-01
- mistral-small-3-1: released before 2025-07-01
- mistral-small-3-2: released before 2025-07-01
- mixtral-8x7b-instruct: released before 2025-07-01
- molmo-7b-d: creator outside the providers the catalogue covers
- molmo2-8b: creator outside the providers the catalogue covers
- motif-0714: creator outside the providers the catalogue covers
- motif-2-12-7b: creator outside the providers the catalogue covers
- motif-3: creator outside the providers the catalogue covers
- nanbeige4-1-3b: creator outside the providers the catalogue covers
- nemotron-3-5-lightning: creator outside the providers the catalogue covers
- nemotron-3-nano-omni-30b-a3b: creator outside the providers the catalogue covers
- nemotron-cascade-2-30b-a3b: creator outside the providers the catalogue covers
- nex-n2-pro: creator outside the providers the catalogue covers
- north-mini-code: creator outside the providers the catalogue covers
- nova-2-0-lite: creator outside the providers the catalogue covers
- nova-2-0-lite-reasoning: creator outside the providers the catalogue covers
- nova-2-0-lite-reasoning-low: creator outside the providers the catalogue covers
- nova-2-0-lite-reasoning-medium: creator outside the providers the catalogue covers
- nova-2-0-omni: creator outside the providers the catalogue covers
- nova-2-0-omni-reasoning-low: creator outside the providers the catalogue covers
- nova-2-0-omni-reasoning-medium: creator outside the providers the catalogue covers
- nova-2-0-pro: creator outside the providers the catalogue covers
- nova-2-0-pro-reasoning-low: creator outside the providers the catalogue covers
- nova-2-0-pro-reasoning-medium: creator outside the providers the catalogue covers
- nova-lite: creator outside the providers the catalogue covers
- nova-micro: creator outside the providers the catalogue covers
- nova-premier: creator outside the providers the catalogue covers
- nova-pro: creator outside the providers the catalogue covers
- nvidia-nemotron-3-nano-30b-a3b: creator outside the providers the catalogue covers
- nvidia-nemotron-3-nano-30b-a3b-reasoning: creator outside the providers the catalogue covers
- nvidia-nemotron-3-nano-4b: creator outside the providers the catalogue covers
- nvidia-nemotron-3-super-120b-a12b: creator outside the providers the catalogue covers
- nvidia-nemotron-3-ultra-550b-a55b: creator outside the providers the catalogue covers
- nvidia-nemotron-nano-12b-v2-vl: creator outside the providers the catalogue covers
- nvidia-nemotron-nano-12b-v2-vl-reasoning: creator outside the providers the catalogue covers
- nvidia-nemotron-nano-9b-v2: creator outside the providers the catalogue covers
- nvidia-nemotron-nano-9b-v2-reasoning: creator outside the providers the catalogue covers
- o1: released before 2025-07-01
- o1-mini: released before 2025-07-01
- o1-preview: released before 2025-07-01
- o1-pro: released before 2025-07-01
- o3: released before 2025-07-01
- o3 Mini: released before 2025-07-01
- o3 Mini High: released before 2025-07-01
- o3 Pro: released before 2025-07-01
- o4 Mini: released before 2025-07-01
- olmo-2-32b: creator outside the providers the catalogue covers
- olmo-2-7b: creator outside the providers the catalogue covers
- olmo-3-1-32b-instruct: creator outside the providers the catalogue covers
- olmo-3-1-32b-think: creator outside the providers the catalogue covers
- olmo-3-32b-think: creator outside the providers the catalogue covers
- olmo-3-7b-instruct: creator outside the providers the catalogue covers
- olmo-3-7b-think: creator outside the providers the catalogue covers
- openchat-35: creator outside the providers the catalogue covers
- palm-2: released before 2025-07-01
- phi-3-mini: creator outside the providers the catalogue covers
- phi-4-mini: creator outside the providers the catalogue covers
- phi-4-multimodal: creator outside the providers the catalogue covers
- pixtral-large-2411: released before 2025-07-01
- quasar-438b: creator outside the providers the catalogue covers
- qwen-2-5-max: released before 2025-07-01
- qwen-chat-14b: released before 2025-07-01
- qwen-chat-72b: released before 2025-07-01
- qwen-turbo: released before 2025-07-01
- qwen1.5-110b-chat: released before 2025-07-01
- qwen2-5-72b-instruct: released before 2025-07-01
- qwen2-5-coder-32b-instruct: released before 2025-07-01
- qwen2-5-coder-7b-instruct: released before 2025-07-01
- qwen2-72b-instruct: released before 2025-07-01
- qwen2.5-32b-instruct: released before 2025-07-01
- qwen3-0.6b-instruct: released before 2025-07-01
- qwen3-0.6b-instruct-reasoning: released before 2025-07-01
- qwen3-1.7b-instruct: released before 2025-07-01
- qwen3-1.7b-instruct-reasoning: released before 2025-07-01
- qwen3-14b-instruct: released before 2025-07-01
- qwen3-14b-instruct-reasoning: released before 2025-07-01
- qwen3-235b-a22b-instruct: released before 2025-07-01
- qwen3-235b-a22b-instruct-reasoning: released before 2025-07-01
- qwen3-30b-a3b-instruct: released before 2025-07-01
- qwen3-30b-a3b-instruct-reasoning: released before 2025-07-01
- qwen3-32b-instruct: released before 2025-07-01
- qwen3-32b-instruct-reasoning: released before 2025-07-01
- qwen3-4b-instruct: released before 2025-07-01
- qwen3-4b-instruct-reasoning: released before 2025-07-01
- qwen3-8b-instruct: released before 2025-07-01
- qwen3-8b-instruct-reasoning: released before 2025-07-01
- qwq-32b: released before 2025-07-01
- r1-1776: creator outside the providers the catalogue covers
- reka-flash: creator outside the providers the catalogue covers
- ring-1t: creator outside the providers the catalogue covers
- ring-2-6-1t: creator outside the providers the catalogue covers
- ring-flash-2-0: creator outside the providers the catalogue covers
- sarvam-105b: creator outside the providers the catalogue covers
- sarvam-30b: creator outside the providers the catalogue covers
- sarvam-m-reasoning: creator outside the providers the catalogue covers
- seed-oss-36b-instruct: creator outside the providers the catalogue covers
- solar-mini: creator outside the providers the catalogue covers
- solar-mini4: creator outside the providers the catalogue covers
- solar-open-100b-reasoning: creator outside the providers the catalogue covers
- solar-open2-250b: creator outside the providers the catalogue covers
- solar-pro-2: creator outside the providers the catalogue covers
- solar-pro-2-preview: creator outside the providers the catalogue covers
- solar-pro-2-preview-reasoning: creator outside the providers the catalogue covers
- solar-pro-2-reasoning: creator outside the providers the catalogue covers
- sonar: creator outside the providers the catalogue covers
- sonar-pro: creator outside the providers the catalogue covers
- sonar-reasoning: creator outside the providers the catalogue covers
- sonar-reasoning-pro: creator outside the providers the catalogue covers
- step-3-5-flash: creator outside the providers the catalogue covers
- step-3-5-flash-0202: creator outside the providers the catalogue covers
- step-3-7-flash: creator outside the providers the catalogue covers
- step-3-vl-10b: creator outside the providers the catalogue covers
- step-5: creator outside the providers the catalogue covers
- tiny-aya-global: creator outside the providers the catalogue covers
- tri-21b-think-preview: creator outside the providers the catalogue covers
- tri-21b-think-v0-5: creator outside the providers the catalogue covers
- tulu3-405b: creator outside the providers the catalogue covers
Data sourced from Artificial Analysis. Licence: Artificial Analysis commercial data licence.