Benchmarks / Artificial Analysis
Reported by Artificial Analysis
Artificial Analysis
Share of the hardest Terminal-Bench tasks completed, as run by Artificial Analysis with its own harness and prompts.
- Results dated
- 1 Oct 2026
- Models
- 213
- Unit
- % of tasks
Full results
| # | Model | Artificial Analysis: Terminal-Bench Hard % of tasks, higher is better |
|---|---|---|
| 1 | GPT-5.6 Sol (max)OpenAI |
65.9%
|
| 2 | Claude Fable 5 (max reasoning)Anthropic |
62.9%
|
| 2 | GPT-5.6 Sol (medium reasoning)OpenAI |
62.9%
|
| 2 | GPT-5.6 Terra (xhigh)OpenAI |
62.9%
|
| 5 | GPT-5.6 Sol (high reasoning)OpenAI |
62.1%
|
| 6 | GPT-5.6 Sol (xhigh)OpenAI |
61.4%
|
| 7 | GPT-5.5 (xhigh reasoning)OpenAI |
60.6%
|
| 7 | GPT-5.6 Sol (low reasoning)OpenAI |
60.6%
|
| 9 | GPT-5.5 (high)OpenAI |
59.8%
|
| 10 | Claude Opus 4.8 (max reasoning)Anthropic |
58.3%
|
| 11 | GPT-5.4 (xhigh reasoning)OpenAI |
57.6%
|
| 11 | GPT-5.5 (medium reasoning)OpenAI |
57.6%
|
| 11 | GPT-5.6 Terra (high reasoning)OpenAI |
57.6%
|
| 11 | GPT-5.6 Terra (max)OpenAI |
57.6%
|
| 15 | Claude Opus 4.7 (off)Anthropic |
54.5%
|
| 16 | Gemini 3.1 Pro PreviewGoogle |
53.8%
|
| 17 | Claude Sonnet 4.6 (max reasoning)Anthropic |
53.0%
|
| 17 | GPT-5.3-Codex (xhigh)OpenAI |
53.0%
|
| 19 | GPT-5.4 Mini (xhigh)OpenAI |
52.3%
|
| 19 | GPT-5.5 (low reasoning)OpenAI |
52.3%
|
| 21 | Claude Opus 4.7 (max reasoning)Anthropic |
51.5%
|
| 22 | Qwen3.7 MaxAlibaba |
50.8%
|
| 22 | GLM 5.2 (max)Z.ai |
50.8%
|
| 24 | GPT-5.5 (no reasoning)OpenAI |
49.2%
|
| 25 | Claude Opus 4.6 (off)Anthropic |
48.5%
|
| 26 | Qwen3.7 PlusAlibaba |
47.0%
|
| 26 | Claude Opus 4.5 (thinking reasoning)Anthropic |
47.0%
|
| 26 | GPT-5.2 (xhigh)OpenAI |
47.0%
|
| 29 | Claude Opus 4.6 (max reasoning)Anthropic |
46.2%
|
| 29 | Claude Sonnet 4.6 (off)Anthropic |
46.2%
|
| 29 | deepseek-v4-pro-preview (max reasoning)DeepSeek |
46.2%
|
| 29 | Gemini 3.5 Flash (minimal reasoning)Google |
46.2%
|
| 33 | muse-sparkMeta |
45.5%
|
| 33 | GPT-5.1 (high)OpenAI |
45.5%
|
| 35 | Kimi K2.7 CodeMoonshot AI |
44.7%
|
| 36 | Qwen3.6 Max PreviewAlibaba |
43.9%
|
| 36 | Qwen3.6 PlusAlibaba |
43.9%
|
| 36 | Kimi K2.6Moonshot AI |
43.9%
|
| 36 | GPT-5.6 Terra (low reasoning)OpenAI |
43.9%
|
| 40 | GPT-5.2 (medium reasoning)OpenAI |
43.2%
|
| 40 | GPT-5.4 (low reasoning)OpenAI |
43.2%
|
| 40 | GLM 5.1Z.ai |
43.2%
|
| 40 | GLM 5Z.ai |
43.2%
|
| 44 | GPT-5.4 Nano (xhigh)OpenAI |
42.4%
|
| 44 | GPT-5.5 Instant (26 May)OpenAI |
42.4%
|
| 46 | deepseek-v4-pro-preview (high reasoning)DeepSeek |
41.7%
|
| 46 | gemini-3-pro (high)Google |
41.7%
|
| 48 | Qwen3.5 397B A17BAlibaba |
40.9%
|
| 48 | Claude Opus 4.5 (no reasoning)Anthropic |
40.9%
|
| 48 | Gemini 3.5 Flash (high)Google |
40.9%
|
| 48 | grok-4.20-0309-reasoningxAI |
40.9%
|
| 52 | Gemini 3.5 Flash (medium)Google |
39.4%
|
| 52 | GLM 5 (no reasoning)Z.ai |
39.4%
|
| 54 | deepseek-v4-flash-preview (high reasoning)DeepSeek |
38.6%
|
| 54 | gemini-3-flash (thinking reasoning)Google |
38.6%
|
| 56 | Kimi K2.6 (no reasoning)Moonshot AI |
37.9%
|
| 56 | GPT-5.4 (no reasoning)OpenAI |
37.9%
|
| 56 | GPT-5-Codex (high)OpenAI |
37.9%
|
| 56 | GPT-5 (medium)OpenAI |
37.9%
|
| 56 | Grok 4.20xAI |
37.9%
|
| 56 | Grok 4.3 (high)xAI |
37.9%
|
| 56 | grok-4xAI |
37.9%
|
| 63 | GPT-5.2-Codex (xhigh)OpenAI |
37.1%
|
| 64 | deepseek-v4-pro-preview (no reasoning)DeepSeek |
36.4%
|
| 64 | Gemma 4 31BGoogle |
36.4%
|
| 66 | Qwen3.5 397B A17B (no reasoning)Alibaba |
35.6%
|
| 66 | Claude Sonnet 4.5 (thinking reasoning)Anthropic |
35.6%
|
| 66 | DeepSeek V3.2DeepSeek |
35.6%
|
| 66 | deepseek-v4-flash-preview (max reasoning)DeepSeek |
35.6%
|
| 66 | GLM 5.1 (no reasoning)Z.ai |
35.6%
|
| 71 | Qwen3.6 27BAlibaba |
34.8%
|
| 71 | Qwen3.6 35B A3BAlibaba |
34.8%
|
| 71 | deepseek-v3.2-specialeDeepSeek |
34.8%
|
| 71 | Kimi K2.5Moonshot AI |
34.8%
|
| 71 | GPT-5.1-Codex (high)OpenAI |
34.8%
|
| 76 | Claude Opus 4.1 (thinking reasoning)Anthropic |
34.3%
|
| 77 | deepseek-v4-flash-preview (no reasoning)DeepSeek |
34.1%
|
| 77 | gemini-3-pro (low)Google |
34.1%
|
| 77 | GPT-5.4 Mini (medium)OpenAI |
34.1%
|
| 80 | Mistral Medium 3.5Mistral |
33.3%
|
| 80 | GPT-5.1-Codex-Mini (high)OpenAI |
33.3%
|
| 80 | GPT-5.4 Nano (medium)OpenAI |
33.3%
|
| 80 | GPT-5 Mini (high)OpenAI |
33.3%
|
| 80 | GLM 5 TurboZ.ai |
33.3%
|
| 85 | Qwen3.5-27BAlibaba |
32.6%
|
| 85 | DeepSeek V3.2 (no reasoning)DeepSeek |
32.6%
|
| 85 | GPT-5 (high)OpenAI |
32.6%
|
| 85 | GLM 5V TurboZ.ai |
32.6%
|
| 89 | Qwen3.5-27B (no reasoning)Alibaba |
31.8%
|
| 89 | DeepSeek V3.1 Terminus (no reasoning)DeepSeek |
31.8%
|
| 89 | gemini-3-flash (off)Google |
31.8%
|
| 89 | GPT-5.2 (no reasoning)OpenAI |
31.8%
|
| 89 | GLM 4.7Z.ai |
31.8%
|
| 94 | Qwen3.5-122B-A10BAlibaba |
31.1%
|
| 94 | DeepSeek V3.2 ExpDeepSeek |
31.1%
|
| 94 | Kimi K2 ThinkingMoonshot AI |
31.1%
|
| 97 | DeepSeek V3.1 TerminusDeepSeek |
30.3%
|
| 97 | Gemma 4 31B (off)Google |
30.3%
|
| 97 | Grok 4.3 (medium)xAI |
30.3%
|
| 97 | GLM 4.7 (no reasoning)Z.ai |
30.3%
|
| 101 | Qwen3.5-122B-A10B (no reasoning)Alibaba |
29.5%
|
| 102 | Claude Sonnet 4.5 (no reasoning)Anthropic |
28.8%
|
| 102 | GPT-5 Mini (medium)OpenAI |
28.8%
|
| 102 | GLM 4.6 (no reasoning)Z.ai |
28.8%
|
| 105 | Claude Haiku 4.5 (no reasoning)Anthropic |
27.3%
|
| 105 | Claude Haiku 4.5 (thinking reasoning)Anthropic |
27.3%
|
| 107 | Qwen3.5-35B-A3BAlibaba |
26.5%
|
| 107 | GPT-5 (low reasoning)OpenAI |
26.5%
|
| 107 | Grok 4.3 (low)xAI |
26.5%
|
| 110 | Qwen3.6 35B A3B (no reasoning)Alibaba |
25.8%
|
| 111 | DeepSeek V3.1DeepSeek |
25.0%
|
| 111 | DeepSeek V3.2 Exp (no reasoning)DeepSeek |
25.0%
|
| 111 | Gemma 4 26B A4B (off)Google |
25.0%
|
| 111 | GLM 4.6 (thinking reasoning)Z.ai |
25.0%
|
| 115 | Qwen3.5-9BAlibaba |
24.2%
|
| 115 | Qwen3 Max ThinkingAlibaba |
24.2%
|
| 115 | DeepSeek V3.1 (no reasoning)DeepSeek |
24.2%
|
| 115 | Gemini 3.1 Flash Lite PreviewGoogle |
24.2%
|
| 115 | GPT-5.4 Nano (no reasoning)OpenAI |
24.2%
|
| 115 | grok-4-1-fast-reasoningxAI |
24.2%
|
| 121 | Kimi K2 0905Moonshot AI |
23.5%
|
| 121 | gpt-oss-120b (high)OpenAI |
23.5%
|
| 123 | GPT-5.1 (off)OpenAI |
22.7%
|
| 124 | grok-4.20-0309-non-reasoning (no reasoning)xAI |
22.0%
|
| 124 | GLM 4.5Z.ai |
22.0%
|
| 124 | GLM 4.7 FlashZ.ai |
22.0%
|
| 127 | Qwen3.5 Omni PlusAlibaba |
21.2%
|
| 127 | Qwen3.6 27B (no reasoning)Alibaba |
21.2%
|
| 129 | Qwen3 MaxAlibaba |
20.5%
|
| 129 | GLM 4.5 AirZ.ai |
20.5%
|
| 131 | qwen3-max-previewAlibaba |
19.7%
|
| 132 | Qwen3 Coder 480B A35BAlibaba |
18.9%
|
| 132 | Devstral 2 2512Mistral |
18.9%
|
| 132 | Kimi K2.5Moonshot AI |
18.9%
|
| 132 | Grok 4.3 (off)xAI |
18.9%
|
| 132 | grok-4-fast-reasoningxAI |
18.9%
|
| 137 | qwen3.5-4b (thinking reasoning)Alibaba |
18.2%
|
| 137 | Qwen3.5-9B (no reasoning)Alibaba |
18.2%
|
| 137 | Qwen3 Coder NextAlibaba |
18.2%
|
| 137 | gemma-4-12b-itGoogle |
18.2%
|
| 137 | GPT-5.4 Mini (no reasoning)OpenAI |
18.2%
|
| 137 | GPT-5 (minimal reasoning)OpenAI |
18.2%
|
| 143 | Qwen3 Max Thinking (preview)Alibaba |
17.4%
|
| 143 | Mistral Small 4Mistral |
17.4%
|
| 143 | GPT-5 Nano (medium)OpenAI |
17.4%
|
| 143 | Grok Code Fast 1xAI |
17.4%
|
| 147 | gemini-2.5-flash-preview-09-2025 (thinking reasoning)Google |
16.7%
|
| 147 | devstral-small-2-24b-instruct-2512Mistral |
16.7%
|
| 147 | Grok 4.20 (off)xAI |
16.7%
|
| 150 | Mistral Large 3 2512Mistral |
15.9%
|
| 150 | Kimi K2 0711Moonshot AI |
15.9%
|
| 152 | Qwen3 235B A22B Instruct 2507Alibaba |
15.2%
|
| 152 | Qwen3 Coder 30B A3B InstructAlibaba |
15.2%
|
| 154 | gemini-2.5-flash-preview-09-2025 (no reasoning)Google |
14.4%
|
| 154 | GPT-5 Mini (minimal)OpenAI |
14.4%
|
| 154 | grok-4-1-fast-non-reasoning (no reasoning)xAI |
14.4%
|
| 154 | GLM 4.6V (thinking reasoning)Z.ai |
14.4%
|
| 158 | Gemma 4 26B A4BGoogle |
13.6%
|
| 159 | Qwen3 235B A22B Thinking 2507Alibaba |
13.6%
|
| 160 | gemini-2.5-flash-lite-preview-09-2025 (thinking reasoning)Google |
12.9%
|
| 160 | Magistral Medium 1.2Mistral |
12.9%
|
| 160 | gpt-5-chatOpenAI |
12.9%
|
| 163 | GPT-5 Nano (high)OpenAI |
12.1%
|
| 163 | grok-4-fast-non-reasoning (no reasoning)xAI |
12.1%
|
| 165 | qwen3.5-4b (no reasoning)Alibaba |
11.4%
|
| 165 | Qwen3 VL 235B A22B ThinkingAlibaba |
11.4%
|
| 165 | gemma-4-12b-it (no reasoning)Google |
11.4%
|
| 165 | kimi-linear-48b-a3b-instructMoonshot AI |
11.4%
|
| 169 | Qwen3.5-35B-A3B (no reasoning)Alibaba |
10.6%
|
| 169 | Mistral Medium 3.1Mistral |
10.6%
|
| 169 | Mistral Small 4 (no reasoning)Mistral |
10.6%
|
| 169 | gpt-oss-20b (high reasoning)OpenAI |
10.6%
|
| 173 | Qwen3 Next 80B A3B ThinkingAlibaba |
9.8%
|
| 174 | Devstral MediumMistral |
9.1%
|
| 175 | Qwen3.5 Omni FlashAlibaba |
8.3%
|
| 175 | Qwen3 VL 32B InstructAlibaba |
8.3%
|
| 175 | gemma-4-e4b-itGoogle |
8.3%
|
| 178 | Qwen3 Next 80B A3B InstructAlibaba |
7.6%
|
| 178 | qwen3-vl-32b-thinkingAlibaba |
7.6%
|
| 178 | gemini-2.5-flash-lite-preview-09-2025 (no reasoning)Google |
7.6%
|
| 178 | gemma-4-e4b-it (no reasoning)Google |
7.6%
|
| 182 | Qwen3 VL 235B A22B InstructAlibaba |
6.8%
|
| 182 | GPT-5 Nano (minimal)OpenAI |
6.8%
|
| 182 | GLM 4.5V (off)Z.ai |
6.8%
|
| 185 | Qwen3 30B A3B Instruct 2507Alibaba |
6.1%
|
| 185 | Qwen3 VL 30B A3B InstructAlibaba |
6.1%
|
| 185 | Devstral Small 1.1Mistral |
6.1%
|
| 188 | Qwen3 30B A3B Thinking 2507Alibaba |
5.3%
|
| 188 | Qwen3 VL 30B A3B ThinkingAlibaba |
5.3%
|
| 188 | gpt-oss-120b (low)OpenAI |
5.3%
|
| 188 | GLM 4.5V (thinking reasoning)Z.ai |
5.3%
|
| 192 | qwen3-4b-instruct-2507Alibaba |
4.5%
|
| 192 | magistral-small-2509Mistral |
4.5%
|
| 192 | Ministral 3 14B 2512Mistral |
4.5%
|
| 192 | Ministral 3 8B 2512Mistral |
4.5%
|
| 192 | gpt-oss-20b (low reasoning)OpenAI |
4.5%
|
| 197 | qwen3.5-2b (no reasoning)Alibaba |
3.8%
|
| 197 | qwen3.5-2b (thinking reasoning)Alibaba |
3.8%
|
| 197 | qwen3-omni-30b-a3b-thinkingAlibaba |
3.8%
|
| 197 | Qwen3 VL 8B ThinkingAlibaba |
3.8%
|
| 197 | GLM 4.7 Flash (no reasoning)Z.ai |
3.8%
|
| 202 | gemma-4-e2b-itGoogle |
3.0%
|
| 202 | GLM 4.6V (no reasoning)Z.ai |
3.0%
|
| 204 | Qwen3 VL 8B InstructAlibaba |
2.3%
|
| 204 | gemma-4-e2b-it (no reasoning)Google |
2.3%
|
| 206 | qwen3-4b-thinking-2507Alibaba |
1.5%
|
| 206 | Qwen3 Omni 30B A3B InstructAlibaba |
1.5%
|
| 206 | qwen3-vl-4b-thinkingAlibaba |
1.5%
|
| 209 | qwen3.5-0.8b (no reasoning)Alibaba |
0.0%
|
| 209 | qwen3.5-0.8b (thinking reasoning)Alibaba |
0.0%
|
| 209 | qwen3-vl-4b-instructAlibaba |
0.0%
|
| 209 | Gemma 3 270MGoogle |
0.0%
|
| 209 | Ministral 3 3B 2512Mistral |
0.0%
|
Results as published by Artificial Analysis; we do not re-run them.
What it measures
Share of the hardest Terminal-Bench tasks completed, as run by Artificial Analysis with its own harness and prompts.
What it does not measure
Not other harnesses; Artificial Analysis no longer runs it on new models.
Source
Failures
Failures count against a model: a product with no usable output is a failed listing. They are listed here so you can see why.
Not ranked
- Command A: creator outside the providers the catalogue covers
- GPT-4 Turbo: released before 2025-07-01
- GPT-4o (2024-05-13): released before 2025-07-01
- GPT-4o (2024-08-06): released before 2025-07-01
- Hy3: creator outside the providers the catalogue covers
- Hy3 preview: creator outside the providers the catalogue covers
- Inkling: creator outside the providers the catalogue covers
- Inkling Small: creator outside the providers the catalogue covers
- Llama 4 Maverick: released before 2025-07-01
- Llama 4 Scout: released before 2025-07-01
- Mercury 2: creator outside the providers the catalogue covers
- MiniMax M2: creator outside the providers the catalogue covers
- MiniMax M3: creator outside the providers the catalogue covers
- Mistral Large 2407: released before 2025-07-01
- Mistral Medium 3: released before 2025-07-01
- Phi 4: creator outside the providers the catalogue covers
- QwQ-32B-Preview: released before 2025-07-01
- R1: released before 2025-07-01
- Reka Flash 3: creator outside the providers the catalogue covers
- Solar Pro 3: creator outside the providers the catalogue covers
- Solar Pro 4: creator outside the providers the catalogue covers
- Trinity Large Thinking: creator outside the providers the catalogue covers
- a-x-k2: creator outside the providers the catalogue covers
- apertus-70b-instruct: creator outside the providers the catalogue covers
- apertus-8b-instruct: creator outside the providers the catalogue covers
- apodex-1-1: creator outside the providers the catalogue covers
- apriel-v1-5-15b-thinker: creator outside the providers the catalogue covers
- apriel-v1-6-15b-thinker: creator outside the providers the catalogue covers
- arctic-instruct: creator outside the providers the catalogue covers
- celeris-1: creator outside the providers the catalogue covers
- claude-2: released before 2025-07-01
- claude-21: released before 2025-07-01
- claude-3-5-haiku: released before 2025-07-01
- claude-3-7-sonnet: released before 2025-07-01
- claude-3-7-sonnet-thinking: released before 2025-07-01
- claude-3-haiku: released before 2025-07-01
- claude-3-opus: released before 2025-07-01
- claude-3-sonnet: released before 2025-07-01
- claude-35-sonnet: released before 2025-07-01
- claude-35-sonnet-june-24: released before 2025-07-01
- claude-4-opus: released before 2025-07-01
- claude-4-opus-thinking: released before 2025-07-01
- claude-4-sonnet: released before 2025-07-01
- claude-4-sonnet-thinking: released before 2025-07-01
- claude-instant: released before 2025-07-01
- claude-sonnet-4-6-non-reasoning-low-effort: non-standard setting combination
- cogito-v2-1-reasoning: creator outside the providers the catalogue covers
- command-a-plus: creator outside the providers the catalogue covers
- command-r-03-2024: creator outside the providers the catalogue covers
- command-r-plus-04-2024: creator outside the providers the catalogue covers
- dbrx: creator outside the providers the catalogue covers
- deephermes-3-llama-3-1-8b-preview: creator outside the providers the catalogue covers
- deephermes-3-mistral-24b-preview: creator outside the providers the catalogue covers
- deepseek-coder-v2: released before 2025-07-01
- deepseek-coder-v2-lite: released before 2025-07-01
- deepseek-llm-67b-chat: released before 2025-07-01
- deepseek-r1-0120: released before 2025-07-01
- deepseek-r1-distill-llama-70b: released before 2025-07-01
- deepseek-r1-distill-llama-8b: released before 2025-07-01
- deepseek-r1-distill-qwen-1-5b: released before 2025-07-01
- deepseek-r1-distill-qwen-14b: released before 2025-07-01
- deepseek-r1-distill-qwen-32b: released before 2025-07-01
- deepseek-r1-qwen3-8b: released before 2025-07-01
- deepseek-v2: released before 2025-07-01
- deepseek-v2-5: released before 2025-07-01
- deepseek-v2-5-sep-2024: released before 2025-07-01
- deepseek-v3: released before 2025-07-01
- deepseek-v3-0324: released before 2025-07-01
- devstral-small-2505: released before 2025-07-01
- doubao-seed-code: creator outside the providers the catalogue covers
- ernie-4-5-300b-a47b: creator outside the providers the catalogue covers
- ernie-5-0-thinking-preview: creator outside the providers the catalogue covers
- exaone-4-0-1-2b: creator outside the providers the catalogue covers
- exaone-4-0-1-2b-reasoning: creator outside the providers the catalogue covers
- exaone-4-0-32b: creator outside the providers the catalogue covers
- exaone-4-0-32b-reasoning: creator outside the providers the catalogue covers
- exaone-4-5-33b: creator outside the providers the catalogue covers
- falcon-h1r-7b: creator outside the providers the catalogue covers
- g9v3-39a5b: creator outside the providers the catalogue covers
- g9v3-3b: creator outside the providers the catalogue covers
- gemini-1-0-pro: released before 2025-07-01
- gemini-1-0-ultra: released before 2025-07-01
- gemini-1-5-flash: released before 2025-07-01
- gemini-1-5-flash-8b: released before 2025-07-01
- gemini-1-5-flash-may-2024: released before 2025-07-01
- gemini-1-5-pro: released before 2025-07-01
- gemini-1-5-pro-may-2024: released before 2025-07-01
- gemini-2-0-flash: released before 2025-07-01
- gemini-2-0-flash-experimental: released before 2025-07-01
- gemini-2-0-flash-lite-001: released before 2025-07-01
- gemini-2-0-flash-lite-preview: released before 2025-07-01
- gemini-2-0-flash-thinking-exp-0121: released before 2025-07-01
- gemini-2-0-flash-thinking-exp-1219: released before 2025-07-01
- gemini-2-0-pro-experimental-02-05: released before 2025-07-01
- gemini-2-5-flash: released before 2025-07-01
- gemini-2-5-flash-04-2025: released before 2025-07-01
- gemini-2-5-flash-lite: released before 2025-07-01
- gemini-2-5-flash-lite-reasoning: released before 2025-07-01
- gemini-2-5-flash-reasoning: released before 2025-07-01
- gemini-2-5-flash-reasoning-04-2025: released before 2025-07-01
- gemini-2-5-pro: released before 2025-07-01
- gemini-2-5-pro-03-25: released before 2025-07-01
- gemini-2-5-pro-05-06: released before 2025-07-01
- gemma-3-12b: released before 2025-07-01
- gemma-3-1b: released before 2025-07-01
- gemma-3-27b: released before 2025-07-01
- gemma-3-4b: released before 2025-07-01
- gemma-3n-e2b: released before 2025-07-01
- gemma-3n-e4b: released before 2025-07-01
- gemma-3n-e4b-preview-0520: released before 2025-07-01
- gpt-35-turbo: released before 2025-07-01
- gpt-4: released before 2025-07-01
- gpt-4-1: released before 2025-07-01
- gpt-4-1-mini: released before 2025-07-01
- gpt-4-1-nano: released before 2025-07-01
- gpt-4-5: released before 2025-07-01
- gpt-4o: released before 2025-07-01
- gpt-4o-chatgpt: released before 2025-07-01
- gpt-4o-chatgpt-03-25: released before 2025-07-01
- gpt-4o-mini: released before 2025-07-01
- granite-3-3-8b-instruct: creator outside the providers the catalogue covers
- granite-4-0-350m: creator outside the providers the catalogue covers
- granite-4-0-h-350m: creator outside the providers the catalogue covers
- granite-4-0-h-nano-1b: creator outside the providers the catalogue covers
- granite-4-0-h-small: creator outside the providers the catalogue covers
- granite-4-0-micro: creator outside the providers the catalogue covers
- granite-4-0-nano-1b: creator outside the providers the catalogue covers
- granite-4-1-30b: creator outside the providers the catalogue covers
- granite-4-1-3b: creator outside the providers the catalogue covers
- granite-4-1-8b: creator outside the providers the catalogue covers
- granite-4-2-30b: creator outside the providers the catalogue covers
- granite-4-2-3b: creator outside the providers the catalogue covers
- granite-4-2-8b: creator outside the providers the catalogue covers
- grok-1: released before 2025-07-01
- grok-2-1212: released before 2025-07-01
- grok-3: released before 2025-07-01
- grok-3-mini-reasoning: released before 2025-07-01
- grok-3-reasoning: released before 2025-07-01
- grok-beta: released before 2025-07-01
- hermes-3-llama-3-1-70b: creator outside the providers the catalogue covers
- hermes-4-llama-3-1-405b: creator outside the providers the catalogue covers
- hermes-4-llama-3-1-405b-reasoning: creator outside the providers the catalogue covers
- hermes-4-llama-3-1-70b: creator outside the providers the catalogue covers
- hermes-4-llama-3-1-70b-reasoning: creator outside the providers the catalogue covers
- hy3-non-reasoning: creator outside the providers the catalogue covers
- hyperclova-x-seed-think-32b: creator outside the providers the catalogue covers
- hypernova-60b: creator outside the providers the catalogue covers
- intellect-3: creator outside the providers the catalogue covers
- jamba-1-5-large: creator outside the providers the catalogue covers
- jamba-1-5-mini: creator outside the providers the catalogue covers
- jamba-1-6-large: creator outside the providers the catalogue covers
- jamba-1-6-mini: creator outside the providers the catalogue covers
- jamba-1-7-large: creator outside the providers the catalogue covers
- jamba-1-7-mini: creator outside the providers the catalogue covers
- jamba-reasoning-3b: creator outside the providers the catalogue covers
- jt-35b-flash: creator outside the providers the catalogue covers
- jt-4-1-flash-236b-a21b: creator outside the providers the catalogue covers
- jt-mini: creator outside the providers the catalogue covers
- jt236b: creator outside the providers the catalogue covers
- k-exaone: creator outside the providers the catalogue covers
- k-exaone-2-0-0803: creator outside the providers the catalogue covers
- k-exaone-non-reasoning: creator outside the providers the catalogue covers
- k2-horizon-0-9b: creator outside the providers the catalogue covers
- k2-horizon-3-7b: creator outside the providers the catalogue covers
- k2-horizon-375b-a23b: creator outside the providers the catalogue covers
- k2-horizon-7b: creator outside the providers the catalogue covers
- k2-horizon-mova-36b-a4b: creator outside the providers the catalogue covers
- k2-think-v2: creator outside the providers the catalogue covers
- k2-v2: creator outside the providers the catalogue covers
- k2-v2-low: creator outside the providers the catalogue covers
- k2-v2-medium: creator outside the providers the catalogue covers
- kat-coder-pro-v1: creator outside the providers the catalogue covers
- kat-coder-pro-v2: creator outside the providers the catalogue covers
- lfm-40b: creator outside the providers the catalogue covers
- lfm2-1-2b: creator outside the providers the catalogue covers
- lfm2-2-6b: creator outside the providers the catalogue covers
- lfm2-24b-a2b: creator outside the providers the catalogue covers
- lfm2-5-1-2b-instruct: creator outside the providers the catalogue covers
- lfm2-5-1-2b-thinking: creator outside the providers the catalogue covers
- lfm2-5-2-6b: creator outside the providers the catalogue covers
- lfm2-5-8b-a1b: creator outside the providers the catalogue covers
- lfm2-5-vl-1-6b: creator outside the providers the catalogue covers
- lfm2-8b-a1b: creator outside the providers the catalogue covers
- ling-1t: creator outside the providers the catalogue covers
- ling-2-6-1t: creator outside the providers the catalogue covers
- ling-2-6-flash: creator outside the providers the catalogue covers
- ling-3-0-flash: creator outside the providers the catalogue covers
- ling-3-0-flash-fin: creator outside the providers the catalogue covers
- ling-3-0-flash-vl: creator outside the providers the catalogue covers
- ling-3-0-tiny: creator outside the providers the catalogue covers
- ling-flash-2-0: creator outside the providers the catalogue covers
- ling-mini-2-0: creator outside the providers the catalogue covers
- llama-2-chat-13b: released before 2025-07-01
- llama-2-chat-70b: released before 2025-07-01
- llama-2-chat-7b: released before 2025-07-01
- llama-3-1-instruct-405b: released before 2025-07-01
- llama-3-1-instruct-70b: released before 2025-07-01
- llama-3-1-instruct-8b: released before 2025-07-01
- llama-3-1-nemotron-instruct-70b: creator outside the providers the catalogue covers
- llama-3-1-nemotron-nano-4b-reasoning: creator outside the providers the catalogue covers
- llama-3-1-nemotron-ultra-253b-v1-reasoning: creator outside the providers the catalogue covers
- llama-3-2-instruct-11b-vision: released before 2025-07-01
- llama-3-2-instruct-1b: released before 2025-07-01
- llama-3-2-instruct-3b: released before 2025-07-01
- llama-3-2-instruct-90b-vision: released before 2025-07-01
- llama-3-3-instruct-70b: released before 2025-07-01
- llama-3-3-nemotron-super-49b: creator outside the providers the catalogue covers
- llama-3-3-nemotron-super-49b-reasoning: creator outside the providers the catalogue covers
- llama-3-instruct-70b: released before 2025-07-01
- llama-3-instruct-8b: released before 2025-07-01
- llama-65b: released before 2025-07-01
- llama-nemotron-super-49b-v1-5: creator outside the providers the catalogue covers
- llama-nemotron-super-49b-v1-5-reasoning: creator outside the providers the catalogue covers
- longcat-2-0: creator outside the providers the catalogue covers
- longcat-flash-lite: creator outside the providers the catalogue covers
- magistral-medium: released before 2025-07-01
- magistral-small: released before 2025-07-01
- mercury-2-5: creator outside the providers the catalogue covers
- mi-dm-k-2-5-pro-dec28: creator outside the providers the catalogue covers
- midm-250-pro-rsnsft: creator outside the providers the catalogue covers
- mimo-v2-0206: creator outside the providers the catalogue covers
- mimo-v2-5-0424: creator outside the providers the catalogue covers
- mimo-v2-5-pro: creator outside the providers the catalogue covers
- mimo-v2-5-pro-non-reasoning: creator outside the providers the catalogue covers
- mimo-v2-6-flash: creator outside the providers the catalogue covers
- mimo-v2-6-pro: creator outside the providers the catalogue covers
- mimo-v2-flash: creator outside the providers the catalogue covers
- mimo-v2-flash-reasoning: creator outside the providers the catalogue covers
- mimo-v2-omni: creator outside the providers the catalogue covers
- mimo-v2-omni-0327: creator outside the providers the catalogue covers
- mimo-v2-pro: creator outside the providers the catalogue covers
- minicpm-v4-6-1-3b: creator outside the providers the catalogue covers
- minicpm5-1b: creator outside the providers the catalogue covers
- minicpm5-1b-non-reasoning: creator outside the providers the catalogue covers
- minicpm5-2b: creator outside the providers the catalogue covers
- minimax-m1-40k: creator outside the providers the catalogue covers
- minimax-m1-80k: creator outside the providers the catalogue covers
- minimax-m2-1: creator outside the providers the catalogue covers
- minimax-m2-5: creator outside the providers the catalogue covers
- minimax-m2-7: creator outside the providers the catalogue covers
- mistral-7b-instruct: released before 2025-07-01
- mistral-8x22b-instruct: released before 2025-07-01
- mistral-large: released before 2025-07-01
- mistral-large-2: released before 2025-07-01
- mistral-medium: released before 2025-07-01
- mistral-saba: released before 2025-07-01
- mistral-small: released before 2025-07-01
- mistral-small-2402: released before 2025-07-01
- mistral-small-3: released before 2025-07-01
- mistral-small-3-1: released before 2025-07-01
- mistral-small-3-2: released before 2025-07-01
- mixtral-8x7b-instruct: released before 2025-07-01
- molmo-7b-d: creator outside the providers the catalogue covers
- molmo2-8b: creator outside the providers the catalogue covers
- motif-0714: creator outside the providers the catalogue covers
- motif-2-12-7b: creator outside the providers the catalogue covers
- motif-3: creator outside the providers the catalogue covers
- nanbeige4-1-3b: creator outside the providers the catalogue covers
- nemotron-3-5-lightning: creator outside the providers the catalogue covers
- nemotron-3-nano-omni-30b-a3b: creator outside the providers the catalogue covers
- nemotron-cascade-2-30b-a3b: creator outside the providers the catalogue covers
- nex-n2-pro: creator outside the providers the catalogue covers
- north-mini-code: creator outside the providers the catalogue covers
- nova-2-0-lite: creator outside the providers the catalogue covers
- nova-2-0-lite-reasoning: creator outside the providers the catalogue covers
- nova-2-0-lite-reasoning-low: creator outside the providers the catalogue covers
- nova-2-0-lite-reasoning-medium: creator outside the providers the catalogue covers
- nova-2-0-omni: creator outside the providers the catalogue covers
- nova-2-0-omni-reasoning-low: creator outside the providers the catalogue covers
- nova-2-0-omni-reasoning-medium: creator outside the providers the catalogue covers
- nova-2-0-pro: creator outside the providers the catalogue covers
- nova-2-0-pro-reasoning-low: creator outside the providers the catalogue covers
- nova-2-0-pro-reasoning-medium: creator outside the providers the catalogue covers
- nova-lite: creator outside the providers the catalogue covers
- nova-micro: creator outside the providers the catalogue covers
- nova-premier: creator outside the providers the catalogue covers
- nova-pro: creator outside the providers the catalogue covers
- nvidia-nemotron-3-nano-30b-a3b: creator outside the providers the catalogue covers
- nvidia-nemotron-3-nano-30b-a3b-reasoning: creator outside the providers the catalogue covers
- nvidia-nemotron-3-nano-4b: creator outside the providers the catalogue covers
- nvidia-nemotron-3-super-120b-a12b: creator outside the providers the catalogue covers
- nvidia-nemotron-3-ultra-550b-a55b: creator outside the providers the catalogue covers
- nvidia-nemotron-nano-12b-v2-vl: creator outside the providers the catalogue covers
- nvidia-nemotron-nano-12b-v2-vl-reasoning: creator outside the providers the catalogue covers
- nvidia-nemotron-nano-9b-v2: creator outside the providers the catalogue covers
- nvidia-nemotron-nano-9b-v2-reasoning: creator outside the providers the catalogue covers
- o1: released before 2025-07-01
- o1-mini: released before 2025-07-01
- o1-preview: released before 2025-07-01
- o1-pro: released before 2025-07-01
- o3: released before 2025-07-01
- o3 Mini: released before 2025-07-01
- o3 Mini High: released before 2025-07-01
- o3 Pro: released before 2025-07-01
- o4 Mini: released before 2025-07-01
- olmo-2-32b: creator outside the providers the catalogue covers
- olmo-2-7b: creator outside the providers the catalogue covers
- olmo-3-1-32b-instruct: creator outside the providers the catalogue covers
- olmo-3-1-32b-think: creator outside the providers the catalogue covers
- olmo-3-32b-think: creator outside the providers the catalogue covers
- olmo-3-7b-instruct: creator outside the providers the catalogue covers
- olmo-3-7b-think: creator outside the providers the catalogue covers
- openchat-35: creator outside the providers the catalogue covers
- palm-2: released before 2025-07-01
- phi-3-mini: creator outside the providers the catalogue covers
- phi-4-mini: creator outside the providers the catalogue covers
- phi-4-multimodal: creator outside the providers the catalogue covers
- pixtral-large-2411: released before 2025-07-01
- quasar-438b: creator outside the providers the catalogue covers
- qwen-2-5-max: released before 2025-07-01
- qwen-chat-14b: released before 2025-07-01
- qwen-chat-72b: released before 2025-07-01
- qwen-turbo: released before 2025-07-01
- qwen1.5-110b-chat: released before 2025-07-01
- qwen2-5-72b-instruct: released before 2025-07-01
- qwen2-5-coder-32b-instruct: released before 2025-07-01
- qwen2-5-coder-7b-instruct: released before 2025-07-01
- qwen2-72b-instruct: released before 2025-07-01
- qwen2.5-32b-instruct: released before 2025-07-01
- qwen3-0.6b-instruct: released before 2025-07-01
- qwen3-0.6b-instruct-reasoning: released before 2025-07-01
- qwen3-1.7b-instruct: released before 2025-07-01
- qwen3-1.7b-instruct-reasoning: released before 2025-07-01
- qwen3-14b-instruct: released before 2025-07-01
- qwen3-14b-instruct-reasoning: released before 2025-07-01
- qwen3-235b-a22b-instruct: released before 2025-07-01
- qwen3-235b-a22b-instruct-reasoning: released before 2025-07-01
- qwen3-30b-a3b-instruct: released before 2025-07-01
- qwen3-30b-a3b-instruct-reasoning: released before 2025-07-01
- qwen3-32b-instruct: released before 2025-07-01
- qwen3-32b-instruct-reasoning: released before 2025-07-01
- qwen3-4b-instruct: released before 2025-07-01
- qwen3-4b-instruct-reasoning: released before 2025-07-01
- qwen3-8b-instruct: released before 2025-07-01
- qwen3-8b-instruct-reasoning: released before 2025-07-01
- qwq-32b: released before 2025-07-01
- r1-1776: creator outside the providers the catalogue covers
- reka-flash: creator outside the providers the catalogue covers
- ring-1t: creator outside the providers the catalogue covers
- ring-2-6-1t: creator outside the providers the catalogue covers
- ring-flash-2-0: creator outside the providers the catalogue covers
- sarvam-105b: creator outside the providers the catalogue covers
- sarvam-30b: creator outside the providers the catalogue covers
- sarvam-m-reasoning: creator outside the providers the catalogue covers
- seed-oss-36b-instruct: creator outside the providers the catalogue covers
- solar-mini: creator outside the providers the catalogue covers
- solar-mini4: creator outside the providers the catalogue covers
- solar-open-100b-reasoning: creator outside the providers the catalogue covers
- solar-open2-250b: creator outside the providers the catalogue covers
- solar-pro-2: creator outside the providers the catalogue covers
- solar-pro-2-preview: creator outside the providers the catalogue covers
- solar-pro-2-preview-reasoning: creator outside the providers the catalogue covers
- solar-pro-2-reasoning: creator outside the providers the catalogue covers
- sonar: creator outside the providers the catalogue covers
- sonar-pro: creator outside the providers the catalogue covers
- sonar-reasoning: creator outside the providers the catalogue covers
- sonar-reasoning-pro: creator outside the providers the catalogue covers
- step-3-5-flash: creator outside the providers the catalogue covers
- step-3-5-flash-0202: creator outside the providers the catalogue covers
- step-3-7-flash: creator outside the providers the catalogue covers
- step-3-vl-10b: creator outside the providers the catalogue covers
- step-5: creator outside the providers the catalogue covers
- tiny-aya-global: creator outside the providers the catalogue covers
- tri-21b-think-preview: creator outside the providers the catalogue covers
- tri-21b-think-v0-5: creator outside the providers the catalogue covers
- tulu3-405b: creator outside the providers the catalogue covers
Data sourced from Artificial Analysis. Licence: Artificial Analysis commercial data licence.