Benchmarks / Artificial Analysis
Reported by Artificial Analysis
Artificial Analysis
Share of simulated telecom support tasks resolved with tools, as run by Artificial Analysis with its own harness and prompts.
- Results dated
- 1 Oct 2026
- Models
- 214
- Unit
- % of tasks
Full results
| # | Model | Artificial Analysis: τ²-bench telecom % of tasks, higher is better |
|---|---|---|
| 1 | GLM 5.2 (max)Z.ai |
99.1%
|
| 2 | GLM 4.7 FlashZ.ai |
98.8%
|
| 3 | Claude Fable 5 (max reasoning)Anthropic |
98.5%
|
| 3 | GLM 5 TurboZ.ai |
98.5%
|
| 3 | GLM 5V TurboZ.ai |
98.5%
|
| 6 | GLM 5Z.ai |
98.2%
|
| 7 | Qwen3.6 PlusAlibaba |
97.7%
|
| 7 | Grok 4.3 (high)xAI |
97.7%
|
| 7 | GLM 5.1Z.ai |
97.7%
|
| 10 | GLM 5 (no reasoning)Z.ai |
97.4%
|
| 11 | GLM 5.1 (no reasoning)Z.ai |
97.1%
|
| 12 | grok-4.20-0309-reasoningxAI |
96.5%
|
| 13 | deepseek-v4-pro-preview (max reasoning)DeepSeek |
96.2%
|
| 14 | Qwen3.6 Max PreviewAlibaba |
95.9%
|
| 14 | Kimi K2.5Moonshot AI |
95.9%
|
| 14 | Kimi K2.6Moonshot AI |
95.9%
|
| 14 | GLM 4.7Z.ai |
95.9%
|
| 18 | Qwen3.5 397B A17BAlibaba |
95.6%
|
| 18 | deepseek-v4-flash-preview (high reasoning)DeepSeek |
95.6%
|
| 18 | Gemini 3.1 Pro PreviewGoogle |
95.6%
|
| 18 | Gemini 3.5 Flash (medium)Google |
95.6%
|
| 22 | Qwen3.6 35B A3BAlibaba |
95.3%
|
| 22 | Gemini 3.5 Flash (high)Google |
95.3%
|
| 24 | deepseek-v4-flash-preview (max reasoning)DeepSeek |
95.0%
|
| 25 | Qwen3.7 MaxAlibaba |
94.7%
|
| 26 | Claude Opus 4.8 (max reasoning)Anthropic |
94.4%
|
| 26 | deepseek-v4-flash-preview (no reasoning)DeepSeek |
94.4%
|
| 28 | Qwen3.6 27BAlibaba |
94.2%
|
| 28 | deepseek-v4-pro-preview (high reasoning)DeepSeek |
94.2%
|
| 28 | Mistral Medium 3.5Mistral |
94.2%
|
| 28 | GLM 4.7 (no reasoning)Z.ai |
94.2%
|
| 32 | Qwen3.5-27BAlibaba |
93.9%
|
| 32 | Kimi K2.6 (no reasoning)Moonshot AI |
93.9%
|
| 32 | GPT-5.5 (xhigh reasoning)OpenAI |
93.9%
|
| 35 | Qwen3.5-122B-A10BAlibaba |
93.6%
|
| 35 | Qwen3.6 27B (no reasoning)Alibaba |
93.6%
|
| 37 | grok-4-1-fast-reasoningxAI |
93.3%
|
| 38 | Qwen3.7 PlusAlibaba |
93.0%
|
| 38 | Kimi K2 ThinkingMoonshot AI |
93.0%
|
| 38 | GPT-5.5 (high)OpenAI |
93.0%
|
| 38 | Grok 4.20xAI |
93.0%
|
| 42 | qwen3.5-4b (thinking reasoning)Alibaba |
92.1%
|
| 42 | Claude Opus 4.6 (max reasoning)Anthropic |
92.1%
|
| 42 | GPT-5.2-Codex (xhigh)OpenAI |
92.1%
|
| 45 | GPT-5.5 (medium reasoning)OpenAI |
91.8%
|
| 45 | GLM 4.7 Flash (no reasoning)Z.ai |
91.8%
|
| 47 | muse-sparkMeta |
91.5%
|
| 48 | deepseek-v4-pro-preview (no reasoning)DeepSeek |
91.2%
|
| 48 | Grok 4.3 (medium)xAI |
91.2%
|
| 50 | DeepSeek V3.2DeepSeek |
90.6%
|
| 51 | Kimi K2.7 CodeMoonshot AI |
90.1%
|
| 52 | Claude Opus 4.5 (thinking reasoning)Anthropic |
89.5%
|
| 53 | Qwen3.5-35B-A3BAlibaba |
89.2%
|
| 54 | Grok 4.3 (low)xAI |
88.9%
|
| 55 | Claude Opus 4.7 (max reasoning)Anthropic |
88.6%
|
| 56 | Qwen3.5 Omni PlusAlibaba |
88.3%
|
| 57 | qwen3.5-4b (no reasoning)Alibaba |
87.7%
|
| 58 | Qwen3.5-27B (no reasoning)Alibaba |
87.1%
|
| 58 | gemini-3-pro (high)Google |
87.1%
|
| 58 | GPT-5.4 (xhigh reasoning)OpenAI |
87.1%
|
| 61 | Qwen3.5-9BAlibaba |
86.8%
|
| 61 | GPT-5-Codex (high)OpenAI |
86.8%
|
| 63 | GPT-5 (medium)OpenAI |
86.5%
|
| 64 | Qwen3.5-35B-A3B (no reasoning)Alibaba |
86.3%
|
| 64 | Claude Opus 4.5 (no reasoning)Anthropic |
86.3%
|
| 64 | GPT-5.6 Terra (max)OpenAI |
86.3%
|
| 67 | GPT-5.3-Codex (xhigh)OpenAI |
86.0%
|
| 68 | Qwen3.5-9B (no reasoning)Alibaba |
85.1%
|
| 68 | Qwen3.6 35B A3B (no reasoning)Alibaba |
85.1%
|
| 68 | GPT-5.6 Sol (max)OpenAI |
85.1%
|
| 71 | Claude Opus 4.6 (off)Anthropic |
84.8%
|
| 71 | GPT-5.2 (xhigh)OpenAI |
84.8%
|
| 71 | GPT-5.6 Sol (xhigh)OpenAI |
84.8%
|
| 71 | GPT-5 (high)OpenAI |
84.8%
|
| 75 | Qwen3.5-122B-A10B (no reasoning)Alibaba |
84.5%
|
| 75 | Qwen3.5 Omni FlashAlibaba |
84.5%
|
| 77 | GPT-5 (low reasoning)OpenAI |
84.2%
|
| 78 | Qwen3.5 397B A17B (no reasoning)Alibaba |
83.9%
|
| 78 | GPT-5.5 (low reasoning)OpenAI |
83.9%
|
| 80 | Qwen3 Max Thinking (preview)Alibaba |
83.6%
|
| 80 | Qwen3 Max ThinkingAlibaba |
83.6%
|
| 82 | GPT-5.4 Mini (xhigh)OpenAI |
83.3%
|
| 82 | GPT-5.6 Sol (high reasoning)OpenAI |
83.3%
|
| 84 | GPT-5.1-Codex (high)OpenAI |
83.0%
|
| 85 | GPT-5.1 (high)OpenAI |
81.9%
|
| 86 | qwen3.5-2b (no reasoning)Alibaba |
81.6%
|
| 87 | Kimi K2.5Moonshot AI |
81.3%
|
| 88 | GPT-5.6 Sol (medium reasoning)OpenAI |
81.0%
|
| 89 | gemini-3-flash (thinking reasoning)Google |
80.4%
|
| 89 | GPT-5.6 Terra (xhigh)OpenAI |
80.4%
|
| 91 | Qwen3 Coder NextAlibaba |
79.5%
|
| 91 | Claude Sonnet 4.6 (off)Anthropic |
79.5%
|
| 93 | DeepSeek V3.2 (no reasoning)DeepSeek |
78.9%
|
| 94 | GPT-5.6 Terra (high reasoning)OpenAI |
78.4%
|
| 95 | Claude Sonnet 4.5 (thinking reasoning)Anthropic |
78.1%
|
| 96 | GLM 4.6 (no reasoning)Z.ai |
76.9%
|
| 97 | GPT-5.4 Nano (xhigh)OpenAI |
76.0%
|
| 97 | GPT-5.6 Sol (low reasoning)OpenAI |
76.0%
|
| 99 | Claude Sonnet 4.6 (max reasoning)Anthropic |
75.7%
|
| 99 | Grok Code Fast 1xAI |
75.7%
|
| 101 | grok-4xAI |
74.9%
|
| 102 | GPT-5.4 (low reasoning)OpenAI |
74.6%
|
| 103 | Qwen3 MaxAlibaba |
74.3%
|
| 103 | GPT-5.2 (medium reasoning)OpenAI |
74.3%
|
| 105 | Claude Opus 4.7 (off)Anthropic |
74.0%
|
| 106 | Kimi K2 0905Moonshot AI |
73.4%
|
| 107 | GPT-5.6 Terra (medium reasoning)OpenAI |
72.8%
|
| 108 | Claude Opus 4.1 (thinking reasoning)Anthropic |
71.4%
|
| 109 | GPT-5 Mini (medium)OpenAI |
71.1%
|
| 110 | Claude Sonnet 4.5 (no reasoning)Anthropic |
70.5%
|
| 110 | GLM 4.6 (thinking reasoning)Z.ai |
70.5%
|
| 112 | grok-4.20-0309-non-reasoning (no reasoning)xAI |
69.6%
|
| 113 | GPT-5.5 (no reasoning)OpenAI |
69.3%
|
| 114 | qwen3.5-2b (thinking reasoning)Alibaba |
69.0%
|
| 115 | GPT-5 Mini (high)OpenAI |
68.4%
|
| 116 | gemini-3-pro (low)Google |
68.1%
|
| 117 | GPT-5 (minimal reasoning)OpenAI |
67.0%
|
| 118 | gpt-oss-120b (high)OpenAI |
65.8%
|
| 118 | Grok 4.3 (off)xAI |
65.8%
|
| 118 | grok-4-fast-reasoningxAI |
65.8%
|
| 121 | Gemma 4 31B (off)Google |
65.5%
|
| 122 | qwen3.5-0.8b (no reasoning)Alibaba |
65.2%
|
| 123 | grok-4-1-fast-non-reasoning (no reasoning)xAI |
63.7%
|
| 123 | grok-4-fast-non-reasoning (no reasoning)xAI |
63.7%
|
| 125 | GPT-5.1-Codex-Mini (high)OpenAI |
62.9%
|
| 126 | Kimi K2 0711Moonshot AI |
61.1%
|
| 127 | GPT-5.6 Terra (low reasoning)OpenAI |
60.5%
|
| 128 | gpt-oss-20b (high reasoning)OpenAI |
60.2%
|
| 129 | Gemma 4 31BGoogle |
59.9%
|
| 129 | Grok 4.20 (off)xAI |
59.9%
|
| 131 | Gemini 3.5 Flash (minimal reasoning)Google |
58.8%
|
| 132 | Claude Haiku 4.5 (thinking reasoning)Anthropic |
54.7%
|
| 133 | Qwen3 VL 235B A22B ThinkingAlibaba |
54.1%
|
| 134 | Qwen3 235B A22B Thinking 2507Alibaba |
53.2%
|
| 135 | GPT-5.4 Nano (medium)OpenAI |
52.6%
|
| 136 | Magistral Medium 1.2Mistral |
52.0%
|
| 137 | gpt-oss-20b (low reasoning)OpenAI |
50.3%
|
| 138 | GPT-5.5 Instant (26 May)OpenAI |
49.4%
|
| 139 | qwen3.5-0.8b (thinking reasoning)Alibaba |
47.7%
|
| 140 | GPT-5.1 (off)OpenAI |
46.5%
|
| 140 | GPT-5.2 (no reasoning)OpenAI |
46.5%
|
| 140 | GLM 4.5 AirZ.ai |
46.5%
|
| 143 | qwen3-vl-32b-thinkingAlibaba |
45.6%
|
| 143 | gemini-2.5-flash-preview-09-2025 (thinking reasoning)Google |
45.6%
|
| 145 | gpt-oss-120b (low)OpenAI |
45.0%
|
| 146 | Qwen3 Coder 480B A35BAlibaba |
43.6%
|
| 146 | Gemma 4 26B A4BGoogle |
43.6%
|
| 148 | gemini-3-flash (off)Google |
43.3%
|
| 149 | GLM 4.5Z.ai |
43.0%
|
| 150 | Qwen3 Next 80B A3B ThinkingAlibaba |
41.5%
|
| 151 | Mistral Small 4Mistral |
41.2%
|
| 152 | Mistral Medium 3.1Mistral |
40.6%
|
| 153 | Gemma 4 26B A4B (off)Google |
40.4%
|
| 154 | DeepSeek V3.1DeepSeek |
37.4%
|
| 155 | DeepSeek V3.1 Terminus (no reasoning)DeepSeek |
37.1%
|
| 155 | DeepSeek V3.1 TerminusDeepSeek |
37.1%
|
| 157 | GPT-5.4 Mini (medium)OpenAI |
36.5%
|
| 157 | GPT-5 Nano (high)OpenAI |
36.5%
|
| 159 | gemma-4-12b-itGoogle |
36.3%
|
| 160 | GPT-5.4 (no reasoning)OpenAI |
36.0%
|
| 161 | Qwen3 VL 235B A22B InstructAlibaba |
35.1%
|
| 162 | DeepSeek V3.1 (no reasoning)DeepSeek |
34.8%
|
| 162 | GPT-5.4 Nano (no reasoning)OpenAI |
34.8%
|
| 164 | Qwen3 Coder 30B A3B InstructAlibaba |
34.5%
|
| 165 | DeepSeek V3.2 Exp (no reasoning)DeepSeek |
33.9%
|
| 165 | DeepSeek V3.2 ExpDeepSeek |
33.9%
|
| 167 | Qwen3 235B A22B Instruct 2507Alibaba |
33.3%
|
| 168 | qwen3-max-previewAlibaba |
32.7%
|
| 169 | Claude Haiku 4.5 (no reasoning)Anthropic |
32.5%
|
| 170 | gemma-4-12b-it (no reasoning)Google |
31.9%
|
| 170 | GPT-5 Mini (minimal)OpenAI |
31.9%
|
| 172 | GLM 4.6V (thinking reasoning)Z.ai |
31.6%
|
| 173 | Gemini 3.1 Flash Lite PreviewGoogle |
31.3%
|
| 174 | gemini-2.5-flash-lite-preview-09-2025 (thinking reasoning)Google |
30.7%
|
| 174 | GLM 4.6V (no reasoning)Z.ai |
30.7%
|
| 176 | gemini-2.5-flash-lite-preview-09-2025 (no reasoning)Google |
30.4%
|
| 176 | GPT-5 Nano (medium)OpenAI |
30.4%
|
| 178 | Qwen3 VL 32B InstructAlibaba |
29.2%
|
| 178 | Qwen3 VL 8B InstructAlibaba |
29.2%
|
| 180 | gemini-2.5-flash-preview-09-2025 (no reasoning)Google |
28.4%
|
| 180 | Devstral Small 1.1Mistral |
28.4%
|
| 182 | Qwen3 30B A3B Thinking 2507Alibaba |
28.1%
|
| 183 | magistral-small-2509Mistral |
27.8%
|
| 184 | Ministral 3 14B 2512Mistral |
27.2%
|
| 185 | qwen3-4b-instruct-2507Alibaba |
26.6%
|
| 185 | Ministral 3 8B 2512Mistral |
26.6%
|
| 187 | gemma-4-e4b-it (no reasoning)Google |
26.0%
|
| 188 | GPT-5 Nano (minimal)OpenAI |
25.7%
|
| 189 | qwen3-4b-thinking-2507Alibaba |
25.4%
|
| 190 | Devstral 2 2512Mistral |
24.9%
|
| 190 | Ministral 3 3B 2512Mistral |
24.9%
|
| 192 | Mistral Large 3 2512Mistral |
24.6%
|
| 193 | qwen3-vl-4b-instructAlibaba |
23.4%
|
| 193 | devstral-small-2-24b-instruct-2512Mistral |
23.4%
|
| 193 | GPT-5.4 Mini (no reasoning)OpenAI |
23.4%
|
| 196 | Qwen3 VL 8B ThinkingAlibaba |
22.5%
|
| 196 | GLM 4.5V (thinking reasoning)Z.ai |
22.5%
|
| 198 | gemma-4-e2b-it (no reasoning)Google |
22.2%
|
| 199 | Qwen3 Next 80B A3B InstructAlibaba |
21.6%
|
| 200 | qwen3-omni-30b-a3b-thinkingAlibaba |
21.3%
|
| 201 | gemma-4-e2b-itGoogle |
20.8%
|
| 201 | gemma-4-e4b-itGoogle |
20.8%
|
| 203 | Qwen3 VL 30B A3B ThinkingAlibaba |
19.9%
|
| 203 | Devstral MediumMistral |
19.9%
|
| 205 | GLM 4.5V (off)Z.ai |
19.6%
|
| 206 | Qwen3 VL 30B A3B InstructAlibaba |
19.0%
|
| 207 | Mistral Small 4 (no reasoning)Mistral |
18.4%
|
| 208 | Qwen3 Omni 30B A3B InstructAlibaba |
16.4%
|
| 209 | qwen3-vl-4b-thinkingAlibaba |
15.5%
|
| 210 | Qwen3 30B A3B Instruct 2507Alibaba |
10.2%
|
| 211 | Gemma 3 270MGoogle |
9.1%
|
| 212 | deepseek-v3.2-specialeDeepSeek |
0.0%
|
| 212 | kimi-linear-48b-a3b-instructMoonshot AI |
0.0%
|
| 212 | gpt-5-chatOpenAI |
0.0%
|
Results as published by Artificial Analysis; we do not re-run them.
What it measures
Share of simulated telecom support tasks resolved with tools, as run by Artificial Analysis with its own harness and prompts.
What it does not measure
Not your policies or systems; no longer run on new models.
Source
Failures
Failures count against a model: a product with no usable output is a failed listing. They are listed here so you can see why.
Not ranked
- Command A: creator outside the providers the catalogue covers
- GPT-4 Turbo: released before 2025-07-01
- GPT-4o (2024-05-13): released before 2025-07-01
- GPT-4o (2024-08-06): released before 2025-07-01
- Hy3: creator outside the providers the catalogue covers
- Hy3 preview: creator outside the providers the catalogue covers
- Inkling: creator outside the providers the catalogue covers
- Inkling Small: creator outside the providers the catalogue covers
- Llama 4 Maverick: released before 2025-07-01
- Llama 4 Scout: released before 2025-07-01
- Mercury 2: creator outside the providers the catalogue covers
- MiniMax M2: creator outside the providers the catalogue covers
- MiniMax M3: creator outside the providers the catalogue covers
- Mistral Large 2407: released before 2025-07-01
- Mistral Medium 3: released before 2025-07-01
- Phi 4: creator outside the providers the catalogue covers
- QwQ-32B-Preview: released before 2025-07-01
- R1: released before 2025-07-01
- Reka Flash 3: creator outside the providers the catalogue covers
- Solar Pro 3: creator outside the providers the catalogue covers
- Solar Pro 4: creator outside the providers the catalogue covers
- Trinity Large Thinking: creator outside the providers the catalogue covers
- a-x-k2: creator outside the providers the catalogue covers
- apertus-70b-instruct: creator outside the providers the catalogue covers
- apertus-8b-instruct: creator outside the providers the catalogue covers
- apodex-1-1: creator outside the providers the catalogue covers
- apriel-v1-5-15b-thinker: creator outside the providers the catalogue covers
- apriel-v1-6-15b-thinker: creator outside the providers the catalogue covers
- arctic-instruct: creator outside the providers the catalogue covers
- celeris-1: creator outside the providers the catalogue covers
- claude-2: released before 2025-07-01
- claude-21: released before 2025-07-01
- claude-3-5-haiku: released before 2025-07-01
- claude-3-7-sonnet: released before 2025-07-01
- claude-3-7-sonnet-thinking: released before 2025-07-01
- claude-3-haiku: released before 2025-07-01
- claude-3-opus: released before 2025-07-01
- claude-3-sonnet: released before 2025-07-01
- claude-35-sonnet: released before 2025-07-01
- claude-35-sonnet-june-24: released before 2025-07-01
- claude-4-opus: released before 2025-07-01
- claude-4-opus-thinking: released before 2025-07-01
- claude-4-sonnet: released before 2025-07-01
- claude-4-sonnet-thinking: released before 2025-07-01
- claude-instant: released before 2025-07-01
- claude-sonnet-4-6-non-reasoning-low-effort: non-standard setting combination
- cogito-v2-1-reasoning: creator outside the providers the catalogue covers
- command-a-plus: creator outside the providers the catalogue covers
- command-r-03-2024: creator outside the providers the catalogue covers
- command-r-plus-04-2024: creator outside the providers the catalogue covers
- dbrx: creator outside the providers the catalogue covers
- deephermes-3-llama-3-1-8b-preview: creator outside the providers the catalogue covers
- deephermes-3-mistral-24b-preview: creator outside the providers the catalogue covers
- deepseek-coder-v2: released before 2025-07-01
- deepseek-coder-v2-lite: released before 2025-07-01
- deepseek-llm-67b-chat: released before 2025-07-01
- deepseek-r1-0120: released before 2025-07-01
- deepseek-r1-distill-llama-70b: released before 2025-07-01
- deepseek-r1-distill-llama-8b: released before 2025-07-01
- deepseek-r1-distill-qwen-1-5b: released before 2025-07-01
- deepseek-r1-distill-qwen-14b: released before 2025-07-01
- deepseek-r1-distill-qwen-32b: released before 2025-07-01
- deepseek-r1-qwen3-8b: released before 2025-07-01
- deepseek-v2: released before 2025-07-01
- deepseek-v2-5: released before 2025-07-01
- deepseek-v2-5-sep-2024: released before 2025-07-01
- deepseek-v3: released before 2025-07-01
- deepseek-v3-0324: released before 2025-07-01
- devstral-small-2505: released before 2025-07-01
- doubao-seed-code: creator outside the providers the catalogue covers
- ernie-4-5-300b-a47b: creator outside the providers the catalogue covers
- ernie-5-0-thinking-preview: creator outside the providers the catalogue covers
- exaone-4-0-1-2b: creator outside the providers the catalogue covers
- exaone-4-0-1-2b-reasoning: creator outside the providers the catalogue covers
- exaone-4-0-32b: creator outside the providers the catalogue covers
- exaone-4-0-32b-reasoning: creator outside the providers the catalogue covers
- exaone-4-5-33b: creator outside the providers the catalogue covers
- falcon-h1r-7b: creator outside the providers the catalogue covers
- g9v3-39a5b: creator outside the providers the catalogue covers
- g9v3-3b: creator outside the providers the catalogue covers
- gemini-1-0-pro: released before 2025-07-01
- gemini-1-0-ultra: released before 2025-07-01
- gemini-1-5-flash: released before 2025-07-01
- gemini-1-5-flash-8b: released before 2025-07-01
- gemini-1-5-flash-may-2024: released before 2025-07-01
- gemini-1-5-pro: released before 2025-07-01
- gemini-1-5-pro-may-2024: released before 2025-07-01
- gemini-2-0-flash: released before 2025-07-01
- gemini-2-0-flash-experimental: released before 2025-07-01
- gemini-2-0-flash-lite-001: released before 2025-07-01
- gemini-2-0-flash-lite-preview: released before 2025-07-01
- gemini-2-0-flash-thinking-exp-0121: released before 2025-07-01
- gemini-2-0-flash-thinking-exp-1219: released before 2025-07-01
- gemini-2-0-pro-experimental-02-05: released before 2025-07-01
- gemini-2-5-flash: released before 2025-07-01
- gemini-2-5-flash-04-2025: released before 2025-07-01
- gemini-2-5-flash-lite: released before 2025-07-01
- gemini-2-5-flash-lite-reasoning: released before 2025-07-01
- gemini-2-5-flash-reasoning: released before 2025-07-01
- gemini-2-5-flash-reasoning-04-2025: released before 2025-07-01
- gemini-2-5-pro: released before 2025-07-01
- gemini-2-5-pro-03-25: released before 2025-07-01
- gemini-2-5-pro-05-06: released before 2025-07-01
- gemma-3-12b: released before 2025-07-01
- gemma-3-1b: released before 2025-07-01
- gemma-3-27b: released before 2025-07-01
- gemma-3-4b: released before 2025-07-01
- gemma-3n-e2b: released before 2025-07-01
- gemma-3n-e4b: released before 2025-07-01
- gemma-3n-e4b-preview-0520: released before 2025-07-01
- gpt-35-turbo: released before 2025-07-01
- gpt-4: released before 2025-07-01
- gpt-4-1: released before 2025-07-01
- gpt-4-1-mini: released before 2025-07-01
- gpt-4-1-nano: released before 2025-07-01
- gpt-4-5: released before 2025-07-01
- gpt-4o: released before 2025-07-01
- gpt-4o-chatgpt: released before 2025-07-01
- gpt-4o-chatgpt-03-25: released before 2025-07-01
- gpt-4o-mini: released before 2025-07-01
- granite-3-3-8b-instruct: creator outside the providers the catalogue covers
- granite-4-0-350m: creator outside the providers the catalogue covers
- granite-4-0-h-350m: creator outside the providers the catalogue covers
- granite-4-0-h-nano-1b: creator outside the providers the catalogue covers
- granite-4-0-h-small: creator outside the providers the catalogue covers
- granite-4-0-micro: creator outside the providers the catalogue covers
- granite-4-0-nano-1b: creator outside the providers the catalogue covers
- granite-4-1-30b: creator outside the providers the catalogue covers
- granite-4-1-3b: creator outside the providers the catalogue covers
- granite-4-1-8b: creator outside the providers the catalogue covers
- granite-4-2-30b: creator outside the providers the catalogue covers
- granite-4-2-3b: creator outside the providers the catalogue covers
- granite-4-2-8b: creator outside the providers the catalogue covers
- grok-1: released before 2025-07-01
- grok-2-1212: released before 2025-07-01
- grok-3: released before 2025-07-01
- grok-3-mini-reasoning: released before 2025-07-01
- grok-3-reasoning: released before 2025-07-01
- grok-beta: released before 2025-07-01
- hermes-3-llama-3-1-70b: creator outside the providers the catalogue covers
- hermes-4-llama-3-1-405b: creator outside the providers the catalogue covers
- hermes-4-llama-3-1-405b-reasoning: creator outside the providers the catalogue covers
- hermes-4-llama-3-1-70b: creator outside the providers the catalogue covers
- hermes-4-llama-3-1-70b-reasoning: creator outside the providers the catalogue covers
- hy3-non-reasoning: creator outside the providers the catalogue covers
- hyperclova-x-seed-think-32b: creator outside the providers the catalogue covers
- hypernova-60b: creator outside the providers the catalogue covers
- intellect-3: creator outside the providers the catalogue covers
- jamba-1-5-large: creator outside the providers the catalogue covers
- jamba-1-5-mini: creator outside the providers the catalogue covers
- jamba-1-6-large: creator outside the providers the catalogue covers
- jamba-1-6-mini: creator outside the providers the catalogue covers
- jamba-1-7-large: creator outside the providers the catalogue covers
- jamba-1-7-mini: creator outside the providers the catalogue covers
- jamba-reasoning-3b: creator outside the providers the catalogue covers
- jt-35b-flash: creator outside the providers the catalogue covers
- jt-4-1-flash-236b-a21b: creator outside the providers the catalogue covers
- jt-mini: creator outside the providers the catalogue covers
- jt236b: creator outside the providers the catalogue covers
- k-exaone: creator outside the providers the catalogue covers
- k-exaone-2-0-0803: creator outside the providers the catalogue covers
- k-exaone-non-reasoning: creator outside the providers the catalogue covers
- k2-horizon-0-9b: creator outside the providers the catalogue covers
- k2-horizon-3-7b: creator outside the providers the catalogue covers
- k2-horizon-375b-a23b: creator outside the providers the catalogue covers
- k2-horizon-7b: creator outside the providers the catalogue covers
- k2-horizon-mova-36b-a4b: creator outside the providers the catalogue covers
- k2-think-v2: creator outside the providers the catalogue covers
- k2-v2: creator outside the providers the catalogue covers
- k2-v2-low: creator outside the providers the catalogue covers
- k2-v2-medium: creator outside the providers the catalogue covers
- kat-coder-pro-v1: creator outside the providers the catalogue covers
- kat-coder-pro-v2: creator outside the providers the catalogue covers
- lfm-40b: creator outside the providers the catalogue covers
- lfm2-1-2b: creator outside the providers the catalogue covers
- lfm2-2-6b: creator outside the providers the catalogue covers
- lfm2-24b-a2b: creator outside the providers the catalogue covers
- lfm2-5-1-2b-instruct: creator outside the providers the catalogue covers
- lfm2-5-1-2b-thinking: creator outside the providers the catalogue covers
- lfm2-5-2-6b: creator outside the providers the catalogue covers
- lfm2-5-8b-a1b: creator outside the providers the catalogue covers
- lfm2-5-vl-1-6b: creator outside the providers the catalogue covers
- lfm2-8b-a1b: creator outside the providers the catalogue covers
- ling-1t: creator outside the providers the catalogue covers
- ling-2-6-1t: creator outside the providers the catalogue covers
- ling-2-6-flash: creator outside the providers the catalogue covers
- ling-3-0-flash: creator outside the providers the catalogue covers
- ling-3-0-flash-fin: creator outside the providers the catalogue covers
- ling-3-0-flash-vl: creator outside the providers the catalogue covers
- ling-3-0-tiny: creator outside the providers the catalogue covers
- ling-flash-2-0: creator outside the providers the catalogue covers
- ling-mini-2-0: creator outside the providers the catalogue covers
- llama-2-chat-13b: released before 2025-07-01
- llama-2-chat-70b: released before 2025-07-01
- llama-2-chat-7b: released before 2025-07-01
- llama-3-1-instruct-405b: released before 2025-07-01
- llama-3-1-instruct-70b: released before 2025-07-01
- llama-3-1-instruct-8b: released before 2025-07-01
- llama-3-1-nemotron-instruct-70b: creator outside the providers the catalogue covers
- llama-3-1-nemotron-nano-4b-reasoning: creator outside the providers the catalogue covers
- llama-3-1-nemotron-ultra-253b-v1-reasoning: creator outside the providers the catalogue covers
- llama-3-2-instruct-11b-vision: released before 2025-07-01
- llama-3-2-instruct-1b: released before 2025-07-01
- llama-3-2-instruct-3b: released before 2025-07-01
- llama-3-2-instruct-90b-vision: released before 2025-07-01
- llama-3-3-instruct-70b: released before 2025-07-01
- llama-3-3-nemotron-super-49b: creator outside the providers the catalogue covers
- llama-3-3-nemotron-super-49b-reasoning: creator outside the providers the catalogue covers
- llama-3-instruct-70b: released before 2025-07-01
- llama-3-instruct-8b: released before 2025-07-01
- llama-65b: released before 2025-07-01
- llama-nemotron-super-49b-v1-5: creator outside the providers the catalogue covers
- llama-nemotron-super-49b-v1-5-reasoning: creator outside the providers the catalogue covers
- longcat-2-0: creator outside the providers the catalogue covers
- longcat-flash-lite: creator outside the providers the catalogue covers
- magistral-medium: released before 2025-07-01
- magistral-small: released before 2025-07-01
- mercury-2-5: creator outside the providers the catalogue covers
- mi-dm-k-2-5-pro-dec28: creator outside the providers the catalogue covers
- midm-250-pro-rsnsft: creator outside the providers the catalogue covers
- mimo-v2-0206: creator outside the providers the catalogue covers
- mimo-v2-5-0424: creator outside the providers the catalogue covers
- mimo-v2-5-pro: creator outside the providers the catalogue covers
- mimo-v2-5-pro-non-reasoning: creator outside the providers the catalogue covers
- mimo-v2-6-flash: creator outside the providers the catalogue covers
- mimo-v2-6-pro: creator outside the providers the catalogue covers
- mimo-v2-flash: creator outside the providers the catalogue covers
- mimo-v2-flash-reasoning: creator outside the providers the catalogue covers
- mimo-v2-omni: creator outside the providers the catalogue covers
- mimo-v2-omni-0327: creator outside the providers the catalogue covers
- mimo-v2-pro: creator outside the providers the catalogue covers
- minicpm-v4-6-1-3b: creator outside the providers the catalogue covers
- minicpm5-1b: creator outside the providers the catalogue covers
- minicpm5-1b-non-reasoning: creator outside the providers the catalogue covers
- minicpm5-2b: creator outside the providers the catalogue covers
- minimax-m1-40k: creator outside the providers the catalogue covers
- minimax-m1-80k: creator outside the providers the catalogue covers
- minimax-m2-1: creator outside the providers the catalogue covers
- minimax-m2-5: creator outside the providers the catalogue covers
- minimax-m2-7: creator outside the providers the catalogue covers
- mistral-7b-instruct: released before 2025-07-01
- mistral-8x22b-instruct: released before 2025-07-01
- mistral-large: released before 2025-07-01
- mistral-large-2: released before 2025-07-01
- mistral-medium: released before 2025-07-01
- mistral-saba: released before 2025-07-01
- mistral-small: released before 2025-07-01
- mistral-small-2402: released before 2025-07-01
- mistral-small-3: released before 2025-07-01
- mistral-small-3-1: released before 2025-07-01
- mistral-small-3-2: released before 2025-07-01
- mixtral-8x7b-instruct: released before 2025-07-01
- molmo-7b-d: creator outside the providers the catalogue covers
- molmo2-8b: creator outside the providers the catalogue covers
- motif-0714: creator outside the providers the catalogue covers
- motif-2-12-7b: creator outside the providers the catalogue covers
- motif-3: creator outside the providers the catalogue covers
- nanbeige4-1-3b: creator outside the providers the catalogue covers
- nemotron-3-5-lightning: creator outside the providers the catalogue covers
- nemotron-3-nano-omni-30b-a3b: creator outside the providers the catalogue covers
- nemotron-cascade-2-30b-a3b: creator outside the providers the catalogue covers
- nex-n2-pro: creator outside the providers the catalogue covers
- north-mini-code: creator outside the providers the catalogue covers
- nova-2-0-lite: creator outside the providers the catalogue covers
- nova-2-0-lite-reasoning: creator outside the providers the catalogue covers
- nova-2-0-lite-reasoning-low: creator outside the providers the catalogue covers
- nova-2-0-lite-reasoning-medium: creator outside the providers the catalogue covers
- nova-2-0-omni: creator outside the providers the catalogue covers
- nova-2-0-omni-reasoning-low: creator outside the providers the catalogue covers
- nova-2-0-omni-reasoning-medium: creator outside the providers the catalogue covers
- nova-2-0-pro: creator outside the providers the catalogue covers
- nova-2-0-pro-reasoning-low: creator outside the providers the catalogue covers
- nova-2-0-pro-reasoning-medium: creator outside the providers the catalogue covers
- nova-lite: creator outside the providers the catalogue covers
- nova-micro: creator outside the providers the catalogue covers
- nova-premier: creator outside the providers the catalogue covers
- nova-pro: creator outside the providers the catalogue covers
- nvidia-nemotron-3-nano-30b-a3b: creator outside the providers the catalogue covers
- nvidia-nemotron-3-nano-30b-a3b-reasoning: creator outside the providers the catalogue covers
- nvidia-nemotron-3-nano-4b: creator outside the providers the catalogue covers
- nvidia-nemotron-3-super-120b-a12b: creator outside the providers the catalogue covers
- nvidia-nemotron-3-ultra-550b-a55b: creator outside the providers the catalogue covers
- nvidia-nemotron-nano-12b-v2-vl: creator outside the providers the catalogue covers
- nvidia-nemotron-nano-12b-v2-vl-reasoning: creator outside the providers the catalogue covers
- nvidia-nemotron-nano-9b-v2: creator outside the providers the catalogue covers
- nvidia-nemotron-nano-9b-v2-reasoning: creator outside the providers the catalogue covers
- o1: released before 2025-07-01
- o1-mini: released before 2025-07-01
- o1-preview: released before 2025-07-01
- o1-pro: released before 2025-07-01
- o3: released before 2025-07-01
- o3 Mini: released before 2025-07-01
- o3 Mini High: released before 2025-07-01
- o3 Pro: released before 2025-07-01
- o4 Mini: released before 2025-07-01
- olmo-2-32b: creator outside the providers the catalogue covers
- olmo-2-7b: creator outside the providers the catalogue covers
- olmo-3-1-32b-instruct: creator outside the providers the catalogue covers
- olmo-3-1-32b-think: creator outside the providers the catalogue covers
- olmo-3-32b-think: creator outside the providers the catalogue covers
- olmo-3-7b-instruct: creator outside the providers the catalogue covers
- olmo-3-7b-think: creator outside the providers the catalogue covers
- openchat-35: creator outside the providers the catalogue covers
- palm-2: released before 2025-07-01
- phi-3-mini: creator outside the providers the catalogue covers
- phi-4-mini: creator outside the providers the catalogue covers
- phi-4-multimodal: creator outside the providers the catalogue covers
- pixtral-large-2411: released before 2025-07-01
- quasar-438b: creator outside the providers the catalogue covers
- qwen-2-5-max: released before 2025-07-01
- qwen-chat-14b: released before 2025-07-01
- qwen-chat-72b: released before 2025-07-01
- qwen-turbo: released before 2025-07-01
- qwen1.5-110b-chat: released before 2025-07-01
- qwen2-5-72b-instruct: released before 2025-07-01
- qwen2-5-coder-32b-instruct: released before 2025-07-01
- qwen2-5-coder-7b-instruct: released before 2025-07-01
- qwen2-72b-instruct: released before 2025-07-01
- qwen2.5-32b-instruct: released before 2025-07-01
- qwen3-0.6b-instruct: released before 2025-07-01
- qwen3-0.6b-instruct-reasoning: released before 2025-07-01
- qwen3-1.7b-instruct: released before 2025-07-01
- qwen3-1.7b-instruct-reasoning: released before 2025-07-01
- qwen3-14b-instruct: released before 2025-07-01
- qwen3-14b-instruct-reasoning: released before 2025-07-01
- qwen3-235b-a22b-instruct: released before 2025-07-01
- qwen3-235b-a22b-instruct-reasoning: released before 2025-07-01
- qwen3-30b-a3b-instruct: released before 2025-07-01
- qwen3-30b-a3b-instruct-reasoning: released before 2025-07-01
- qwen3-32b-instruct: released before 2025-07-01
- qwen3-32b-instruct-reasoning: released before 2025-07-01
- qwen3-4b-instruct: released before 2025-07-01
- qwen3-4b-instruct-reasoning: released before 2025-07-01
- qwen3-8b-instruct: released before 2025-07-01
- qwen3-8b-instruct-reasoning: released before 2025-07-01
- qwq-32b: released before 2025-07-01
- r1-1776: creator outside the providers the catalogue covers
- reka-flash: creator outside the providers the catalogue covers
- ring-1t: creator outside the providers the catalogue covers
- ring-2-6-1t: creator outside the providers the catalogue covers
- ring-flash-2-0: creator outside the providers the catalogue covers
- sarvam-105b: creator outside the providers the catalogue covers
- sarvam-30b: creator outside the providers the catalogue covers
- sarvam-m-reasoning: creator outside the providers the catalogue covers
- seed-oss-36b-instruct: creator outside the providers the catalogue covers
- solar-mini: creator outside the providers the catalogue covers
- solar-mini4: creator outside the providers the catalogue covers
- solar-open-100b-reasoning: creator outside the providers the catalogue covers
- solar-open2-250b: creator outside the providers the catalogue covers
- solar-pro-2: creator outside the providers the catalogue covers
- solar-pro-2-preview: creator outside the providers the catalogue covers
- solar-pro-2-preview-reasoning: creator outside the providers the catalogue covers
- solar-pro-2-reasoning: creator outside the providers the catalogue covers
- sonar: creator outside the providers the catalogue covers
- sonar-pro: creator outside the providers the catalogue covers
- sonar-reasoning: creator outside the providers the catalogue covers
- sonar-reasoning-pro: creator outside the providers the catalogue covers
- step-3-5-flash: creator outside the providers the catalogue covers
- step-3-5-flash-0202: creator outside the providers the catalogue covers
- step-3-7-flash: creator outside the providers the catalogue covers
- step-3-vl-10b: creator outside the providers the catalogue covers
- step-5: creator outside the providers the catalogue covers
- tiny-aya-global: creator outside the providers the catalogue covers
- tri-21b-think-preview: creator outside the providers the catalogue covers
- tri-21b-think-v0-5: creator outside the providers the catalogue covers
- tulu3-405b: creator outside the providers the catalogue covers
Data sourced from Artificial Analysis. Licence: Artificial Analysis commercial data licence.