Artificial Analysis

Name: Artificial Analysis results
Creator: Artificial Analysis
License: https://artificialanalysis.ai/

Share of questions answered correctly over long documents, as run by Artificial Analysis with its own harness and prompts.

Last updated 20 Oct 2026

Results dated: 20 Oct 2026
Results: 399 configurations of 239 models
Unit: % of questions
Licence: Artificial Analysis commercial data licence

Long-context reasoning (AA-LCR): Muse Spark Open

Top 15 of 399 results · % of questions, higher is better. Choose a model to highlight it.Clear highlight

1 Kimi K3 (max reasoning)Moonshot AI 88.7%
2 MiMo-V2.6-ProXiaomi 86.3%
3 Claude Fable 5.1 (max reasoning)Anthropic 85.3%
4 Claude Fable 5.1 (medium reasoning)Anthropic 84.7%
4 Claude Opus 5.5 (max reasoning)Anthropic 84.7%
4 Claude Opus 5.5 (extra-high reasoning)Anthropic 84.7%
7 Claude Opus 5.5 (medium reasoning)Anthropic 84.3%
7 GPT-5.5 (high reasoning)OpenAI 84.3%
7 GPT-5.5 (extra-high reasoning)OpenAI 84.3%
10 DeepSeek-V4.1-Flash (max reasoning)DeepSeek 84.0%
10 Gemini 3.8 Flash (medium reasoning)Google 84.0%
10 GPT-5.6 Sol (max reasoning)OpenAI 84.0%
10 GPT-6.1 Sol (low reasoning)OpenAI 84.0%
14 Claude Fable 5.1 (high reasoning)Anthropic 83.7%
14 GPT-5.6 Luna (max reasoning)OpenAI 83.7%
⋯
103 Muse Spark Open (extra-high reasoning)Meta 78.3%

Full results

Artificial Analysis: Long-context reasoning (AA-LCR), % of questions, higher is better
#	Model	Long-context reasoning (AA-LCR) % of questions, higher is better	Price $ per million tokens, in / out
1	Kimi K3 (max reasoning)Moonshot AI	88.7%	$3 / $15
2	MiMo-V2.6-ProXiaomi	86.3%	$0.43 / $0.87
3	Claude Fable 5.1 (max reasoning)Anthropic	85.3%	$10 / $50
4	Claude Fable 5.1 (medium reasoning)Anthropic	84.7%	$10 / $50
4	Claude Opus 5.5 (max reasoning)Anthropic	84.7%	$4 / $20
4	Claude Opus 5.5 (extra-high reasoning)Anthropic	84.7%	$4 / $20
7	Claude Opus 5.5 (medium reasoning)Anthropic	84.3%	$4 / $20
7	GPT-5.5 (high reasoning)OpenAI	84.3%	$5 / $30
7	GPT-5.5 (extra-high reasoning)OpenAI	84.3%	$5 / $30
10	DeepSeek-V4.1-Flash (max reasoning)DeepSeek	84.0%	$0.30 / $1.20
10	Gemini 3.8 Flash (medium reasoning)Google	84.0%	$1.50 / $7.50
10	GPT-5.6 Sol (max reasoning)OpenAI	84.0%	$4 / $20
10	GPT-6.1 Sol (low reasoning)OpenAI	84.0%	$2 / $10
14	Claude Fable 5.1 (high reasoning)Anthropic	83.7%	$10 / $50
14	GPT-5.6 Luna (max reasoning)OpenAI	83.7%	$0.20 / $1.20
14	GPT-6 Sol (high reasoning)OpenAI	83.7%	$2 / $10
14	GPT-6 Sol (max reasoning)OpenAI	83.7%	$2 / $10
18	Muse Glimmer (high reasoning)Meta	83.3%	–
18	GPT-5.3-Codex (extra-high reasoning)OpenAI	83.3%	$1.75 / $14
18	GPT-6.1 Sol (medium reasoning)OpenAI	83.3%	$2 / $10
18	GPT-6 Luna (max reasoning)OpenAI	83.3%	$0.10 / $0.50
22	Claude Fable 5.1 (extra-high reasoning)Anthropic	83.0%	$10 / $50
22	Gemini 3.7 Flash (medium reasoning)Google	83.0%	$1.50 / $7.50
22	Muse Spark 1.3 (max reasoning)Meta	83.0%	$1.25 / $4.25
22	Muse Spark 1.3 (extra-high reasoning)Meta	83.0%	$1.25 / $4.25
22	MiniMax-M3MiniMax	83.0%	$0.30 / $1.20
22	GPT-5.5 (medium reasoning)OpenAI	83.0%	$5 / $30
22	GPT-5.6 Terra (max reasoning)OpenAI	83.0%	$2 / $12
22	GPT-6.1 Sol (max reasoning)OpenAI	83.0%	$2 / $10
30	Claude Haiku 5.5 (max reasoning)Anthropic	82.7%	$0.10 / $0.50
30	Claude Opus 5.5 (high reasoning)Anthropic	82.7%	$4 / $20
30	Claude Sonnet 5.5 (max reasoning)Anthropic	82.7%	$2 / $10
30	DeepSeek-V4.1-Flash-1017 (max reasoning)DeepSeek	82.7%	$0.30 / $1.20
30	GPT-5.2 (extra-high reasoning)OpenAI	82.7%	$1.75 / $14
35	Claude Fable 5.1 (low reasoning)Anthropic	82.3%	$10 / $50
35	Claude Fable 5 (max reasoning)Anthropic	82.3%	$10 / $50
35	GPT-5.2-Codex (extra-high reasoning)OpenAI	82.3%	$1.75 / $14
35	GPT-5.6 Sol (extra-high reasoning)OpenAI	82.3%	$4 / $20
35	GPT-6.1 Sol (high reasoning)OpenAI	82.3%	$2 / $10
35	GPT-6 Sol (medium reasoning)OpenAI	82.3%	$2 / $10
41	Qwen3.8-27B (extra-high reasoning)Alibaba	82.0%	$0.50 / $3
41	Claude Opus 5 (medium reasoning)Anthropic	82.0%	$5 / $25
41	Claude Sonnet 5 (max reasoning)Anthropic	82.0%	$2 / $10
41	Gemini 3.1 Pro PreviewGoogle	82.0%	$2 / $12
41	GPT-5.4 (extra-high reasoning)OpenAI	82.0%	$2.50 / $15
46	Gemini 3.7 Flash (high reasoning)Google	81.7%	$1.50 / $7.50
46	GPT-5.6 Luna (extra-high reasoning)OpenAI	81.7%	$0.20 / $1.20
46	GPT-5.6 Sol (high reasoning)OpenAI	81.7%	$4 / $20
49	Claude Opus 5 (low reasoning)Anthropic	81.3%	$5 / $25
49	DeepSeek-V4-Flash-Vision-Exp (max reasoning)DeepSeek	81.3%	$0.44 / $1.32
49	Gemini 3.8 Flash (high reasoning)Google	81.3%	$1.50 / $7.50
49	Mistral Large 4Mistral AI	81.3%	$1.36 / $4.18
49	GPT-6 Sol (extra-high reasoning)OpenAI	81.3%	$2 / $10
54	Kimi K2.6Moonshot AI	81.0%	$0.95 / $4
54	GPT-5.5 (low reasoning)OpenAI	81.0%	$5 / $30
54	Grok 4.6 (medium reasoning)xAI	81.0%	$2 / $6
54	Grok 4.6 (extra-high reasoning)xAI	81.0%	$2 / $6
58	Qwen3.6-Max-PreviewAlibaba	80.7%	$1.03 / $6.16
58	Claude Opus 5.5 (low reasoning)Anthropic	80.7%	$4 / $20
58	Gemini 3.8 Flash (low reasoning)Google	80.7%	$1.50 / $7.50
58	Muse Wonder (max reasoning)Meta	80.7%	$4 / $20
58	GPT-6 Astra (max reasoning)OpenAI	80.7%	$10 / $50
58	Grok 4.6 (low reasoning)xAI	80.7%	$2 / $6
64	Qwen3.8-2.4T-A95BAlibaba	80.3%	$2 / $6
64	Qwen3.8-Max (0902)Alibaba	80.3%	$2 / $6
64	Claude Opus 5 (extra-high reasoning)Anthropic	80.3%	$5 / $25
64	DeepSeek-V4-Pro (0813, max reasoning)DeepSeek	80.3%	$1.32 / $3.96
64	GPT-5.6 Luna (high reasoning)OpenAI	80.3%	$0.20 / $1.20
64	GPT-5.6 Sol (medium reasoning)OpenAI	80.3%	$4 / $20
64	Grok 4.6 (high reasoning)xAI	80.3%	$2 / $6
71	Claude Sonnet 4.6 (max reasoning)Anthropic	80.0%	$3 / $15
71	Gemini 3.6 Flash (high reasoning)Google	80.0%	$1.50 / $7.50
71	GPT-5.1 (high reasoning)OpenAI	80.0%	$1.25 / $10
71	GPT-6 Astra (high reasoning)OpenAI	80.0%	$10 / $50
71	GPT-6 Astra (low reasoning)OpenAI	80.0%	$10 / $50
71	GPT-6 Astra (extra-high reasoning)OpenAI	80.0%	$10 / $50
71	GPT-6 Luna (extra-high reasoning)OpenAI	80.0%	$0.10 / $0.50
71	Grok 4.7 (low reasoning)xAI	80.0%	$2 / $6
71	GLM-5.3-FlashZ.ai	80.0%	$0.15 / $0.50
80	Qwen3.8-27B (medium reasoning)Alibaba	79.7%	$0.50 / $3
80	Qwen3.8-Flash-NextAlibaba	79.7%	–
80	Claude Sonnet 5.5 (extra-high reasoning)Anthropic	79.7%	$2 / $10
80	DeepSeek-V4-Flash (0731, max reasoning)DeepSeek	79.7%	$0.14 / $0.28
80	Gemini 4 Argon (high reasoning)Google	79.7%	$2 / $10
80	MiniMax M3.1 FlashMiniMax	79.7%	$0.15 / $0.60
80	GPT-6.1 Sol (extra-high reasoning)OpenAI	79.7%	$2 / $10
80	GPT-6 Astra (medium reasoning)OpenAI	79.7%	$10 / $50
80	MiMo-V2.5-Pro (reasoning on)Xiaomi	79.7%	$0.43 / $0.87
80	GLM-5.3 (max reasoning)Z.ai	79.7%	$1.40 / $4.40
90	Claude Opus 5 (max reasoning)Anthropic	79.3%	$5 / $25
90	Kimi K2.7 CodeMoonshot AI	79.3%	$0.95 / $4
90	Kimi K3 (low reasoning)Moonshot AI	79.3%	$3 / $15
90	GPT-6 Luna (high reasoning)OpenAI	79.3%	$0.10 / $0.50
90	GPT-6 Sol (low reasoning)OpenAI	79.3%	$2 / $10
90	Grok 4.5 (high reasoning)xAI	79.3%	$2 / $6
96	Qwen3.7-MaxAlibaba	79.0%	$1.48 / $4.42
96	Claude Opus 5 (high reasoning)Anthropic	79.0%	$5 / $25
96	Muse Spark 1.2 (extra-high reasoning)Meta	79.0%	$1.25 / $4.25
96	GPT-5.6 Terra (extra-high reasoning)OpenAI	79.0%	$2 / $12
96	Hy3Tencent	79.0%	$0.14 / $0.58
101	Claude Opus 4.7 (max reasoning)Anthropic	78.7%	$5 / $25
101	Gemini 3.7 Flash (low reasoning)Google	78.7%	$1.50 / $7.50
103	Qwen3.6-PlusAlibaba	78.3%	$0.33 / $1.95
103	Qwen3.8-Max (0803)Alibaba	78.3%	–
103	Claude Haiku 5.5 (extra-high reasoning)Anthropic	78.3%	$0.10 / $0.50
103	Muse Spark Open (extra-high reasoning)Meta	78.3%	–
103	MiniMax-M2.7MiniMax	78.3%	$0.30 / $1.20
103	GPT-6 Luna (medium reasoning)OpenAI	78.3%	$0.10 / $0.50
103	GLM-5.2 (max reasoning)Z.ai	78.3%	$1.40 / $4.40
110	GPT-5 (high reasoning)OpenAI	78.2%	$1.25 / $10
111	Claude Opus 4.6 (max reasoning)Anthropic	78.0%	$5 / $25
111	Claude Sonnet 5.5 (high reasoning)Anthropic	78.0%	$2 / $10
111	Gemini 3 Flash Preview (reasoning on)Google	78.0%	$0.50 / $3
111	Muse SparkMeta	78.0%	–
111	Kimi K2.5Moonshot AI	78.0%	$0.57 / $2.85
111	GPT-5.6 Sol (low reasoning)OpenAI	78.0%	$4 / $20
111	Beam 1.0 501B A23BReflection	78.0%	–
118	Qwen3.5-27BAlibaba	77.7%	$0.27 / $2.16
118	Claude Opus 4.8 (max reasoning)Anthropic	77.7%	$5 / $25
118	Muse Spark 1.1 (extra-high reasoning)Meta	77.7%	$1.25 / $4.25
118	GPT-5.6 Terra (high reasoning)OpenAI	77.7%	$2 / $12
122	Qwen3.5-397B-A17BAlibaba	77.3%	$0.55 / $3.50
122	Qwen3.6-27BAlibaba	77.3%	$0.30 / $3.20
122	Qwen3.8-27B (low reasoning)Alibaba	77.3%	$0.50 / $3
122	Claude Haiku 5.5 (high reasoning)Anthropic	77.3%	$0.10 / $0.50
122	Claude Haiku 5.5 (medium reasoning)Anthropic	77.3%	$0.10 / $0.50
122	Claude Opus 4.5 (reasoning on)Anthropic	77.3%	$5 / $25
122	Inkling (extra-high reasoning)Thinking Machines	77.3%	$0.95 / $4.05
129	GPT-5.4 mini (extra-high reasoning)OpenAI	77.0%	$0.75 / $4.50
129	Grok 4.7 (high reasoning)xAI	77.0%	$2 / $6
131	Claude Sonnet 5 (high reasoning)Anthropic	76.7%	$2 / $10
131	Claude Sonnet 5 (extra-high reasoning)Anthropic	76.7%	$2 / $10
131	GPT-5.4 nano (extra-high reasoning)OpenAI	76.7%	$0.20 / $1.25
131	GPT-5.4 (low reasoning)OpenAI	76.7%	$2.50 / $15
131	Grok 4.7 (extra-high reasoning)xAI	76.7%	$2 / $6
136	Qwen3.5-122B-A10BAlibaba	76.3%	$0.26 / $2.08
136	Claude Sonnet 5.5 (medium reasoning)Anthropic	76.3%	$2 / $10
138	Claude Opus 4.1 (reasoning on)Anthropic	76.0%	$15 / $75
138	Claude Sonnet 5.5 (low reasoning)Anthropic	76.0%	$2 / $10
138	Gemini 3.5 Flash-LiteGoogle	76.0%	$0.30 / $2.50
138	Gemini 3 Pro Preview (high reasoning)Google	76.0%	–
138	GPT-5 (medium reasoning)OpenAI	76.0%	$1.25 / $10
143	Claude Opus 4.7 (no reasoning)Anthropic	75.7%	$5 / $25
143	Inkling SmallThinking Machines	75.7%	$0.45 / $1.20
143	GLM-5Z.ai	75.7%	$0.95 / $2.55
146	GPT-5.6 Luna (medium reasoning)OpenAI	75.0%	$0.20 / $1.20
146	Grok 4.3 (medium reasoning)xAI	75.0%	$1.25 / $2.50
148	DeepSeek-V4-Pro (0423, max reasoning)DeepSeek	74.7%	$1.42 / $2.83
148	o3OpenAI	74.7%	$2 / $8
148	Grok Build 0.1xAI	74.7%	$1 / $2
151	Qwen3-Max-ThinkingAlibaba	74.3%	$0.78 / $3.90
151	Claude Haiku 4.5 (reasoning on)Anthropic	74.3%	$1 / $5
151	DeepSeek-V4-Flash (0423, max reasoning)DeepSeek	74.3%	$0.14 / $0.28
151	Gemini 3.1 Flash-Lite PreviewGoogle	74.3%	$0.25 / $1.50
151	Gemini 3.5 Flash (medium reasoning)Google	74.3%	$1.50 / $9
151	MiMo-V2.6-FlashXiaomi	74.3%	$0.14 / $0.28
157	Gemini 3 Pro Preview (low reasoning)Google	74.0%	–
157	GPT-5.6 Terra (medium reasoning)OpenAI	74.0%	$2 / $12
157	GPT-6 Luna (low reasoning)OpenAI	74.0%	$0.10 / $0.50
157	Grok 4.1 Fast (reasoning)xAI	74.0%	–
157	Grok 4.3 (low reasoning)xAI	74.0%	$1.25 / $2.50
162	Claude Sonnet 5 (medium reasoning)Anthropic	73.7%	$2 / $10
162	Grok 4 Fast (reasoning)xAI	73.7%	–
162	GLM-5.1Z.ai	73.7%	$1.38 / $4.40
165	DeepSeek-V3.2 (reasoning on)DeepSeek	73.3%	$0.30 / $0.96
165	Gemini 3.5 Flash (high reasoning)Google	73.3%	$1.50 / $9
165	MiniMax-M2.5MiniMax	73.3%	$0.30 / $1.20
168	Qwen3.7-PlusAlibaba	73.0%	$0.32 / $1.28
168	Grok 4.3 (high reasoning)xAI	73.0%	$1.25 / $2.50
168	MiMo-V2.5Xiaomi	73.0%	$0.17 / $0.34
171	GLM-5.3 (low reasoning)Z.ai	72.7%	$1.40 / $4.40
172	Claude Sonnet 4.5 (reasoning on)Anthropic	72.3%	$3 / $15
172	DeepSeek-V3.2-Exp (reasoning on)DeepSeek	72.3%	$0.27 / $0.41
172	GPT-5 mini (high reasoning)OpenAI	72.3%	$0.25 / $2
172	GPT-5 mini (medium reasoning)OpenAI	72.3%	$0.25 / $2
176	Qwen3-235B-A22B-Thinking-2507Alibaba	72.0%	$0.30 / $3
176	Qwen3.5-35B-A3BAlibaba	72.0%	$0.16 / $1.30
176	Claude Haiku 5.5 (low reasoning)Anthropic	72.0%	$0.10 / $0.50
176	DeepSeek-V4-Flash (0423, high reasoning)DeepSeek	72.0%	$0.14 / $0.28
176	Kimi K2 ThinkingMoonshot AI	72.0%	$0.60 / $2.50
181	Qwen3.6-35B-A3BAlibaba	71.7%	$0.10 / $1
181	GPT-5-Codex (high reasoning)OpenAI	71.7%	–
181	GLM-5-TurboZ.ai	71.7%	$1.20 / $4
184	GPT-5.6 Terra (low reasoning)OpenAI	71.3%	$2 / $12
185	Gemini 2.5 Flash Preview (09-2025, reasoning on)Google	71.0%	–
185	GLM-4.7Z.ai	71.0%	$0.54 / $1.98
187	Claude Opus 4.5 (no reasoning)Anthropic	70.7%	$5 / $25
187	Solar Pro 4Upstage	70.7%	$0.09 / $0.36
189	Claude Sonnet 4 (reasoning on)Anthropic	70.3%	$3 / $15
189	DeepSeek-V4-Pro (0423, high reasoning)DeepSeek	70.3%	$1.42 / $2.83
189	GPT-5.2 (medium reasoning)OpenAI	70.3%	$1.75 / $14
189	GLM-5V-TurboZ.ai	70.3%	$1.20 / $4
193	Qwen3.5-9BAlibaba	70.0%	$0.10 / $0.15
193	Claude Sonnet 5 (no reasoning)Anthropic	70.0%	$2 / $10
193	DeepSeek-V3.2-SpecialeDeepSeek	70.0%	–
193	GPT-5.5 Instant (2026-06-26)OpenAI	70.0%	–
193	GPT-5.6 Luna (low reasoning)OpenAI	70.0%	$0.20 / $1.20
198	Gemma 4 31BGoogle	69.7%	$0.14 / $0.40
198	Kimi K2.6 (no reasoning)Moonshot AI	69.7%	$0.95 / $4
200	Qwen3.8-27B (no reasoning)Alibaba	69.3%	$0.50 / $3
200	DeepSeek-V3.1-Terminus (reasoning on)DeepSeek	69.3%	$0.27 / $1
200	Mistral Medium 3.5Mistral AI	69.3%	$1.50 / $7.50
200	GPT-5.1-Codex (high reasoning)OpenAI	69.3%	$1.25 / $10
204	Gemini 2.5 ProGoogle	69.0%	$1.25 / $10
204	Nemotron 3.5 Super VLNVIDIA	69.0%	–
204	Grok 4.20xAI	69.0%	$1.25 / $2.50
207	Claude Sonnet 4.6 (no reasoning)Anthropic	68.3%	$3 / $15
207	GPT-4.1OpenAI	68.3%	$2 / $8
209	Grok 4xAI	68.0%	–
210	MiniMax-M2.1MiniMax	67.7%	$0.30 / $1.20
210	Grok 4.20 (0309, reasoning)xAI	67.7%	–
212	Claude Sonnet 5 (low reasoning)Anthropic	67.3%	$2 / $10
212	Kimi K2.5 (no reasoning)Moonshot AI	67.3%	$0.57 / $2.85
212	GPT-5.4 nano (medium reasoning)OpenAI	67.3%	$0.20 / $1.25
215	Claude Opus 4.6 (no reasoning)Anthropic	67.0%	$5 / $25
215	GPT-5.4 mini (medium reasoning)OpenAI	67.0%	$0.75 / $4.50
217	Qwen3.6-27B (no reasoning)Alibaba	66.7%	$0.30 / $3.20
217	GPT-5.1-Codex-Mini (high reasoning)OpenAI	66.7%	$0.25 / $2
219	GPT-5.5 Instant (2026-05-26)OpenAI	66.3%	–
220	Gemma 4 26B A4BGoogle	65.7%	$0.10 / $0.30
220	Nemotron 3 Super 120B A12BNVIDIA	65.7%	$0.085 / $0.40
222	Gemini 2.5 Flash (reasoning on)Google	65.3%	$0.30 / $2.50
223	GPT-5 ChatOpenAI	65.0%	–
223	o1OpenAI	65.0%	$15 / $60
225	Gemini 2.5 Flash-Lite Preview (09-2025, reasoning on)Google	64.7%	–
225	Hy3 Preview (reasoning on)Tencent	64.7%	$0.18 / $0.60
227	Qwen3.5-397B-A17B (no reasoning)Alibaba	64.3%	$0.55 / $3.50
227	Qwen3.6-35B-A3B (no reasoning)Alibaba	64.3%	$0.10 / $1
227	MiniMax-M2MiniMax	64.3%	$0.30 / $1.20
230	Qwen3.5-27B (no reasoning)Alibaba	64.0%	$0.27 / $2.16
230	GPT-5.5 (no reasoning)OpenAI	64.0%	$5 / $30
230	GPT-6 Sol (no reasoning)OpenAI	64.0%	$2 / $10
233	Qwen3.5-Omni-PlusAlibaba	63.7%	–
233	Qwen3-Next-80B-A3B-ThinkingAlibaba	63.7%	$0.15 / $1.20
233	Qwen3-VL-235B-A22B-ThinkingAlibaba	63.7%	$0.40 / $4
233	Gemma 4 12BGoogle	63.7%	–
237	Qwen3.5-35B-A3B (no reasoning)Alibaba	63.0%	$0.16 / $1.30
237	Qwen3.5-4B (reasoning on)Alibaba	63.0%	–
239	GPT-5.6 Sol (no reasoning)OpenAI	62.3%	$4 / $20
240	Qwen3-Max-Thinking-PreviewAlibaba	62.0%	–
241	Qwen3-30B-A3B-Thinking-2507Alibaba	61.3%	$0.20 / $2.40
241	Qwen3.5-122B-A10B (no reasoning)Alibaba	61.3%	$0.26 / $2.08
241	Gemini 3.5 Flash (minimal reasoning)Google	61.3%	$1.50 / $9
244	o4-mini (high reasoning)OpenAI	61.0%	$1.10 / $4.40
245	Nova 2 Lite (high reasoning)Amazon	60.3%	$0.30 / $2.50
246	Nova 2 Lite (medium reasoning)Amazon	60.0%	$0.30 / $2.50
246	Gemini 2.5 Flash Preview (09-2025, no reasoning)Google	60.0%	–
248	GPT-5.6 Terra (no reasoning)OpenAI	58.7%	$2 / $12
249	GPT-5.4 (no reasoning)OpenAI	58.3%	$2.50 / $15
250	DeepSeek-R1DeepSeek	57.7%	$0.70 / $2.50
251	DeepSeek-V3.1 (reasoning on)DeepSeek	56.7%	$0.55 / $1.65
252	DeepSeek-R1-0528DeepSeek	55.7%	$0.50 / $2.18
252	Gemini 2.5 Flash-Lite (reasoning on)Google	55.7%	$0.10 / $0.40
254	Qwen3-VL-32B-ThinkingAlibaba	55.3%	–
254	DeepSeek-V4.1-Flash (no reasoning)DeepSeek	55.3%	$0.30 / $1.20
254	Gemini 3 Flash Preview (no reasoning)Google	55.3%	$0.50 / $3
257	Nova 2 Lite (low reasoning)Amazon	54.3%	$0.30 / $2.50
258	Claude Sonnet 4.5 (no reasoning)Anthropic	54.0%	$3 / $15
258	GLM-4.6 (reasoning on)Z.ai	54.0%	$0.50 / $2
260	GLM-5.1 (no reasoning)Z.ai	53.3%	$1.38 / $4.40
261	DeepSeek-V4-Pro (0423, no reasoning)DeepSeek	53.0%	$1.42 / $2.83
261	Magistral Medium 1.2Mistral AI	53.0%	–
261	Kimi K2 (0905)Moonshot AI	53.0%	$0.60 / $2.50
261	Kimi K2 (0711)Moonshot AI	53.0%	$0.57 / $2.30
261	Grok Code Fast 1xAI	53.0%	–
266	Qwen3-Next-80B-A3B-InstructAlibaba	52.7%	$0.10 / $1.10
266	GLM-4.5Z.ai	52.7%	$0.60 / $2.20
268	Qwen3.5-Omni-FlashAlibaba	52.0%	–
268	gpt-oss-120b (high reasoning)OpenAI	52.0%	$0.15 / $0.60
270	DeepSeek-V4-Pro (0813, no reasoning)DeepSeek	50.7%	$1.32 / $3.96
271	Qwen3-MaxAlibaba	50.0%	$0.78 / $3.90
271	Llama 4 MaverickMeta	50.0%	$0.27 / $0.85
271	Step 3.5 FlashStepFun	50.0%	$0.10 / $0.30
274	Gemini 2.5 Flash (no reasoning)Google	49.9%	$0.30 / $2.50
275	Claude Haiku 4.5 (no reasoning)Anthropic	49.7%	$1 / $5
275	Gemini 2.5 Flash-Lite Preview (09-2025, no reasoning)Google	49.7%	–
275	Mistral Small 4Mistral AI	49.7%	$0.15 / $0.60
278	GLM-4.6V (reasoning on)Z.ai	48.7%	$0.30 / $0.90
279	Qwen3-Coder-NextAlibaba	47.0%	$0.18 / $0.90
279	DeepSeek-V3.1 (no reasoning)DeepSeek	47.0%	$0.55 / $1.65
281	Gemma 4 31B (no reasoning)Google	46.7%	$0.14 / $0.40
281	GLM-4.5-AirZ.ai	46.7%	$0.14 / $0.86
283	Qwen3.5-9B (no reasoning)Alibaba	46.0%	$0.10 / $0.15
283	gpt-oss-120b (low reasoning)OpenAI	46.0%	$0.15 / $0.60
285	Qwen3-Coder-480B-A35BAlibaba	45.7%	$0.35 / $1.50
285	DeepSeek-V3.2 (no reasoning)DeepSeek	45.7%	$0.30 / $0.96
285	GPT-5.2 (no reasoning)OpenAI	45.7%	$1.75 / $14
288	DeepSeek-V3.1-Terminus (no reasoning)DeepSeek	45.3%	$0.27 / $1
289	Granite 4.2 8BIBM	45.0%	$0.06 / $0.25
289	GPT-5.1 (no reasoning)OpenAI	45.0%	$1.25 / $10
289	GPT-5 nano (high reasoning)OpenAI	45.0%	$0.05 / $0.40
292	DeepSeek-V3.2-Exp (no reasoning)DeepSeek	44.7%	$0.27 / $0.41
293	Claude Sonnet 4 (no reasoning)Anthropic	44.0%	$3 / $15
293	GPT-4.1 miniOpenAI	44.0%	$0.40 / $1.60
295	Mercury 2Inception	43.7%	$0.25 / $0.75
295	GPT-5 nano (medium reasoning)OpenAI	43.7%	$0.05 / $0.40
295	GLM-5 (no reasoning)Z.ai	43.7%	$0.95 / $2.55
298	Qwen3-Max-PreviewAlibaba	43.0%	–
298	o3-mini (high reasoning)OpenAI	43.0%	$1.10 / $4.40
300	Mistral Medium 3.1Mistral AI	42.7%	$0.40 / $2
300	GPT-5.6 Luna (no reasoning)OpenAI	42.7%	$0.20 / $1.20
302	Gemma 4 26B A4B (no reasoning)Google	42.3%	$0.10 / $0.30
302	GLM-5.2 (no reasoning)Z.ai	42.3%	$1.40 / $4.40
304	Hy3 Preview (no reasoning)Tencent	42.0%	$0.18 / $0.60
305	DeepSeek-V4-Flash (0423, no reasoning)DeepSeek	41.7%	$0.14 / $0.28
305	MiMo-V2.5-Pro (no reasoning)Xiaomi	41.7%	$0.43 / $0.87
305	GLM-4.7-FlashZ.ai	41.7%	$0.06 / $0.40
308	GPT-4o (2024-08-06)OpenAI	41.0%	$2.50 / $10
309	DeepSeek-V3-0324DeepSeek	40.7%	$0.25 / $1
309	GLM-4.7 (no reasoning)Z.ai	40.7%	$0.54 / $1.98
311	GPT-6 Luna (no reasoning)OpenAI	39.7%	$0.10 / $0.50
312	GPT-5 mini (minimal reasoning)OpenAI	39.3%	$0.25 / $2
313	Trinity Large ThinkingArcee AI	38.0%	$0.25 / $0.80
313	Nemotron 3 Nano 30B A3B (reasoning on)NVIDIA	38.0%	$0.05 / $0.20
315	Qwen3-4B-Thinking-2507Alibaba	37.3%	–
316	GPT-5.4 mini (no reasoning)OpenAI	37.0%	$0.75 / $4.50
317	Mistral Large 3Mistral AI	36.0%	$0.50 / $1.50
318	Gemma 4 12B (no reasoning)Google	35.0%	–
319	Qwen3.5-4B (no reasoning)Alibaba	34.7%	–
319	gpt-oss-20b (high reasoning)OpenAI	34.7%	$0.03 / $0.15
321	Qwen3-235B-A22B-Instruct-2507Alibaba	33.9%	$0.15 / $0.75
322	Qwen3-VL-8B-ThinkingAlibaba	33.3%	$0.18 / $2.10
323	Qwen3-Coder-30B-A3B-InstructAlibaba	32.7%	$0.07 / $0.28
323	Qwen3-VL-235B-A22B-InstructAlibaba	32.7%	$0.30 / $1.50
325	Devstral 2Mistral AI	32.3%	$0.40 / $2
325	Solar Pro 3Upstage	32.3%	$0.15 / $0.60
325	Grok 4.3 (no reasoning)xAI	32.3%	$1.25 / $2.50
328	Gemini 2.5 Flash-Lite (no reasoning)Google	32.0%	$0.10 / $0.40
328	Gemma 4 E4BGoogle	32.0%	–
328	Devstral MediumMistral AI	32.0%	–
331	Mistral Medium 3Mistral AI	31.3%	$0.40 / $2
331	Grok 4.1 Fast (non-reasoning, no reasoning)xAI	31.3%	–
333	gpt-oss-20b (low reasoning)OpenAI	31.0%	$0.03 / $0.15
334	GPT-5.4 nano (no reasoning)OpenAI	29.7%	$0.20 / $1.25
335	DeepSeek-V3DeepSeek	29.3%	$0.26 / $1.03
336	Mistral Small 4 (no reasoning)Mistral AI	28.3%	$0.15 / $0.60
337	Devstral Small 2Mistral AI	28.0%	–
337	Kimi Linear 48B A3B InstructMoonshot AI	28.0%	–
339	Llama 4 ScoutMeta	27.7%	$0.18 / $0.59
340	Qwen3-30B-A3B-Instruct-2507Alibaba	26.3%	$0.09 / $0.30
340	Ministral 3 14BMistral AI	26.3%	$0.20 / $0.20
340	GLM-4.6 (no reasoning)Z.ai	26.3%	$0.50 / $2
343	Ministral 3 8BMistral AI	25.7%	$0.15 / $0.15
344	Grok 4.20 (0309, non-reasoning, no reasoning)xAI	25.3%	–
345	Gemma 4 E4B (no reasoning)Google	24.0%	–
345	Grok 4 Fast (non-reasoning, no reasoning)xAI	24.0%	–
347	Grok 4.20 (no reasoning)xAI	23.3%	$1.25 / $2.50
348	Mistral Small 3.1 24BMistral AI	22.3%	$0.35 / $0.56
349	Qwen3-VL-4B-ThinkingAlibaba	21.3%	–
349	Command ACohere	21.3%	$2.50 / $10
351	Qwen3.5-2B (reasoning on)Alibaba	21.0%	–
351	Nova Pro 1.0Amazon	21.0%	$0.80 / $3.20
353	Mistral Small 3.2 24BMistral AI	20.3%	$0.094 / $0.25
353	GPT-4.1 nanoOpenAI	20.3%	$0.10 / $0.40
353	GLM-4.7-Flash (no reasoning)Z.ai	20.3%	$0.06 / $0.40
356	GPT-5 nano (minimal reasoning)OpenAI	20.0%	$0.05 / $0.40
357	DiffusionGemma 26B A4BGoogle	19.7%	–
358	Magistral Small 1.2Mistral AI	19.3%	–
359	Nova Lite 1.0Amazon	19.0%	$0.06 / $0.24
360	Nova 2 Lite (no reasoning)Amazon	18.7%	$0.30 / $2.50
360	Devstral Small 1.1Mistral AI	18.7%	–
362	Llama 3.1 8B InstructMeta	18.0%	$0.05 / $0.08
363	Ministral 3 3BMistral AI	17.0%	$0.10 / $0.10
363	GLM-4.6V (no reasoning)Z.ai	17.0%	$0.30 / $0.90
365	Qwen3-VL-8B-InstructAlibaba	16.7%	$0.12 / $0.46
366	Gemma 4 E2B (no reasoning)Google	16.3%	–
366	Gemma 4 E2BGoogle	16.3%	–
368	Llama 3.3 70B InstructMeta	15.7%	$0.59 / $0.79
369	Qwen3.5-2B (no reasoning)Alibaba	14.0%	–
369	Qwen3-VL-4B-InstructAlibaba	14.0%	–
371	Nova Micro 1.0Amazon	13.0%	$0.035 / $0.14
372	Qwen3-4B-Instruct-2507Alibaba	11.3%	–
373	Nemotron 3 Nano 30B A3B (no reasoning)NVIDIA	10.7%	$0.05 / $0.20
374	Qwen3.5-0.8B (reasoning on)Alibaba	9.0%	–
375	Gemma 3 12BGoogle	8.3%	$0.05 / $0.15
376	Qwen3.5-0.8B (no reasoning)Alibaba	8.0%	–
377	Gemma 3 27BGoogle	7.3%	$0.12 / $0.20
378	Gemma 3 4BGoogle	6.7%	$0.05 / $0.10
378	Llama 3.2 1B InstructMeta	6.7%	$0.027 / $0.20
380	Llama 3.2 3B InstructMeta	4.3%	$0.05 / $0.33
381	Mistral Large 2 (2407)Mistral AI	2.0%	$2 / $6
382	Qwen3-14B (no reasoning)Alibaba	0.0%	$0.12 / $0.24
382	Qwen3-14B (reasoning on)Alibaba	0.0%	$0.12 / $0.24
382	Qwen3-235B-A22B (no reasoning)Alibaba	0.0%	$0.46 / $1.82
382	Qwen3-235B-A22B (reasoning on)Alibaba	0.0%	$0.46 / $1.82
382	Qwen3-30B-A3B (no reasoning)Alibaba	0.0%	$0.12 / $0.50
382	Qwen3-30B-A3B (reasoning on)Alibaba	0.0%	$0.12 / $0.50
382	Qwen3-32B (no reasoning)Alibaba	0.0%	$0.14 / $0.40
382	Qwen3-32B (reasoning on)Alibaba	0.0%	$0.14 / $0.40
382	Qwen3-8B (no reasoning)Alibaba	0.0%	$0.12 / $0.46
382	Qwen3-8B (reasoning on)Alibaba	0.0%	$0.12 / $0.46
382	Qwen3-Omni-30B-A3B-InstructAlibaba	0.0%	–
382	Qwen3-Omni-30B-A3B-ThinkingAlibaba	0.0%	–
382	Gemma 3 270MGoogle	0.0%	–
382	Phi-4Microsoft	0.0%	$0.07 / $0.14
382	Mistral Small 3Mistral AI	0.0%	$0.05 / $0.08
382	Reka Flash 3Reka AI	0.0%	$0.10 / $0.20
382	GLM-4.5V (no reasoning)Z.ai	0.0%	$0.60 / $1.80
382	GLM-4.5V (reasoning on)Z.ai	0.0%	$0.60 / $1.80

Swipe the table sideways for more columns.

Ranks follow the score as shown, so equal numbers share a rank. Results as published by Artificial Analysis; we do not re-run them.

Progress over time

Long-context reasoning (AA-LCR), plotted at each model's release date, higher is better. Each model counts once, at its best setting. Scores are today's, not launch day's. Hover or tap a mark for its model.

Best score so far

Every model at its release date. The line moves each time a new release beats every earlier one, and each new best is named where there is room.

Best score by lab

Each lab's best so far, stepping whenever one of its releases beats its own earlier models. The 6 labs with the best scores today; 19 others not drawn.

Moonshot AIXiaomiAnthropicOpenAIDeepSeekGoogle

What it measures

Share of questions answered correctly over long documents, as run by Artificial Analysis with its own harness and prompts.

What it does not measure

Not retrieval over your own document store.

Source

Artificial Analysis · Methodology

285 results from Artificial Analysis not ranked here · show why

We rank a result only when we can tie it to a specific model you can use. These are left out:

Not on sale through the API providers we track: 270
A different snapshot or variant from the model we list: 14
An unusual combination of settings: 1

Data sourced from Artificial Analysis. Licence: Artificial Analysis commercial data licence.