Models / GPT-6.1 Sol

OpenAI

GPT-6.1 Sol

GPT-6.1 Sol is best for reasoning and knowledge, and product listings; pick it when quality matters more than cost. The cheapest model of similar intelligence is Muse Spark 1.3, at $2.00 per million tokens against $4.00.

Results 16 Nov 2026 · 168 results · 9 sources

Test GPT-6.1 Sol on your prompt → It runs beside the models you could use instead, with every answer checked and costed.

Price per million tokens
$2.00 in · $10.00 out
OpenAI's list price, 10 Nov 2026 · compare prices$0.10 cached input · 50% off in batch
Speed
53 tokens a second; on its test prompt the answer starts after 4.2 min, thinking time included
Artificial Analysis, on its usual API, at max reasoning; 45–53 across 5 settings
Intelligence Index
51.8
Artificial Analysis, at max reasoning; 42.1–51.8 across 5 settings
Spring Prompt overall
3rd of 36 score 80 of 100 · how it works
Spring Prompt Score
92 of 100 1st of 32 · 4 of 5 benchmarks · our own tests only
Developer
OpenAI, based in the US
Weights not published
Released
29 Sep 2026
1,050,000 tokens of context

Where it stands among the models you could choose

Available models grouped by price, intelligence, speed and developer location. Retired models are excluded.

AmongIntelligence IndexSpring Prompt overallPrice, blendedSpeed
Models available today 7th of 185Claude Opus 5.5 3rd of 35Claude Fable 5.2 $4.00 blended, 83rd percentilecheapest: Mistral Nemo 56th of 65Nemotron 3.5 Super VL
Models priced $3–10 per million tokens 5th of 38Claude Opus 5.5 2nd of 15Claude Opus 5.5 sets this group 12th of 15Mistral Medium 3.5
Models with similar intelligence sets this group 1st of 6leads $4.00 blended, 14th percentilecheapest: Muse Spark 1.3 5th of 5Muse Spark 1.3
Models writing 50–100 tokens a second 4th of 21Claude Opus 5.5 2nd of 7Claude Opus 5.5 $4.00 blended, 80th percentilecheapest: Granite 4.2 8B sets this group
Models from developers based in the US 7th of 92Claude Opus 5.5 3rd of 21Claude Fable 5.2 $4.00 blended, 68th percentilecheapest: Gemma 3 4B 30th of 33Nemotron 3.5 Super VL

The name under each rank is the leader of that group; green is the top quarter of the group and red the bottom quarter, by rank. Price is shown as a percentile: the share of the group that costs less, so lower is cheaper. "Sets this group" marks the measure the group is defined by. Spring Prompt overall is our score out of 100 across every source (how it works). Price is the developer's list price (or the typical OpenRouter host where we haven't read one) for three input tokens to one output; intelligence and speed are from Artificial Analysis (data sourced from Artificial Analysis); "similar intelligence" means within 4 points on its Intelligence Index. Developer locations are where each company is based, not where a model is served. Groups under 3 models are not ranked.

Measured cost per task

API cost recorded in our benchmark runs, excluding judging.

TaskBenchmarkCost per task
Product listingCatalogBench≈ $0.008
DeckDeckBench≈ $0.153
Survey plan and analysisSurveyBench≈ $0.143
Game of blitz chessBulletBench≈ $0.077

Cheapest model that passes

On our benchmarks that define a pass for each task: what one passing answer cost in our run, failed attempts included, and whether a cheaper model passed.

  • CatalogBench · cost per 1,000 accepted listings
    GPT-6.1 Sol: $10.75 (131 of 168 attempts), 7 of 25. Cheapest: GPT-6 Luna at $0.70 (114 of 168 attempts). Every cheaper model passed less often.
  • DeckBench · cost per presentable deck
    GPT-6.1 Sol: $0.31 (3 of 6 tasks), 3 of 12. Cheapest: GPT-6.1 Terra at $0.13 (3 of 6 tasks). It passed at least as often.
  • SurveyBench · cost per sound survey task
    GPT-6.1 Sol: $0.21 (6 of 9 tasks), 6 of 12. Cheapest: GPT-6 Luna at $0.03 (3 of 9 tasks). Every cheaper model passed less often.

Cost per attempt divided by the share that passed, at the run date's prices, excluding judging. Each model at its cheapest setting per passing answer. With a handful of tasks, a pass or two either way is within chance. No estimate where a run had missing outputs, because their cost may not have been recorded.

How good is it, and for what?

Each use case ranks the available models its benchmarks measured, then those priced $3–10 per million tokens. The bar shows its percentile in that field, best to the right. Open a row for the results behind it.

Product listingsTurning a sparse product feed and photos into listings that can go live 2nd of 32 available · 1st of 14 at its price
BenchmarkGPT-6.1 SolRank among availableBest available
CatalogBenchCatalogBench: reliably publish-ready 75.0% 1st of 32 GPT-6 Astra 75.0%
CatalogBenchCatalogBench (sales brief): reliably publish-ready 67.9% 2nd of 32 GPT-6 Astra 69.6%
Decks from an analysisTurning a finished analysis into a deck you could present as it is 5th of 32 available · 2nd of 15 at its price
BenchmarkGPT-6.1 SolRank among availableBest available
DeckBenchDeckBench: deck rating 1,391 5th of 32 Qwen4-Max 1,585
User surveysPlanning a user survey and reading its results without being misled 3rd of 23 available · 2nd of 10 at its price
BenchmarkGPT-6.1 SolRank among availableBest available
SurveyBenchSurveyBench: analysis rating 1,432 3rd of 23 Claude Fable 5.2 1,641
Marketing planningPlanning a year of ad spend without overspending Not measured
  • ROASBench: has not measured this model.
Agents and tool useMulti-step tasks with tools: support desks, coding agents, function calls 6th of 159 available · 5th of 35 at its price
BenchmarkGPT-6.1 SolRank among availableBest available
Artificial AnalysisArtificial Analysis: Terminal-Bench 4.0 · reported 56.1% 6th of 107 Kimi K3.1 Pro 67.2%
  • tau2-bench: pending. Its latest results are dated 26 May 2026, before this model was released.
  • Berkeley Function Calling Leaderboard (BFCL) V4: pending. Its latest results are dated 16 Dec 2025, before this model was released.
  • OpenHands Index: pending. Its latest results are dated 30 Jun 2026, before this model was released.
  • Microsoft STATE-Bench: pending. Its latest results are dated 29 May 2026, before this model was released.
  • Vending-Bench 2: has not measured this model.
Professional workReal tasks from banking, consulting and law, business documents and freelance projects 9th of 51 available · 4th of 23 at its price
BenchmarkGPT-6.1 SolRank among availableBest available
APEX-AgentsAPEX-Agents: tasks passed · reported 60.0% 10th of 37 Claude Sonnet 5.5 75.5%
  • GDP.pdf: has not measured this model.
  • Remote Labor Index: has not measured this model.
Reasoning and knowledgeHard questions across science, maths and general knowledge 6th of 187 available · 4th of 39 at its price
BenchmarkGPT-6.1 SolRank among availableBest available
Artificial AnalysisArtificial Analysis: Artificial Analysis Intelligence Index · reported 51.8 7th of 185 Claude Opus 5.5 57.6
Artificial AnalysisArtificial Analysis: Humanity's Last Exam · reported 52.9% 8th of 186 Claude Opus 5.5 61.4%
WritingWhat people prefer in blind comparisons, and judged writing quality 16th of 169 available · 9th of 34 at its price
BenchmarkGPT-6.1 SolRank among availableBest available
Arena (formerly LMArena)Arena Text: overall · reported 1,483 16th of 153 Gemini 4 Argon 1,525
UGI LeaderboardUGI: writing score · reported 67.7 15th of 124 Gemini 3.8 Flash 78.6
Sticking to the factsSummarising without inventing things, and factual answers 18th of 139 available · 6th of 31 at its price
BenchmarkGPT-6.1 SolRank among availableBest available
Arena (formerly LMArena)Arena Text factuality: overall · reported 1,463 33rd of 109 Gemini 4 Argon 1,511
SimpleQA Verified (Epoch AI)SimpleQA Verified: correct answers · reported 73.9% 2nd of 68 GPT-6 Astra 75.6%
  • Vectara Hallucination Leaderboard: pending. Its latest results are dated 22 Sep 2026, before this model was released.
Speed under pressureGood decisions against a real clock (fast chess) 3rd of 35 available · 1st of 14 at its price
BenchmarkGPT-6.1 SolRank among availableBest available
BulletBenchBulletBench Lightning 10+1: ladder Elo 584 4th of 18 Gemini 3.5 Flash-Lite 892
BulletBenchBulletBench Bullet 60s: ladder Elo 928 2nd of 33 Gemini 3.8 Flash 1,068

Nearest alternatives

Against GPT-6.1 Sol at $4.00 blended, Intelligence Index 51.8. "Similar intelligence" means within 4 points or better.

Where to run it

7 hosts on OpenRouter at the standard service tier, with a median of $4.40 blended per million tokens. Cheapest first.

HostQuantisationInputOutputBlended
Amazon Bedrocknot stated$2.00$10.00$4.00
Azurenot stated$2.00$10.00$4.00
OpenAInot stated$2.00$10.00$4.00
Amazon Bedrocknot stated$2.20$11.00$4.40
Azurenot stated$2.20$11.00$4.40
Azurenot stated$2.20$11.00$4.40
OpenAInot stated$12.00$60.00$24.00

Other service tiers, not counted above: OpenAI fast $4.00 in, $20.00 out; OpenAI flex $1.00 in, $5.00 out. Flex and batch are cheaper but slower or queued; priority and fast cost more.

Prices per million tokens from OpenRouter's public endpoint list, checked 10 Nov 2026.

Against the alternatives

The models you would most likely weigh it against: the leaders of the groups above.

Scroll sideways to see every alternative.

GPT-6.1 SolClaude Opus 5.5
most intelligent at $3–10 per million tokens
Muse Spark 1.3
cheapest with similar intelligence
Claude Fable 5.2
highest-scoring overall available today
Price per million tokens $4.00 $8.00$2.00$16.00
Tokens a second 53 96254–
Intelligence Index 51.8 57.648.1–
Spring Prompt overall 80 825990
Rank among available models, by use case
Product listings 2nd of 32 13th17th5th
Decks from an analysis 5th of 32 7th25th4th
User surveys 3rd of 23 4th–1st
Marketing planning – 9th25th1st
Agents and tool use 6th of 159 3rd13th–
Professional work 9th of 51 3rd8th–
Reasoning and knowledge 6th of 187 1st11th–
Writing 16th of 169 5th7th–
Sticking to the facts 18th of 139 3rd11th–
Speed under pressure 3rd of 35 –33rd8th

Shaded figures are better than GPT-6.1 Sol's. A dash means no result.

Research and examples

In the playground: our pick in 8 of 21 tests, 95% of checks passed →

Where it has been measured

Highest-scoring overall of the 6 models with similar intelligence, and 2nd cheapest of the 8 models with similar intelligence. 5th most intelligent of the 38 models priced $3–10 per million tokens. Among models available today, in the top quarter (by percentile) for 9 of the 9 use cases measured, led by reasoning and knowledge, and product listings.

Every result

168 published results from 9 sources, each in the source's own units, with the configuration that produced it.

BulletBench · measured by Spring Prompt · 40 results
MeasureValueRankConfigurationDated
BulletBench Blitz 3+2: cost per gameUS dollars, lower is better $0.0767 11 of 22 GPT-6.1 Sol
provider default reasoning
9 Oct 2026
BulletBench Blitz 3+2: cost per gameUS dollars, lower is better $1.10 22 of 22 GPT-6.1 Sol Ultrafast
provider default reasoning
9 Oct 2026
BulletBench Blitz 3+2: games lost on time% of games, lower is better 37.5% 9 of 22 GPT-6.1 Sol
provider default reasoning
9 Oct 2026
BulletBench Blitz 3+2: games lost on time% of games, lower is better 0.0% 1 of 22 GPT-6.1 Sol Ultrafast
provider default reasoning
9 Oct 2026
BulletBench Blitz 3+2: invalid moves% of moves, lower is better 0.0% 1 of 22 GPT-6.1 Sol
provider default reasoning
9 Oct 2026
BulletBench Blitz 3+2: invalid moves% of moves, lower is better 0.0% 1 of 22 GPT-6.1 Sol Ultrafast
provider default reasoning
9 Oct 2026
BulletBench Blitz 3+2: ladder Eloladder Elo, higher is better 645
0–890
11 of 22 GPT-6.1 Sol
provider default reasoning
9 Oct 2026
BulletBench Blitz 3+2: ladder Eloladder Elo, higher is better 927
657–1,152
5 of 22 GPT-6.1 Sol Ultrafast
provider default reasoning
9 Oct 2026
BulletBench Blitz 3+2: median move timemilliseconds, lower is better 4.8 s 10 of 22 GPT-6.1 Sol
provider default reasoning
9 Oct 2026
BulletBench Blitz 3+2: median move timemilliseconds, lower is better 2.1 s 6 of 22 GPT-6.1 Sol Ultrafast
provider default reasoning
9 Oct 2026
BulletBench Bullet 60s: cost per gameUS dollars, lower is better $0.0210 54 of 71 GPT-6.1 Sol
provider default reasoning
9 Oct 2026
BulletBench Bullet 60s: cost per gameUS dollars, lower is better $0.0243 56 of 71 GPT-6.1 Sol (low reasoning)
low reasoning
9 Oct 2026
BulletBench Bullet 60s: cost per gameUS dollars, lower is better $0.36 71 of 71 GPT-6.1 Sol Ultrafast
provider default reasoning
9 Oct 2026
BulletBench Bullet 60s: cost per gameUS dollars, lower is better $0.34 70 of 71 GPT-6.1 Sol Ultrafast (low reasoning)
low reasoning
9 Oct 2026
BulletBench Bullet 60s: games lost on time% of games, lower is better 91.7% 68 of 71 GPT-6.1 Sol
provider default reasoning
9 Oct 2026
BulletBench Bullet 60s: games lost on time% of games, lower is better 75.0% 54 of 71 GPT-6.1 Sol (low reasoning)
low reasoning
9 Oct 2026
BulletBench Bullet 60s: games lost on time% of games, lower is better 41.7% 39 of 71 GPT-6.1 Sol Ultrafast
provider default reasoning
9 Oct 2026
BulletBench Bullet 60s: games lost on time% of games, lower is better 25.0% 32 of 71 GPT-6.1 Sol Ultrafast (low reasoning)
low reasoning
9 Oct 2026
BulletBench Bullet 60s: invalid moves% of moves, lower is better 0.0% 1 of 71 GPT-6.1 Sol
provider default reasoning
9 Oct 2026
BulletBench Bullet 60s: invalid moves% of moves, lower is better 0.0% 1 of 71 GPT-6.1 Sol (low reasoning)
low reasoning
9 Oct 2026
BulletBench Bullet 60s: invalid moves% of moves, lower is better 0.0% 1 of 71 GPT-6.1 Sol Ultrafast
provider default reasoning
9 Oct 2026
BulletBench Bullet 60s: invalid moves% of moves, lower is better 0.0% 1 of 71 GPT-6.1 Sol Ultrafast (low reasoning)
low reasoning
9 Oct 2026
BulletBench Bullet 60s: ladder Eloladder Elo, higher is better 33
0–270
66 of 71 GPT-6.1 Sol
provider default reasoning
9 Oct 2026
BulletBench Bullet 60s: ladder Eloladder Elo, higher is better 323
51–529
51 of 71 GPT-6.1 Sol (low reasoning)
low reasoning
9 Oct 2026
BulletBench Bullet 60s: ladder Eloladder Elo, higher is better 540
296–765
26 of 71 GPT-6.1 Sol Ultrafast
provider default reasoning
9 Oct 2026
BulletBench Bullet 60s: ladder Eloladder Elo, higher is better 928
676–1,184
2 of 71 GPT-6.1 Sol Ultrafast (low reasoning)
low reasoning
9 Oct 2026
BulletBench Bullet 60s: median move timemilliseconds, lower is better 3.0 s 61 of 71 GPT-6.1 Sol
provider default reasoning
9 Oct 2026
BulletBench Bullet 60s: median move timemilliseconds, lower is better 2.2 s 50 of 71 GPT-6.1 Sol (low reasoning)
low reasoning
9 Oct 2026
BulletBench Bullet 60s: median move timemilliseconds, lower is better 1.7 s 46 of 71 GPT-6.1 Sol Ultrafast
provider default reasoning
9 Oct 2026
BulletBench Bullet 60s: median move timemilliseconds, lower is better 1.4 s 38 of 71 GPT-6.1 Sol Ultrafast (low reasoning)
low reasoning
9 Oct 2026
BulletBench Lightning 10+1: cost per gameUS dollars, lower is better $0.16 47 of 48 GPT-6.1 Sol Ultrafast
provider default reasoning
9 Oct 2026
BulletBench Lightning 10+1: cost per gameUS dollars, lower is better $0.17 48 of 48 GPT-6.1 Sol Ultrafast (low reasoning)
low reasoning
9 Oct 2026
BulletBench Lightning 10+1: games lost on time% of games, lower is better 83.3% 43 of 48 GPT-6.1 Sol Ultrafast
provider default reasoning
9 Oct 2026
BulletBench Lightning 10+1: games lost on time% of games, lower is better 50.0% 36 of 48 GPT-6.1 Sol Ultrafast (low reasoning)
low reasoning
9 Oct 2026
BulletBench Lightning 10+1: invalid moves% of moves, lower is better 0.0% 1 of 48 GPT-6.1 Sol Ultrafast
provider default reasoning
9 Oct 2026
BulletBench Lightning 10+1: invalid moves% of moves, lower is better 0.0% 1 of 48 GPT-6.1 Sol Ultrafast (low reasoning)
low reasoning
9 Oct 2026
BulletBench Lightning 10+1: ladder Eloladder Elo, higher is better 197
0–404
41 of 48 GPT-6.1 Sol Ultrafast
provider default reasoning
9 Oct 2026
BulletBench Lightning 10+1: ladder Eloladder Elo, higher is better 584
327–806
11 of 48 GPT-6.1 Sol Ultrafast (low reasoning)
low reasoning
9 Oct 2026
BulletBench Lightning 10+1: median move timemilliseconds, lower is better 1.4 s 43 of 48 GPT-6.1 Sol Ultrafast
provider default reasoning
9 Oct 2026
BulletBench Lightning 10+1: median move timemilliseconds, lower is better 1.2 s 40 of 48 GPT-6.1 Sol Ultrafast (low reasoning)
low reasoning
9 Oct 2026

Not shown: Not your cost: prices are those charged on the run date.

CatalogBench · measured by Spring Prompt · 31 results
MeasureValueRankConfigurationDated
CatalogBench (sales brief): channel rules broken% of products, lower is better 0.0% 1 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench (sales brief): claims to check% of products, lower is better 0.0% 1 of 32 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench (sales brief): content quality% of checks, higher is better 98.8% 2 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench (sales brief): failed outputs% of products, lower is better 0.0% 1 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench (sales brief): missing UK information% of products, lower is better 0.0% 1 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench (sales brief): not findable% of products, lower is better 5.4% 23 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench (sales brief): publish-ready listings% of products, higher is better 72.0% 5 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench (sales brief): reliably publish-ready% of products, higher is better 67.9% 2 of 34 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench (sales brief): unsupported claims% of products, lower is better 3.6% 5 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench (sales brief): unsupported claimsclaims per product, lower is better 0.07 2 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench (sales brief): wrong attributes% of products, lower is better 19.1% 20 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench (sales brief): wrong category or variant% of products, lower is better 1.8% 6 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench: channel compliance% of products, higher is better 100.0% 1 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench: channel rules broken% of products, lower is better 0.0% 1 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench: claims to check% of products, lower is better 0.0% 1 of 32 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench: conflicts caught% of conflicts, higher is better 100.0% 1 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench: content quality% of checks, higher is better 98.6% 3 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench: cost per productUS dollars, lower is better $0.0084 17 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench: decision accuracy% of decisions, higher is better 98.7% 3 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench: failed outputs% of products, lower is better 0.0% 1 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench: field accuracy% of missing fields, higher is better 94.4% 8 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench: invented values% of filled values, lower is better 2.2% 25 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench: missing UK information% of products, lower is better 0.0% 1 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench: not findable% of products, lower is better 4.8% 19 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench: publish-ready listings% of products, higher is better 78.0% 3 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench: reliably publish-ready% of products, higher is better 75.0% 1 of 34 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench: time per productseconds, lower is better 10.2 11 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench: unsupported claims% of products, lower is better 0.0% 1 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench: unsupported claimsclaims per product, lower is better 0.00 1 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench: wrong attributes% of products, lower is better 16.7% 16 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026
CatalogBench: wrong category or variant% of products, lower is better 1.8% 6 of 35 GPT-6.1 Sol
provider default reasoning
30 Sep 2026

Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

DeckBench · measured by Spring Prompt · 17 results
MeasureValueRankConfigurationDated
DeckBench: accurate decks% of tasks, higher is better 100.0% 1 of 34 GPT-6.1 Sol
provider default reasoning
6 Oct 2026
DeckBench: caveat dropped% of tasks, lower is better 0.0% 1 of 34 GPT-6.1 Sol
provider default reasoning
6 Oct 2026
DeckBench: clean layout% of tasks, higher is better 83.3% 3 of 34 GPT-6.1 Sol
provider default reasoning
6 Oct 2026
DeckBench: cost per deckUS dollars, lower is better $0.15 22 of 34 GPT-6.1 Sol
provider default reasoning
6 Oct 2026
DeckBench: deck ratingrating, higher is better 1,391
1,316–1,491
5 of 34 GPT-6.1 Sol
provider default reasoning
6 Oct 2026
DeckBench: design quality% of the maximum, higher is better 71.4% 12 of 34 GPT-6.1 Sol
provider default reasoning
6 Oct 2026
DeckBench: draft figure quoted% of tasks, lower is better 0.0% 1 of 34 GPT-6.1 Sol
provider default reasoning
6 Oct 2026
DeckBench: findings missing% of tasks, lower is better 0.0% 1 of 34 GPT-6.1 Sol
provider default reasoning
6 Oct 2026
DeckBench: head-to-head win rate% of comparisons, higher is better 81.0% 5 of 34 GPT-6.1 Sol
provider default reasoning
6 Oct 2026
DeckBench: layout defects% of tasks, lower is better 16.7% 3 of 34 GPT-6.1 Sol
provider default reasoning
6 Oct 2026
DeckBench: misleading metric used% of tasks, lower is better 0.0% 1 of 34 GPT-6.1 Sol
provider default reasoning
6 Oct 2026
DeckBench: presentable decks% of tasks, higher is better 50.0% 3 of 34 GPT-6.1 Sol
provider default reasoning
6 Oct 2026
DeckBench: recommendation late or wrong% of tasks, lower is better 0.0% 1 of 34 GPT-6.1 Sol
provider default reasoning
6 Oct 2026
DeckBench: slides needing work% of tasks, lower is better 50.0% 17 of 34 GPT-6.1 Sol
provider default reasoning
6 Oct 2026
DeckBench: time per deckseconds, lower is better 179 22 of 34 GPT-6.1 Sol
provider default reasoning
6 Oct 2026
DeckBench: unsupported claims% of tasks, lower is better 0.0% 1 of 34 GPT-6.1 Sol
provider default reasoning
6 Oct 2026
DeckBench: unsupported numbers% of tasks, lower is better 0.0% 1 of 34 GPT-6.1 Sol
provider default reasoning
6 Oct 2026

Not shown: Not your analysis or your brand: invented companies, six public tasks, one deck per model per task at the provider's default reasoning setting.

SurveyBench · measured by Spring Prompt · 20 results
MeasureValueRankConfigurationDated
SurveyBench: analysis ratingrating, higher is better 1,432
1,381–1,520
3 of 25 GPT-6.1 Sol
provider default reasoning
8 Oct 2026
SurveyBench: analysis scorepoints of 100, higher is better 96.6 2 of 25 GPT-6.1 Sol
provider default reasoning
8 Oct 2026
SurveyBench: cost per taskUS dollars, lower is better $0.14 16 of 24 GPT-6.1 Sol
provider default reasoning
8 Oct 2026
SurveyBench: head-to-head win rate% of comparisons, higher is better 78.2% 2 of 25 GPT-6.1 Sol
provider default reasoning
8 Oct 2026
SurveyBench: leading or double-barrelled questions% of tasks, lower is better 0.0% 1 of 25 GPT-6.1 Sol
provider default reasoning
8 Oct 2026
SurveyBench: mistaken next steps% of tasks, lower is better 11.1% 5 of 25 GPT-6.1 Sol
provider default reasoning
8 Oct 2026
SurveyBench: numbers right% of answers, higher is better 100.0% 1 of 25 GPT-6.1 Sol
provider default reasoning
8 Oct 2026
SurveyBench: objectives unanswerable% of tasks, lower is better 0.0% 1 of 25 GPT-6.1 Sol
provider default reasoning
8 Oct 2026
SurveyBench: precision ignored% of tasks, lower is better 0.0% 1 of 25 GPT-6.1 Sol
provider default reasoning
8 Oct 2026
SurveyBench: research scorepoints of 100, higher is better 97.0 2 of 25 GPT-6.1 Sol
provider default reasoning
8 Oct 2026
SurveyBench: sound research% of tasks, higher is better 66.7% 1 of 25 GPT-6.1 Sol
provider default reasoning
8 Oct 2026
SurveyBench: stakeholder's view presumed% of tasks, lower is better 0.0% 1 of 25 GPT-6.1 Sol
provider default reasoning
8 Oct 2026
SurveyBench: survey plan scorepoints of 100, higher is better 97.8 1 of 25 GPT-6.1 Sol
provider default reasoning
8 Oct 2026
SurveyBench: survey structure% of tasks, lower is better 11.1% 3 of 25 GPT-6.1 Sol
provider default reasoning
8 Oct 2026
SurveyBench: time per taskseconds, lower is better 222 15 of 24 GPT-6.1 Sol
provider default reasoning
8 Oct 2026
SurveyBench: traps handled% of traps, higher is better 95.7% 5 of 25 GPT-6.1 Sol
provider default reasoning
8 Oct 2026
SurveyBench: traps missed% of tasks, lower is better 33.3% 6 of 25 GPT-6.1 Sol
provider default reasoning
8 Oct 2026
SurveyBench: unsupported findings% of tasks, lower is better 0.0% 1 of 25 GPT-6.1 Sol
provider default reasoning
8 Oct 2026
SurveyBench: wrong numbers% of tasks, lower is better 0.0% 1 of 25 GPT-6.1 Sol
provider default reasoning
8 Oct 2026
SurveyBench: wrong recommendation% of tasks, lower is better 11.1% 5 of 25 GPT-6.1 Sol
provider default reasoning
8 Oct 2026

Not shown: Not your customers or your data: invented organisations with simulated respondents, nine public tasks, one run per model per task at the provider's default reasoning setting.

APEX-Agents · reported by APEX-Agents · 1 result
MeasureValueRankConfigurationDated
APEX-Agents: tasks passed% of tasks, higher is better 60.0% 10 of 39 GPT-6.1 Sol (max reasoning) 1 Oct 2026

Not shown: Not your firm's documents or tools; graded by rubric, not by a client.

Arena (formerly LMArena) · reported by Arena (formerly LMArena) · 11 results
MeasureValueRankConfigurationDated
Arena Agent: confirmed task successIPS effect estimate, higher is better 0.15
0.11–0.20
2 of 50 GPT-6.1 Sol (max reasoning, arena agent) 2 Oct 2026
Arena Agent: praise over complaintIPS effect estimate, higher is better 0.26
0.13–0.38
6 of 50 GPT-6.1 Sol (max reasoning, arena agent) 2 Oct 2026
Arena Agent: steerabilityIPS effect estimate, higher is better 0.11
0.08–0.14
3 of 50 GPT-6.1 Sol (max reasoning, arena agent) 2 Oct 2026
Arena Agent: tool groundingIPS effect estimate, higher is better 0.00
0.00–0.01
1 of 50 GPT-6.1 Sol (max reasoning, arena agent) 2 Oct 2026
Arena Text factuality: overallArena rating, higher is better 1,463
1,454–1,472
44 of 182 GPT-6.1 Sol (max reasoning) 2 Oct 2026
Arena Text: business, management and financeArena rating, higher is better 1,475
1,449–1,501
32 of 406 GPT-6.1 Sol (max reasoning) 2 Oct 2026
Arena Text: creative writingArena rating, higher is better 1,460
1,436–1,483
27 of 411 GPT-6.1 Sol (max reasoning) 2 Oct 2026
Arena Text: expert promptsArena rating, higher is better 1,543
1,511–1,576
4 of 363 GPT-6.1 Sol (max reasoning) 2 Oct 2026
Arena Text: instruction followingArena rating, higher is better 1,490
1,471–1,509
13 of 413 GPT-6.1 Sol (max reasoning) 2 Oct 2026
Arena Text: overallArena rating, higher is better 1,483
1,473–1,494
21 of 413 GPT-6.1 Sol (max reasoning) 2 Oct 2026
Arena Text: writing, literature and languageArena rating, higher is better 1,472
1,452–1,493
20 of 412 GPT-6.1 Sol (max reasoning) 2 Oct 2026

Not shown: Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.

Artificial Analysis · reported by Artificial Analysis · 35 results
MeasureValueRankConfigurationDated
Artificial Analysis: Artificial Analysis Intelligence Indexindex score, higher is better 50.2 18 of 413 GPT-6.1 Sol (high reasoning) 20 Oct 2026
Artificial Analysis: Artificial Analysis Intelligence Indexindex score, higher is better 42.1 51 of 413 GPT-6.1 Sol (low reasoning) 20 Oct 2026
Artificial Analysis: Artificial Analysis Intelligence Indexindex score, higher is better 51.8 12 of 413 GPT-6.1 Sol (max reasoning) 20 Oct 2026
Artificial Analysis: Artificial Analysis Intelligence Indexindex score, higher is better 47.8 25 of 413 GPT-6.1 Sol (medium reasoning) 20 Oct 2026
Artificial Analysis: Artificial Analysis Intelligence Indexindex score, higher is better 51.0 15 of 413 GPT-6.1 Sol (xhigh reasoning) 20 Oct 2026
Artificial Analysis: Humanity's Last Exam% of questions, higher is better 51.4% 22 of 419 GPT-6.1 Sol (high reasoning) 20 Oct 2026
Artificial Analysis: Humanity's Last Exam% of questions, higher is better 47.4% 39 of 419 GPT-6.1 Sol (low reasoning) 20 Oct 2026
Artificial Analysis: Humanity's Last Exam% of questions, higher is better 52.9% 17 of 419 GPT-6.1 Sol (max reasoning) 20 Oct 2026
Artificial Analysis: Humanity's Last Exam% of questions, higher is better 49.9% 26 of 419 GPT-6.1 Sol (medium reasoning) 20 Oct 2026
Artificial Analysis: Humanity's Last Exam% of questions, higher is better 52.6% 20 of 419 GPT-6.1 Sol (xhigh reasoning) 20 Oct 2026
Artificial Analysis: Long-context reasoning (AA-LCR)% of questions, higher is better 82.3% 37 of 407 GPT-6.1 Sol (high reasoning) 20 Oct 2026
Artificial Analysis: Long-context reasoning (AA-LCR)% of questions, higher is better 84.0% 11 of 407 GPT-6.1 Sol (low reasoning) 20 Oct 2026
Artificial Analysis: Long-context reasoning (AA-LCR)% of questions, higher is better 83.0% 23 of 407 GPT-6.1 Sol (max reasoning) 20 Oct 2026
Artificial Analysis: Long-context reasoning (AA-LCR)% of questions, higher is better 83.3% 19 of 407 GPT-6.1 Sol (medium reasoning) 20 Oct 2026
Artificial Analysis: Long-context reasoning (AA-LCR)% of questions, higher is better 79.7% 86 of 407 GPT-6.1 Sol (xhigh reasoning) 20 Oct 2026
Artificial Analysis: Output speedtokens per second, higher is better 48.5 117 of 137 GPT-6.1 Sol (high reasoning) 20 Oct 2026
Artificial Analysis: Output speedtokens per second, higher is better 45.0 123 of 137 GPT-6.1 Sol (low reasoning) 20 Oct 2026
Artificial Analysis: Output speedtokens per second, higher is better 53.1 113 of 137 GPT-6.1 Sol (max reasoning) 20 Oct 2026
Artificial Analysis: Output speedtokens per second, higher is better 44.5 124 of 137 GPT-6.1 Sol (medium reasoning) 20 Oct 2026
Artificial Analysis: Output speedtokens per second, higher is better 49.6 116 of 137 GPT-6.1 Sol (xhigh reasoning) 20 Oct 2026
Artificial Analysis: SciCode% of problems, higher is better 55.8% 43 of 205 GPT-6.1 Sol (high reasoning) 20 Oct 2026
Artificial Analysis: SciCode% of problems, higher is better 53.2% 78 of 205 GPT-6.1 Sol (low reasoning) 20 Oct 2026
Artificial Analysis: SciCode% of problems, higher is better 54.2% 65 of 205 GPT-6.1 Sol (max reasoning) 20 Oct 2026
Artificial Analysis: SciCode% of problems, higher is better 53.2% 78 of 205 GPT-6.1 Sol (medium reasoning) 20 Oct 2026
Artificial Analysis: SciCode% of problems, higher is better 55.7% 45 of 205 GPT-6.1 Sol (xhigh reasoning) 20 Oct 2026
Artificial Analysis: Terminal-Bench 4.0% of tasks, higher is better 51.5% 19 of 204 GPT-6.1 Sol (high reasoning) 20 Oct 2026
Artificial Analysis: Terminal-Bench 4.0% of tasks, higher is better 30.8% 47 of 204 GPT-6.1 Sol (low reasoning) 20 Oct 2026
Artificial Analysis: Terminal-Bench 4.0% of tasks, higher is better 56.1% 10 of 204 GPT-6.1 Sol (max reasoning) 20 Oct 2026
Artificial Analysis: Terminal-Bench 4.0% of tasks, higher is better 48.0% 22 of 204 GPT-6.1 Sol (medium reasoning) 20 Oct 2026
Artificial Analysis: Terminal-Bench 4.0% of tasks, higher is better 54.0% 13 of 204 GPT-6.1 Sol (xhigh reasoning) 20 Oct 2026
Artificial Analysis: Time to first answer tokenseconds, lower is better 41.0 105 of 137 GPT-6.1 Sol (high reasoning) 20 Oct 2026
Artificial Analysis: Time to first answer tokenseconds, lower is better 1.71 37 of 137 GPT-6.1 Sol (low reasoning) 20 Oct 2026
Artificial Analysis: Time to first answer tokenseconds, lower is better 255 134 of 137 GPT-6.1 Sol (max reasoning) 20 Oct 2026
Artificial Analysis: Time to first answer tokenseconds, lower is better 6.99 51 of 137 GPT-6.1 Sol (medium reasoning) 20 Oct 2026
Artificial Analysis: Time to first answer tokenseconds, lower is better 110 127 of 137 GPT-6.1 Sol (xhigh reasoning) 20 Oct 2026

Not shown: Not business work, and a blend: read the parts for any one task.

SimpleQA Verified (Epoch AI) · reported by SimpleQA Verified (Epoch AI) · 1 result
MeasureValueRankConfigurationDated
SimpleQA Verified: correct answers% of questions, higher is better 73.9% 2 of 85 GPT-6.1 Sol (max reasoning) 29 Sep 2026

Not shown: Not answers grounded in your documents; tests what the model remembers.

UGI Leaderboard · reported by UGI Leaderboard · 12 results
MeasureValueRankConfigurationDated
UGI: requested-length error% off the requested word count, lower is better 0.0% 1 of 379 GPT-6.1 Sol (high reasoning) 2 Oct 2026
UGI: requested-length error% off the requested word count, lower is better 1.0% 5 of 379 GPT-6.1 Sol (low reasoning) 2 Oct 2026
UGI: requested-length error% off the requested word count, lower is better 2.0% 10 of 379 GPT-6.1 Sol (medium reasoning) 2 Oct 2026
UGI: requested-length error% off the requested word count, lower is better 0.0% 1 of 379 GPT-6.1 Sol (xhigh reasoning) 2 Oct 2026
UGI: style adherencescore from 0 to 1, higher is better 0.37 85 of 379 GPT-6.1 Sol (high reasoning) 2 Oct 2026
UGI: style adherencescore from 0 to 1, higher is better 0.37 103 of 379 GPT-6.1 Sol (low reasoning) 2 Oct 2026
UGI: style adherencescore from 0 to 1, higher is better 0.37 103 of 379 GPT-6.1 Sol (medium reasoning) 2 Oct 2026
UGI: style adherencescore from 0 to 1, higher is better 0.37 95 of 379 GPT-6.1 Sol (xhigh reasoning) 2 Oct 2026
UGI: writing scorescore out of 100, higher is better 67.7 43 of 379 GPT-6.1 Sol (high reasoning) 2 Oct 2026
UGI: writing scorescore out of 100, higher is better 60.5 100 of 379 GPT-6.1 Sol (low reasoning) 2 Oct 2026
UGI: writing scorescore out of 100, higher is better 62.4 89 of 379 GPT-6.1 Sol (medium reasoning) 2 Oct 2026
UGI: writing scorescore out of 100, higher is better 65.0 67 of 379 GPT-6.1 Sol (xhigh reasoning) 2 Oct 2026

Not shown: Not other format limits such as character counts or bullet counts.

Embed a score badge

A badge for its Spring Prompt Score and each of our benchmarks that ranked GPT-6.1 Sol, from the current results. Paste the code into a page or README; it links back to where the result comes from.

GPT-6.1 Sol is #1 of 32 on the Spring Prompt Score (92 of 100, from 4 of 5 of our benchmarks), measured by Spring Prompt Spring Prompt Score · 4 of 5 benchmarks
<a href="https://springprompt.com/score#openai-gpt-6-1-sol"><img src="https://springprompt.com/badge/score/openai-gpt-6-1-sol.svg" alt="GPT-6.1 Sol is #1 of 32 on the Spring Prompt Score (92 of 100, from 4 of 5 of our benchmarks), measured by Spring Prompt" height="20"></a>
GPT-6.1 Sol is #1 of 32 on CatalogBench (Reliably publish-ready, factual brief: 75.0%), measured by Spring Prompt CatalogBench · Reliably publish-ready, factual brief
<a href="https://springprompt.com/benchmarks/catalogbench?focus=openai-gpt-6-1-sol"><img src="https://springprompt.com/badge/catalogbench/openai-gpt-6-1-sol.svg" alt="GPT-6.1 Sol is #1 of 32 on CatalogBench (Reliably publish-ready, factual brief: 75.0%), measured by Spring Prompt" height="20"></a>
GPT-6.1 Sol is #5 of 33 on DeckBench (Deck rating: 1,391), measured by Spring Prompt DeckBench · Deck rating
<a href="https://springprompt.com/benchmarks/deckbench?focus=openai-gpt-6-1-sol"><img src="https://springprompt.com/badge/deckbench/openai-gpt-6-1-sol.svg" alt="GPT-6.1 Sol is #5 of 33 on DeckBench (Deck rating: 1,391), measured by Spring Prompt" height="20"></a>
GPT-6.1 Sol is #3 of 24 on SurveyBench (Analysis rating: 1,432), measured by Spring Prompt SurveyBench · Analysis rating
<a href="https://springprompt.com/benchmarks/surveybench?focus=openai-gpt-6-1-sol"><img src="https://springprompt.com/badge/surveybench/openai-gpt-6-1-sol.svg" alt="GPT-6.1 Sol is #3 of 24 on SurveyBench (Analysis rating: 1,432), measured by Spring Prompt" height="20"></a>
GPT-6.1 Sol is #11 of 45 on BulletBench (Lightning 10+1: 584), measured by Spring Prompt BulletBench · Lightning 10+1
<a href="https://springprompt.com/benchmarks/bulletbench?focus=openai-gpt-6-1-sol"><img src="https://springprompt.com/badge/bulletbench/openai-gpt-6-1-sol.svg" alt="GPT-6.1 Sol is #11 of 45 on BulletBench (Lightning 10+1: 584), measured by Spring Prompt" height="20"></a>

Will GPT-6.1 Sol work for your product?

Benchmarks aren't your task. Paste the prompt your product uses and run it beside the models you could use instead, with every answer checked and costed.

New here? Your email starts a free trial. No credit card needed.