Confirm Action

Are you sure you want to proceed?

Model intelligence profile

GPT-5.6 Sol benchmark results and model details

This family profile brings together 11 published benchmark records for OpenAI GPT-5.6 Sol. Every result keeps its original benchmark, configuration, scale, and source; unrelated scores are never averaged.

Published benchmark evidence available · Business Skills V3 not yet authorized

Provider

OpenAI

Base model family

Release date

2026-07-09

Exact-family source only

Published benchmarks

11

Native scales kept separate

Artificial Analysis

Reference available

As of 2026-07-16

Benchmark-level evidence

Published GPT-5.6 Sol benchmark results

These are individual benchmarks, not collection rollups. Scores remain on their original scales, and agent or harness results stay labelled as system configurations.

How sources are reviewed →

Spring Prompt benchmark

BulletBench

2 configurations

60-second bullet Elo

Chess decision quality under a shared 60-second game clock and a 10+1 per-move clock.

Ladder Elo: anchored to a Stockfish skill ladder (random mover = 400). Internally consistent ordering, not FIDE-calibrated.

2 published configurations

GPT-5.6 Sol (low)

35

Bullet 95% interval
0–171
10+1 Elo
0
Bullet games
96
Bullet median move time
3.47s
Average bullet game cost
$0.0799

GPT-5.6 Sol (medium)

0

Bullet 95% interval
0–126
10+1 Elo
0
Bullet games
96
Bullet median move time
3.43s
Average bullet game cost
$0.0832
Source: Spring Prompt Recorded 3 Aug 2026 Ladder v1 · controls 10+1 and 60 Source record →

Spring Prompt benchmark

ROASBench

4 configurations

Average ROASBench score

A 12-month performance-marketing simulation scored on business outcomes, planning, behavior, and persona fit.

4 published configurations

OpenAI: GPT-5.6 Sol

36.31

Average contribution profit
$261,326
Average ROAS
1.75×
Completed runs
3
Score variability
±5.75

OpenAI: GPT-5.6 Sol · High

37.53

Average contribution profit
$260,679
Average ROAS
1.76×
Completed runs
3
Score variability
±1.49

OpenAI: GPT-5.6 Sol · Max

36.40

Average contribution profit
$231,057
Average ROAS
1.71×
Completed runs
3
Score variability
±1.90

OpenAI: GPT-5.6 Sol · Medium

39.46

Average contribution profit
$356,717
Average ROAS
1.85×
Completed runs
3
Score variability
±1.92
Source: Spring Prompt Recorded 25 Jul 2026 Published ROASBench cache · 12-month simulation Source record →

source-native benchmark

Artificial Analysis Intelligence Index

56

A composite index of language-model performance across agentic work, coding, scientific reasoning, knowledge, and long-context reasoning.

1 published configuration

GPT-5.6 Sol (high)

56

Status
Measured
Recorded
30 Jul 2026
Source: Artificial Analysis Recorded 30 Jul 2026 Intelligence Index v4.1 · 2026-07-30 Source record →

source-native benchmark

Coding Agent Configurations

6 configurations

Coding Agent Index v1.2 point score

Artificial Analysis Coding Agent Index v1.2 point scores and task-specific operational measurements for exact agent and model configurations.

These are exact agent-plus-model configurations, not bare-model scores.

6 published configurations

Codex - GPT-5.6 Sol (max)

61.0

Mean cost per task
$7.08
Mean wall time
10.2 min

Codex - GPT-5.6 Sol (xhigh)

59.3

Mean cost per task
Not reported
Mean wall time
7.4 min

Codex - GPT-5.6 Sol (high)

58.1

Mean cost per task
Not reported
Mean wall time
6.3 min

Codex - GPT-5.6 Sol (medium)

54.8

Mean cost per task
Not reported
Mean wall time
5.2 min

Codex - GPT-5.6 Sol (low)

48.8

Mean cost per task
Not reported
Mean wall time
3.7 min

Codex - GPT-5.6 Sol (none)

39.5

Mean cost per task
$1.40
Mean wall time
3.4 min
Source: Artificial Analysis Coding Agent Index Recorded 20 Jul 2026 V1.2 Source record →

source-native benchmark

GDPval-AA v2

56%

Artificial Analysis's agentic evaluation of economically valuable, real-world work tasks based on the GDPval dataset.

1 published configuration

GPT-5.6 Sol (high)

56%

Status
Measured
Recorded
30 Jul 2026
Source: Artificial Analysis Recorded 30 Jul 2026 Independent evaluation · Public leaderboard snapshot · 2026-07-30 Source record →

source-native benchmark

GPQA Diamond

93%

The most challenging subset of Graduate-Level Google-Proof Q&A, focused on scientific reasoning.

1 published configuration

GPT-5.6 Sol (high)

93%

Status
Measured
Recorded
30 Jul 2026
Source: Artificial Analysis Recorded 30 Jul 2026 Independent evaluation · Public leaderboard snapshot · 2026-07-30 Source record →

source-native benchmark

Humanity's Last Exam

44%

A broad expert-level benchmark of difficult academic reasoning and knowledge questions.

1 published configuration

GPT-5.6 Sol (high)

44%

Status
Measured
Recorded
30 Jul 2026
Source: Artificial Analysis Recorded 30 Jul 2026 Independent evaluation · Public leaderboard snapshot · 2026-07-30 Source record →

source-native benchmark

IFBench

69%

An instruction-following benchmark with diverse, verifiable out-of-domain output constraints.

1 published configuration

GPT-5.6 Sol (high)

69%

Status
Measured
Recorded
30 Jul 2026
Source: Artificial Analysis Recorded 30 Jul 2026 Independent evaluation · Public leaderboard snapshot · 2026-07-30 Source record →

source-native benchmark

MMMU-Pro

82%

A multimodal academic reasoning benchmark designed to reduce shortcuts and guessing across many disciplines.

1 published configuration

GPT-5.6 Sol (high)

82%

Status
Measured
Recorded
30 Jul 2026
Source: Artificial Analysis Recorded 30 Jul 2026 Independent evaluation · Public leaderboard snapshot · 2026-07-30 Source record →

source-native benchmark

Terminal-Bench v2.1

87%

A terminal-based agent benchmark covering software engineering, system administration, data processing, model training, and security tasks.

1 published configuration

GPT-5.6 Sol (high)

87%

Status
Measured
Recorded
30 Jul 2026
Source: Artificial Analysis Recorded 30 Jul 2026 Independent evaluation · Public leaderboard snapshot · 2026-07-30 Source record →

source-native benchmark

τ²-Bench Telecom

83%

A legacy agentic tool-use benchmark for conversational work in a telecom environment.

1 published configuration

GPT-5.6 Sol (high)

83%

Status
Measured
Recorded
30 Jul 2026
Source: Artificial Analysis Recorded 30 Jul 2026 Independent evaluation · Public leaderboard snapshot · 2026-07-30 Source record →

Independent operational reference

Artificial Analysis details

Representative configuration: GPT-5.6 Sol (max). Lifecycle: active; released 2026-07-09.

Input price

$5.00 / 1M tokens

Output price

$30.00 / 1M tokens

Median output speed

55.9 tok/s

Operational reference only. Price and throughput are not model-quality scores and never affect Spring Prompt comparisons.

Early-user signal

Initial community opinions

Anecdotal · never scored

A paraphrased editorial synthesis of 4 Reddit discussions created in the 14 days after launch (9 Jul 2026 to 23 Jul 2026). Anecdotal context only — it never affects scores or rankings.

The search-indexed launch-window sample highlighted GPT-5.6 Sol's autonomous code review, broad bug discovery, project comprehension, and promising frontend output. Counter-reports focused on heavy quota use, slow execution, overengineering, guardrail interference, rollout friction, and occasional basic mistakes. Strong initial results therefore sat alongside unresolved cost and consistency concerns.

Independent early-test signal

Early technical field tests

X · anecdotal · never scored

No independent field-test write-up has cleared review for this model yet — insufficient independent tests.

Business Skills V3 · proposed

How Spring Prompt plans to test GPT-5.6 Sol

The setup below is proposed and may change until preflight and execution approval are complete. Existing benchmark evidence above does not authorize or stand in for a Business Skills V3 result.

Proposed reasoning
High reasoning
Provider revision
Exact provider revision will be resolved and frozen only after preflight and execution approval
Tools and service
No tools · Provider-default service tier
Planning configuration
gpt-5.6-sol-high
Generation controls
Provider-managed reasoning; no temperature override proposed

Future first-party coverage

15 proposed Business Skills V3 task areas

These links describe evaluation contracts, not published GPT-5.6 Sol results.

Model comparisons

Compare GPT-5.6 Sol side by side

Editorially reviewed comparisons appear first. Every page matches only benchmark records with the same reviewed protocol key and does not manufacture an overall winner.

Publication safeguards

What must pass before a V3 result appears

  1. 1First-party task-local comparisons and eligible external evidence must both be present.
  2. 2Model and provider configuration identity must match the reviewed release exactly.
  3. 3Coverage, reliability, judge diagnostics, and sealed stability checks must pass.
  4. 4Uncertainty and missing evidence remain visible when results are published.

Stable family URL

Evidence can grow without changing the page

New reviewed benchmark snapshots, operational facts, community themes, and early field-test syntheses can be added here while the canonical model-family identity remains fixed.

More from OpenAI

Other owned model profiles