Consistency (pass^5):
2 results · % of tasks, higher is better. Choose a model to highlight it.Clear highlight
- 1 GPT-5.5 (high reasoning)OpenAI 44.2%
- 2 GPT-5.4 (high reasoning)OpenAI 41.8%
Benchmarks / Microsoft STATE-Bench
Share of tasks completed correctly in all five of five runs.
Data older than 90 days: last updated 1 Jul 2026
What it measures. Microsoft STATE-Bench is a third-party benchmark, shown here with credit. Measured here: Share of tasks completed correctly in all five of five runs.
Latest results. , 2 models ranked.
Top 2 on Consistency (pass^5) (% of tasks, higher is better):
How to cite. Microsoft STATE-Bench, via Spring Prompt, results dated 1 July 2026. https://springprompt.com/benchmarks/statebench These results belong to Microsoft STATE-Bench, not to us. Licence: MIT License. Credit Microsoft STATE-Bench first.
2 results · % of tasks, higher is better. Choose a model to highlight it.Clear highlight
| # | Model | Consistency (pass^5) % of tasks, higher is better | Price $ per million tokens, in / out |
|---|---|---|---|
| 1 | GPT-5.5 (high reasoning)OpenAI |
44.2%
|
$5 / $30 |
| 2 | GPT-5.4 (high reasoning)OpenAI |
41.8%
|
$2.50 / $15 |
Swipe the table sideways for more columns.
Source: Microsoft STATE-Bench, via Spring Prompt, springprompt.com/benchmarks/statebench. Test your own prompt on these models →
Ranks follow the score as shown, so equal numbers share a rank. Results as published by Microsoft STATE-Bench; we do not re-run them.
Share of tasks completed correctly in all five of five runs.
Not the model alone: it runs inside STATE-Bench's agent loop against simulated users, and versions of the benchmark are not comparable.
We rank a result only when we can tie it to a specific model you can use. These are left out:
STATE-Bench by Microsoft and STATE-Bench contributors, MIT License.