What it measures. Microsoft STATE-Bench is a third-party benchmark, shown here with credit. Measured here: Share of customer support tasks completed correctly, averaged over repeated runs.
Latest results. , 4 models ranked.
Top 3 on Customer support task success (pass@1) (% of tasks, higher is better, each model at its best setting):
How to cite. Microsoft STATE-Bench, via Spring Prompt, results dated 29 May 2026. https://springprompt.com/benchmarks/statebench These results belong to Microsoft STATE-Bench, not to us. Licence: MIT License. Credit Microsoft STATE-Bench first.
Customer support task success (pass@1):
4 results · % of tasks, higher is better. Choose a model to highlight it.Clear highlight
Ranks follow the score as shown, so equal numbers share a rank. Each model is shown at its best setting; show every setting. Results as published by Microsoft STATE-Bench; we do not re-run them.
Progress over time
Customer support task success (pass@1), plotted at each model's release date, higher is better. Each model counts once, at its best setting. Scores are today's, not launch day's. Hover or tap a mark for its model.
Best score so far
Every model at its release date. The line moves each time a new release beats every earlier one, and each new best is named where there is room.
Best score by lab
Each lab's best so far, stepping whenever one of its releases beats its own earlier models.
OpenAIAnthropicDeepSeekMoonshot AI
What it measures
Share of customer support tasks completed correctly, averaged over repeated runs.
What it does not measure
Not the model alone: it runs inside STATE-Bench's agent loop against simulated users, and versions of the benchmark are not comparable.