What it measures. Microsoft STATE-Bench is a third-party benchmark, shown here with credit. Measured here: Share of shopping assistant tasks completed correctly, averaged over repeated runs.
Latest results. , 2 models ranked.
Top 2 on Shopping assistant task success (pass@1) (% of tasks, higher is better):
The first 2 are too close to tell apart, so read the order among them as a tie.
How to cite. Microsoft STATE-Bench, via Spring Prompt, results dated 1 July 2026. https://springprompt.com/benchmarks/statebench These results belong to Microsoft STATE-Bench, not to us. Licence: MIT License. Credit Microsoft STATE-Bench first.
Shopping assistant task success (pass@1): GPT-5.4
2 results · % of tasks, higher is better · ≈ cannot be told apart from the leader. Choose a model to highlight it.Clear highlight