What it measures. tau2-bench is a third-party benchmark, shown here with credit. Measured here: Share of banking questions answered from a policy knowledge base tasks completed within policy in all four trials.
Latest results. , 21 models ranked.
Top 3 on Consistency (pass^4) (% of tasks, higher is better):
How to cite. tau2-bench, via Spring Prompt, results dated 3 August 2026. https://springprompt.com/benchmarks/tau2-bench These results belong to tau2-bench, not to us. Licence: MIT License. Credit tau2-bench first.
Consistency (pass^4): Grok 4.1 Fast
Top 15 of 21 results · % of tasks, higher is better. Choose a model to highlight it.Clear highlight
Ranks follow the score as shown, so equal numbers share a rank. Results as published by tau2-bench; we do not re-run them.
Progress over time
Consistency (pass^4), plotted at each model's release date, higher is better. Each model counts once, at its best setting. Scores are today's, not launch day's; 1 model without a known release date is left off. Hover or tap a mark for its model.
Best score so far
Every model at its release date. The line moves each time a new release beats every earlier one, and each new best is named where there is room.
Best score by lab
Each lab's best so far, stepping whenever one of its releases beats its own earlier models. The 6 labs with the best scores today; 3 others not drawn.
AlibabaxAIAnthropicOpenAIMetaMoonshot AI
What it measures
Share of banking questions answered from a policy knowledge base tasks completed within policy in all four trials.
What it does not measure
Not your policies or customers: the tasks and policies are tau2's own, and the customer is simulated by gpt-5.2.