The question we want to answer
Which models are best at tool calling and structured output?
A useful category rank must measure this outcome, not merely a broad intelligence score or a stylistically similar task.
Category ranking not yet published
Tool Calling & Structured Output: evidence status
Correct tool selection, arguments, schemas, values, multi-turn recovery, and explicit no-call behaviour under realistic constraints.
This page is not a model ranking.
We do not yet have enough defensible evidence to rank models for Tool Calling & Structured Output. No model order is shown here, and this category contributes nothing to the Spring Prompt overall leaderboard.
Why we are not ranking it yet
Evidence gap
This V3 category is defined, but no model order is published until eligible external evidence and SpringPrompt pairwise evidence pass the coverage, independence, reliability, and stability gates.
Collection structure
Explore the four skills in this benchmark
Each skill has its own task plan and evidence status. A collection ranking cannot go live by silently substituting one facet for another.
Function calling →
Select the right function and construct valid arguments.
25% weight · objective evaluation
Multi-turn tool use →
Maintain state and recover across dependent calls.
25% weight · hybrid evaluation
Structured schemas and values →
Produce schema-valid output with correct grounded values.
25% weight · objective evaluation
No-call and error recovery →
Decline irrelevant calls and recover safely from tool errors.
25% weight · hybrid evaluation
Promotion gate
What must improve before a ranking goes live
- 1At least one eligible external result and one first-party pairwise result.
- 2At least two independent evidence lineages and eight eligible configurations.
- 3At least 80% required-task coverage for every headline row.
- 4Reliability and sealed-release stability checks must both pass.
We do not fill these gaps with the retired internally judged scores. Saved outputs can still illustrate the task, but their old judge grades never determine a new rank.