The question we want to answer
Which models are best at customer support and service resolution?
A useful category rank must measure this outcome, not merely a broad intelligence score or a stylistically similar task.
Category ranking not yet published
Customer Support & Service Resolution: evidence status
Accurate, policy-aware support that resolves the issue, de-escalates appropriately, and hands off cleanly when needed.
This page is not a model ranking.
We do not yet have enough defensible evidence to rank models for Customer Support & Service Resolution. No model order is shown here, and this category contributes nothing to the Spring Prompt overall leaderboard.
Why we are not ranking it yet
Evidence gap
This V3 category is defined, but no model order is published until eligible external evidence and SpringPrompt pairwise evidence pass the coverage, independence, reliability, and stability gates.
Collection structure
Explore the four skills in this benchmark
Each skill has its own task plan and evidence status. A collection ranking cannot go live by silently substituting one facet for another.
Diagnosis and resolution →
Identify the real issue and give a workable resolution path.
25% weight · hybrid evaluation
Policy boundaries →
Apply policy consistently without fabricating authority or exceptions.
25% weight · hybrid evaluation
De-escalation →
Acknowledge frustration while staying direct and useful.
25% weight · hybrid evaluation
Escalation and handoff →
Escalate with complete context, ownership, and a clear next step.
25% weight · hybrid evaluation
Promotion gate
What must improve before a ranking goes live
- 1At least one eligible external result and one first-party pairwise result.
- 2At least two independent evidence lineages and eight eligible configurations.
- 3At least 80% required-task coverage for every headline row.
- 4Reliability and sealed-release stability checks must both pass.
We do not fill these gaps with the retired internally judged scores. Saved outputs can still illustrate the task, but their old judge grades never determine a new rank.