Confirm Action

Are you sure you want to proceed?

Planned benchmark facet · ranking not published

Which models are best at workflow completion?

Reach the correct end state across multiple dependent steps.

This is the evaluation plan, not a model leaderboard.

No model order or score is shown. Candidate external benchmarks and planned first-party comparisons become evidence only after their exact release gates pass; retired benchmark grades are not reused.

First-party pairwise plan

Six distinct tasks for this facet

5

exploration tasks

Used for comparison coverage and calibrated refinement.

1

sealed holdout task

Kept out of model and judge tuning until release validation.

6

tasks in total

One of four equally weighted facets in this collection.

First-party, task-local pairwise comparisons with deterministic validators acting as hard gates. The final task remains sealed from model and judge tuning until release validation.

Collection-level external evidence map

Candidate benchmarks that can inform this skill

These sources are mapped to Business Workflow Automation, then identity-partitioned and lineage-deduplicated. They are supporting inputs, not a substitute for direct task-local pairwise results, and no score is reproduced on this page.

LMArena Leaderboard Dataset

Agent outcome and steerability

Mapped and runnable
Evidence role
supporting
Maximum directness
45%
Declared subject
harnessed model
Usable lineages mapped
1

Capabilities: task outcome, steerability, tool grounding.

Mapped fields: LMArena Agent — Confirmed success net improvement, LMArena Agent — Steerability net improvement, LMArena Agent — Tool-hallucination outcome net improvement.

Skillsbench

SkillsBench v1.1

Score feed not yet integrated
Evidence role
primary
Maximum directness
70%
Declared subject
agent
Usable lineages mapped
0

Capabilities: workflow completion, skill use.

  • • source is absent from the checked-in source registry

Microsoft STATE-Bench

STATE-Bench v0.8 main

Mapped and runnable
Evidence role
primary
Maximum directness
80%
Declared subject
harnessed model
Usable lineages mapped
1

Capabilities: stateful completion, workflow ux.

Mapped fields: STATE-Bench Main v0.8 — Overall — Task completion pass@1, STATE-Bench Main v0.8 — Overall — Mean UX score.

Zapier Automationbench

AutomationBench

Score feed not yet integrated
Evidence role
primary
Maximum directness
75%
Declared subject
harnessed model
Usable lineages mapped
0

Capabilities: business app execution.

  • • source is absent from the checked-in source registry

Current blockers

Why no ranking is live

  • No approved combined collection artifact has been released.
  • The parent collection has not passed its publication gate.
  • No approved facet-level result artifact has been released.

Publication gate

What must pass first

  1. 1Combine at least one eligible external result with at least one first-party pairwise result.
  2. 2Retain at least 2 independent evidence lineages and 8 eligible model configurations.
  3. 3Complete at least 3 facet tasks with at least 80% required-task coverage.
  4. 4Show that this facet is materially distinct, then pass reliability and sealed-release stability checks.

Business Workflow Automation

Explore all four planned skills

Back to Business Workflow Automation Sources and safeguards