Confirm Action

Are you sure you want to proceed?

Release planning · no model scores

STATE-Bench v0.8 main evidence mapping

Exact V3 collection, facet, metric, lineage, identity and rights mapping for STATE-Bench v0.8 main from Microsoft STATE-Bench.

V3 evidence records

1 collection mapping

A repeated upstream benchmark can map to several collections. Each record below preserves its own task role, facets, capability atoms, subject identity, metrics, lineages and exclusions.

primary evidence · business-automation/statebench/state-bench-v0-8-main

Business Workflow Automation

Which models are best at business workflow automation?

Upstream access
machine-ready
Eligibility
runnable-now
Registry
registered
Max task directness
80%

Collection facets

  • Workflow completion · objective · 25%

    Reach the correct end state across multiple dependent steps.

  • Exception recovery · hybrid · 25%

    Recover from missing data, failed tools, and conflicting state.

  • Approval and action safety · hybrid · 25%

    Pause for authorization before consequential or irreversible actions.

  • Operational communication · hybrid · 25%

    Explain progress, blockers, and handoffs without excess narration.

Capability atoms

stateful_completionworkflow_ux

Subject identity

Declared:
harnessed-model
Metric partitions:
harnessed-model
Separate partition required:
no
Identity projection:
forbidden

Usable evidence lineages

  • statebench-v0-8-main/harnessed-model

Exact metric contract

MetricLineageSubjectProtocolUse
v0.8.main.overall.pass_at_1STATE-Bench Main v0.8 — Overall — Task completion pass@1statebench-v0-8-mainharnessed-modelstatebench-v0.8.mainusable
v0.8.main.overall.mean_ux_scoreSTATE-Bench Main v0.8 — Overall — Mean UX scorestatebench-v0-8-mainharnessed-modelstatebench-v0.8.mainusable

Exclusions and blockers

No mapping-level exclusion is recorded; the page-level release gate still applies.

Mapping note

Keep benchmark version and system configuration as hard partitions.