First-party pairwise plan
Six distinct tasks for this facet
5
exploration tasks
Used for comparison coverage and calibrated refinement.
1
sealed holdout task
Kept out of model and judge tuning until release validation.
6
tasks in total
One of four equally weighted facets in this collection.
First-party, task-local pairwise comparisons with deterministic validators acting as hard gates. The final task remains sealed from model and judge tuning until release validation.