-0.11
Confirmed task success · rank 35 of 46
- Unit
- IPS effect estimate, higher is better
- Range
- -0.14 to -0.09
- Sample
- 13961 observations
- Configuration
- Hy3
- Measured
- 28 Sep 2026
- Not shown
- Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
-0.07
Praise over complaint · rank 28 of 46
- Unit
- IPS effect estimate, higher is better
- Range
- -0.11 to -0.04
- Sample
- 4499 observations
- Configuration
- Hy3
- Measured
- 28 Sep 2026
- Not shown
- Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
-0.01
Steerability · rank 17 of 46
- Unit
- IPS effect estimate, higher is better
- Range
- -0.04 to 0.01
- Sample
- 14417 observations
- Configuration
- Hy3
- Measured
- 28 Sep 2026
- Not shown
- Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
-0.03
Tool grounding · rank 44 of 46
- Unit
- IPS effect estimate, higher is better
- Range
- -0.04 to -0.02
- Sample
- 1001499 observations
- Configuration
- Hy3
- Measured
- 28 Sep 2026
- Not shown
- Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
1,447
Overall · rank 49 of 177
- Unit
- Arena rating, higher is better
- Range
- 1,441 to 1,453
- Sample
- 9745 votes
- Configuration
- Hy3
- Measured
- 25 Sep 2026
- Not shown
- Not an error rate: claims that cannot be checked on the web are skipped, and preference still carries most of the weight.
1,447
Business, management and finance · rank 38 of 402
- Unit
- Arena rating, higher is better
- Range
- 1,433 to 1,461
- Sample
- 1916 votes
- Configuration
- Hy3
- Measured
- 25 Sep 2026
- Not shown
- Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,419
Creative writing · rank 51 of 407
- Unit
- Arena rating, higher is better
- Range
- 1,405 to 1,433
- Sample
- 1923 votes
- Configuration
- Hy3
- Measured
- 25 Sep 2026
- Not shown
- Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,490
Expert prompts · rank 14 of 359
- Unit
- Arena rating, higher is better
- Range
- 1,472 to 1,508
- Sample
- 1061 votes
- Configuration
- Hy3
- Measured
- 25 Sep 2026
- Not shown
- Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,446
Instruction following · rank 42 of 409
- Unit
- Arena rating, higher is better
- Range
- 1,435 to 1,456
- Sample
- 3543 votes
- Configuration
- Hy3
- Measured
- 25 Sep 2026
- Not shown
- Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,457
Overall · rank 46 of 409
- Unit
- Arena rating, higher is better
- Range
- 1,450 to 1,464
- Sample
- 9839 votes
- Configuration
- Hy3
- Measured
- 25 Sep 2026
- Not shown
- Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,429
Writing, literature and language · rank 51 of 408
- Unit
- Arena rating, higher is better
- Range
- 1,417 to 1,441
- Sample
- 2591 votes
- Configuration
- Hy3
- Measured
- 25 Sep 2026
- Not shown
- Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
