-0.23
Confirmed task success · rank 43 of 46
- Unit
- IPS effect estimate, higher is better
- Range
- -0.28 to -0.18
- Sample
- 4585 observations
- Configuration
- Solar Pro 4
- Measured
- 28 Sep 2026
- Not shown
- Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
-0.20
Praise over complaint · rank 41 of 46
- Unit
- IPS effect estimate, higher is better
- Range
- -0.25 to -0.15
- Sample
- 1729 observations
- Configuration
- Solar Pro 4
- Measured
- 28 Sep 2026
- Not shown
- Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
-0.10
Steerability · rank 40 of 46
- Unit
- IPS effect estimate, higher is better
- Range
- -0.14 to -0.07
- Sample
- 5935 observations
- Configuration
- Solar Pro 4
- Measured
- 28 Sep 2026
- Not shown
- Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
-0.02
Tool grounding · rank 40 of 46
- Unit
- IPS effect estimate, higher is better
- Range
- -0.03 to -0.01
- Sample
- 345719 observations
- Configuration
- Solar Pro 4
- Measured
- 28 Sep 2026
- Not shown
- Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
1,409
Overall · rank 129 of 177
- Unit
- Arena rating, higher is better
- Range
- 1,403 to 1,414
- Sample
- 13206 votes
- Configuration
- Solar Pro 4
- Measured
- 25 Sep 2026
- Not shown
- Not an error rate: claims that cannot be checked on the web are skipped, and preference still carries most of the weight.
1,386
Business, management and finance · rank 142 of 402
- Unit
- Arena rating, higher is better
- Range
- 1,374 to 1,398
- Sample
- 2590 votes
- Configuration
- Solar Pro 4
- Measured
- 25 Sep 2026
- Not shown
- Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,308
Creative writing · rank 191 of 407
- Unit
- Arena rating, higher is better
- Range
- 1,296 to 1,321
- Sample
- 2768 votes
- Configuration
- Solar Pro 4
- Measured
- 25 Sep 2026
- Not shown
- Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,433
Expert prompts · rank 98 of 359
- Unit
- Arena rating, higher is better
- Range
- 1,418 to 1,448
- Sample
- 1639 votes
- Configuration
- Solar Pro 4
- Measured
- 25 Sep 2026
- Not shown
- Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,379
Instruction following · rank 146 of 409
- Unit
- Arena rating, higher is better
- Range
- 1,370 to 1,388
- Sample
- 4925 votes
- Configuration
- Solar Pro 4
- Measured
- 25 Sep 2026
- Not shown
- Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,385
Overall · rank 161 of 409
- Unit
- Arena rating, higher is better
- Range
- 1,379 to 1,392
- Sample
- 13541 votes
- Configuration
- Solar Pro 4
- Measured
- 25 Sep 2026
- Not shown
- Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,336
Writing, literature and language · rank 184 of 408
- Unit
- Arena rating, higher is better
- Range
- 1,325 to 1,347
- Sample
- 3633 votes
- Configuration
- Solar Pro 4
- Measured
- 25 Sep 2026
- Not shown
- Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
