0.00
Confirmed task success · rank 18 of 46
- Unit
- IPS effect estimate, higher is better
- Range
- -0.01 to 0.02
- Sample
- 45217 observations
- Configuration
- Gemini 3.7 Flash
- Measured
- 28 Sep 2026
- Not shown
- Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
-0.03
Praise over complaint · rank 23 of 46
- Unit
- IPS effect estimate, higher is better
- Range
- -0.05 to -0.01
- Sample
- 19452 observations
- Configuration
- Gemini 3.7 Flash
- Measured
- 28 Sep 2026
- Not shown
- Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
-0.00
Steerability · rank 16 of 46
- Unit
- IPS effect estimate, higher is better
- Range
- -0.01 to 0.01
- Sample
- 59108 observations
- Configuration
- Gemini 3.7 Flash
- Measured
- 28 Sep 2026
- Not shown
- Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
-0.00
Tool grounding · rank 27 of 46
- Unit
- IPS effect estimate, higher is better
- Range
- -0.00 to 0.00
- Sample
- 4100690 observations
- Configuration
- Gemini 3.7 Flash
- Measured
- 28 Sep 2026
- Not shown
- Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
1,477
Overall · rank 6 of 177
- Unit
- Arena rating, higher is better
- Range
- 1,473 to 1,482
- Sample
- 18668 votes
- Configuration
- Gemini 3.7 Flash (high)
- Measured
- 25 Sep 2026
- Not shown
- Not an error rate: claims that cannot be checked on the web are skipped, and preference still carries most of the weight.
1,483
Business, management and finance · rank 6 of 402
- Unit
- Arena rating, higher is better
- Range
- 1,473 to 1,494
- Sample
- 3553 votes
- Configuration
- Gemini 3.7 Flash (high)
- Measured
- 25 Sep 2026
- Not shown
- Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,492
Creative writing · rank 1 of 407
- Unit
- Arena rating, higher is better
- Range
- 1,482 to 1,503
- Sample
- 4080 votes
- Configuration
- Gemini 3.7 Flash (high)
- Measured
- 25 Sep 2026
- Not shown
- Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,512
Expert prompts · rank 7 of 359
- Unit
- Arena rating, higher is better
- Range
- 1,499 to 1,524
- Sample
- 2261 votes
- Configuration
- Gemini 3.7 Flash (high)
- Measured
- 25 Sep 2026
- Not shown
- Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,487
Instruction following · rank 5 of 409
- Unit
- Arena rating, higher is better
- Range
- 1,479 to 1,495
- Sample
- 6938 votes
- Configuration
- Gemini 3.7 Flash (high)
- Measured
- 25 Sep 2026
- Not shown
- Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,488
Overall · rank 7 of 409
- Unit
- Arena rating, higher is better
- Range
- 1,483 to 1,493
- Sample
- 19044 votes
- Configuration
- Gemini 3.7 Flash (high)
- Measured
- 25 Sep 2026
- Not shown
- Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,496
Writing, literature and language · rank 1 of 408
- Unit
- Arena rating, higher is better
- Range
- 1,487 to 1,505
- Sample
- 5129 votes
- Configuration
- Gemini 3.7 Flash (high)
- Measured
- 25 Sep 2026
- Not shown
- Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
8.0%
Requested-length error · rank 55 of 370
- Unit
- % off the requested word count, lower is better
- Configuration
- Gemini 3.7 Flash (high)
- Measured
- 3 Sep 2026
- Not shown
- Not other format limits such as character counts or bullet counts.
9.0%
Requested-length error · rank 67 of 370
- Unit
- % off the requested word count, lower is better
- Configuration
- Gemini 3.7 Flash (low reasoning)
- Measured
- 3 Sep 2026
- Not shown
- Not other format limits such as character counts or bullet counts.
7.0%
Requested-length error · rank 48 of 370
- Unit
- % off the requested word count, lower is better
- Configuration
- Gemini 3.7 Flash (medium reasoning)
- Measured
- 3 Sep 2026
- Not shown
- Not other format limits such as character counts or bullet counts.
0.32
Style adherence · rank 279 of 370
- Unit
- score from 0 to 1, higher is better
- Configuration
- Gemini 3.7 Flash (high)
- Measured
- 3 Sep 2026
- Not shown
- Not brand voice on your own examples: UGI's prompts are private and lean towards creative writing.
0.31
Style adherence · rank 315 of 370
- Unit
- score from 0 to 1, higher is better
- Configuration
- Gemini 3.7 Flash (low reasoning)
- Measured
- 3 Sep 2026
- Not shown
- Not brand voice on your own examples: UGI's prompts are private and lean towards creative writing.
0.33
Style adherence · rank 266 of 370
- Unit
- score from 0 to 1, higher is better
- Configuration
- Gemini 3.7 Flash (medium reasoning)
- Measured
- 3 Sep 2026
- Not shown
- Not brand voice on your own examples: UGI's prompts are private and lean towards creative writing.
76.2
Writing score · rank 3 of 370
- Unit
- score out of 100, higher is better
- Configuration
- Gemini 3.7 Flash (high)
- Measured
- 3 Sep 2026
- Not shown
- Not business copy quality: UGI's prompts are private and lean towards creative writing, and models that often refuse get no score.
76.1
Writing score · rank 4 of 370
- Unit
- score out of 100, higher is better
- Configuration
- Gemini 3.7 Flash (low reasoning)
- Measured
- 3 Sep 2026
- Not shown
- Not business copy quality: UGI's prompts are private and lean towards creative writing, and models that often refuse get no score.
77.5
Writing score · rank 2 of 370
- Unit
- score out of 100, higher is better
- Configuration
- Gemini 3.7 Flash (medium reasoning)
- Measured
- 3 Sep 2026
- Not shown
- Not business copy quality: UGI's prompts are private and lean towards creative writing, and models that often refuse get no score.