1,126
Ladder Elo · rank 1 of 16
- Unit
- ladder Elo, higher is better
- Range
- 949 to 1,347
- Sample
- 8 games
- Configuration
- Gemini 3.8 Flash, provider default reasoning
- Measured
- 30 Sep 2026
- Not shown
- Not a business skill: chess against an engine on a real clock, used here as a speed-under-pressure signal.
4.0 s
Median move time · rank 4 of 16
- Unit
- milliseconds, lower is better
- Configuration
- Gemini 3.8 Flash, provider default reasoning
- Measured
- 30 Sep 2026
- Not shown
- Not general response speed: replies are one short move.
97.3%
Content quality · rank 7 of 18
- Unit
- % of checks, higher is better
- Configuration
- Gemini 3.8 Flash, provider default reasoning
- Measured
- 30 Sep 2026
- Not shown
- Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
0.0%
Failed outputs · rank 1 of 18
- Unit
- % of products, lower is better
- Configuration
- Gemini 3.8 Flash, provider default reasoning
- Measured
- 30 Sep 2026
- Not shown
- Not a provider outage: provider errors are retried before a product counts as failed.
2.4%
Publish-ready listings · rank 11 of 18
- Unit
- % of products, higher is better
- Configuration
- Gemini 3.8 Flash, provider default reasoning
- Measured
- 30 Sep 2026
- Not shown
- Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
1.8%
Reliably publish-ready · rank 8 of 18
- Unit
- % of products, higher is better
- Configuration
- Gemini 3.8 Flash, provider default reasoning
- Measured
- 30 Sep 2026
- Not shown
- Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
7.12
Unsupported claims · rank 11 of 18
- Unit
- claims per product, lower is better
- Configuration
- Gemini 3.8 Flash, provider default reasoning
- Measured
- 30 Sep 2026
- Not shown
- Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
98.8%
Channel compliance · rank 13 of 18
- Unit
- % of products, higher is better
- Configuration
- Gemini 3.8 Flash, provider default reasoning
- Measured
- 30 Sep 2026
- Not shown
- Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
100.0%
Conflicts caught · rank 1 of 18
- Unit
- % of conflicts, higher is better
- Configuration
- Gemini 3.8 Flash, provider default reasoning
- Measured
- 30 Sep 2026
- Not shown
- Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
97.1%
Content quality · rank 8 of 18
- Unit
- % of checks, higher is better
- Configuration
- Gemini 3.8 Flash, provider default reasoning
- Measured
- 30 Sep 2026
- Not shown
- Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
$0.0103
Cost per product · rank 9 of 18
- Unit
- US dollars, lower is better
- Configuration
- Gemini 3.8 Flash, provider default reasoning
- Measured
- 30 Sep 2026
- Not shown
- Not your cost: prices are those charged through OpenRouter on the run date.
94.3%
Decision accuracy · rank 13 of 18
- Unit
- % of decisions, higher is better
- Configuration
- Gemini 3.8 Flash, provider default reasoning
- Measured
- 30 Sep 2026
- Not shown
- Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
0.0%
Failed outputs · rank 1 of 18
- Unit
- % of products, lower is better
- Configuration
- Gemini 3.8 Flash, provider default reasoning
- Measured
- 30 Sep 2026
- Not shown
- Not a provider outage: provider errors are retried before a product counts as failed.
92.7%
Field accuracy · rank 12 of 18
- Unit
- % of missing fields, higher is better
- Configuration
- Gemini 3.8 Flash, provider default reasoning
- Measured
- 30 Sep 2026
- Not shown
- Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
0.2%
Invented values · rank 2 of 18
- Unit
- % of filled values, lower is better
- Configuration
- Gemini 3.8 Flash, provider default reasoning
- Measured
- 30 Sep 2026
- Not shown
- Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
33.3%
Publish-ready listings · rank 13 of 18
- Unit
- % of products, higher is better
- Configuration
- Gemini 3.8 Flash, provider default reasoning
- Measured
- 30 Sep 2026
- Not shown
- Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
16.1%
Reliably publish-ready · rank 12 of 18
- Unit
- % of products, higher is better
- Configuration
- Gemini 3.8 Flash, provider default reasoning
- Measured
- 30 Sep 2026
- Not shown
- Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
1.79
Unsupported claims · rank 13 of 18
- Unit
- claims per product, lower is better
- Configuration
- Gemini 3.8 Flash, provider default reasoning
- Measured
- 30 Sep 2026
- Not shown
- Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
$0.16
Cost of a run · rank 6 of 17
- Unit
- US dollars, lower is better
- Configuration
- Gemini 3.8 Flash, provider default reasoning
- Measured
- 29 Sep 2026
- Not shown
- Not your cost: prices are those charged through OpenRouter on the run date.
0
Months over budget · rank 1 of 17
- Unit
- months of 12, lower is better
- Configuration
- Gemini 3.8 Flash, provider default reasoning
- Measured
- 29 Sep 2026
- Not shown
- Not real ad performance: the market is a deterministic simulation of one invented skincare brand.
51.4
Overall score · rank 7 of 17
- Unit
- score out of 100, higher is better
- Configuration
- Gemini 3.8 Flash, provider default reasoning
- Measured
- 29 Sep 2026
- Not shown
- Not real ad performance: the market is a deterministic simulation of one invented skincare brand.
£0.65
Return on ad spend · rank 6 of 17
- Unit
- profit per £1 spent, higher is better
- Configuration
- Gemini 3.8 Flash, provider default reasoning
- Measured
- 29 Sep 2026
- Not shown
- Not real ad performance: the market is a deterministic simulation of one invented skincare brand.
0.09
Confirmed task success · rank 3 of 46
- Unit
- IPS effect estimate, higher is better
- Range
- 0.08 to 0.11
- Sample
- 21269 observations
- Configuration
- Gemini 3.8 Flash
- Measured
- 28 Sep 2026
- Not shown
- Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
0.05
Praise over complaint · rank 9 of 46
- Unit
- IPS effect estimate, higher is better
- Range
- 0.02 to 0.08
- Sample
- 7753 observations
- Configuration
- Gemini 3.8 Flash
- Measured
- 28 Sep 2026
- Not shown
- Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
0.04
Steerability · rank 6 of 46
- Unit
- IPS effect estimate, higher is better
- Range
- 0.02 to 0.06
- Sample
- 20838 observations
- Configuration
- Gemini 3.8 Flash
- Measured
- 28 Sep 2026
- Not shown
- Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
0.00
Tool grounding · rank 24 of 46
- Unit
- IPS effect estimate, higher is better
- Range
- 0.00 to 0.00
- Sample
- 3499854 observations
- Configuration
- Gemini 3.8 Flash
- Measured
- 28 Sep 2026
- Not shown
- Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
1,477
Overall · rank 6 of 177
- Unit
- Arena rating, higher is better
- Range
- 1,473 to 1,482
- Sample
- 21118 votes
- Configuration
- Gemini 3.8 Flash (high)
- Measured
- 25 Sep 2026
- Not shown
- Not an error rate: claims that cannot be checked on the web are skipped, and preference still carries most of the weight.
1,482
Business, management and finance · rank 7 of 402
- Unit
- Arena rating, higher is better
- Range
- 1,472 to 1,492
- Sample
- 4145 votes
- Configuration
- Gemini 3.8 Flash (high)
- Measured
- 25 Sep 2026
- Not shown
- Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,482
Creative writing · rank 4 of 407
- Unit
- Arena rating, higher is better
- Range
- 1,472 to 1,491
- Sample
- 4474 votes
- Configuration
- Gemini 3.8 Flash (high)
- Measured
- 25 Sep 2026
- Not shown
- Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,529
Expert prompts · rank 1 of 359
- Unit
- Arena rating, higher is better
- Range
- 1,517 to 1,541
- Sample
- 2597 votes
- Configuration
- Gemini 3.8 Flash (high)
- Measured
- 25 Sep 2026
- Not shown
- Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,488
Instruction following · rank 5 of 409
- Unit
- Arena rating, higher is better
- Range
- 1,480 to 1,496
- Sample
- 7901 votes
- Configuration
- Gemini 3.8 Flash (high)
- Measured
- 25 Sep 2026
- Not shown
- Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,492
Overall · rank 4 of 409
- Unit
- Arena rating, higher is better
- Range
- 1,487 to 1,498
- Sample
- 21728 votes
- Configuration
- Gemini 3.8 Flash (high)
- Measured
- 25 Sep 2026
- Not shown
- Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,486
Writing, literature and language · rank 4 of 408
- Unit
- Arena rating, higher is better
- Range
- 1,477 to 1,495
- Sample
- 5831 votes
- Configuration
- Gemini 3.8 Flash (high)
- Measured
- 25 Sep 2026
- Not shown
- Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
13.0%
Requested-length error · rank 103 of 370
- Unit
- % off the requested word count, lower is better
- Configuration
- Gemini 3.8 Flash (high)
- Measured
- 3 Sep 2026
- Not shown
- Not other format limits such as character counts or bullet counts.
16.0%
Requested-length error · rank 127 of 370
- Unit
- % off the requested word count, lower is better
- Configuration
- gemini-3.8-flash
- Measured
- 3 Sep 2026
- Not shown
- Not other format limits such as character counts or bullet counts.
14.0%
Requested-length error · rank 111 of 370
- Unit
- % off the requested word count, lower is better
- Configuration
- gemini-3.8-flash
- Measured
- 3 Sep 2026
- Not shown
- Not other format limits such as character counts or bullet counts.
0.34
Style adherence · rank 229 of 370
- Unit
- score from 0 to 1, higher is better
- Configuration
- Gemini 3.8 Flash (high)
- Measured
- 3 Sep 2026
- Not shown
- Not brand voice on your own examples: UGI's prompts are private and lean towards creative writing.
0.32
Style adherence · rank 285 of 370
- Unit
- score from 0 to 1, higher is better
- Configuration
- gemini-3.8-flash
- Measured
- 3 Sep 2026
- Not shown
- Not brand voice on your own examples: UGI's prompts are private and lean towards creative writing.
0.34
Style adherence · rank 238 of 370
- Unit
- score from 0 to 1, higher is better
- Configuration
- gemini-3.8-flash
- Measured
- 3 Sep 2026
- Not shown
- Not brand voice on your own examples: UGI's prompts are private and lean towards creative writing.
72.0
Writing score · rank 13 of 370
- Unit
- score out of 100, higher is better
- Configuration
- Gemini 3.8 Flash (high)
- Measured
- 3 Sep 2026
- Not shown
- Not business copy quality: UGI's prompts are private and lean towards creative writing, and models that often refuse get no score.
72.7
Writing score · rank 7 of 370
- Unit
- score out of 100, higher is better
- Configuration
- gemini-3.8-flash
- Measured
- 3 Sep 2026
- Not shown
- Not business copy quality: UGI's prompts are private and lean towards creative writing, and models that often refuse get no score.
78.5
Writing score · rank 1 of 370
- Unit
- score out of 100, higher is better
- Configuration
- gemini-3.8-flash
- Measured
- 3 Sep 2026
- Not shown
- Not business copy quality: UGI's prompts are private and lean towards creative writing, and models that often refuse get no score.