Research
Findings and field notes.
What our benchmarks found, how we run them, and notes on building AI products you can trust.
-
Benchmarks · · 4 min readAI is now a better football pundit than the pundit. It still lost to one line of code.
We had six frontier AI models predict all 32 knockout matches of the 2026 World Cup, blind. They out-called a top BBC pundit. Then a one-line rule, always back the higher-ranked team, beat every single one of them on…
-
Benchmarks · · 3 min readSix models, one mind: What the World Cup revealed about how AIs actually think
Across 34 World Cup fixtures, six frontier AI models from five different labs picked the same winner 31 times. Then we gave them memory of the tournament and they changed zero of 96 picks. The herd is real, and it has…
-
Benchmarks · · 3 min readThe AI that won our World Cup benchmark didn't predict best. It read the rules.
GLM-5.2 won World Cup Bench by two points while spending the fewest reasoning tokens and posting an ordinary hit rate. It found the one free lunch in our scoring rules and ate it 34 times. A story about Goodhart's law…