Gemini 3.1 Pro Preview benchmark results and model details

Chess decision quality under a shared 60-second game clock and a 10+1 per-move clock.

Ladder Elo: anchored to a Stockfish skill ladder (random mover = 400). Internally consistent ordering, not FIDE-calibrated.

Can LLMs anticipate next week’s Guardian agenda from last week’s coverage?

This benchmark is not on a weekly live cadence yet. The table and charts reflect a single multi-model comparison on one forecast window—a pilot snapshot, not an updating leaderboard. The evaluation setup (clustering, prompts, automated judge, and scoring checks) is still being refined; reported scores and details may change as we improve the pipeline.

A 12-month performance-marketing simulation scored on business outcomes, planning, behavior, and persona fit.

Fixture-by-fixture football predictions frozen before the tournament and graded on outcomes, scorelines, goals, penalties, and cards.

32 fixtures graded from the frozen prediction artifact.

A composite index of language-model performance across agentic work, coding, scientific reasoning, knowledge, and long-context reasoning.

Artificial Analysis Coding Agent Index v1.2 point scores and task-specific operational measurements for exact agent and model configurations.

These are exact agent-plus-model configurations, not bare-model scores.

Artificial Analysis's agentic evaluation of economically valuable, real-world work tasks based on the GDPval dataset.

The most challenging subset of Graduate-Level Google-Proof Q&A, focused on scientific reasoning.

A broad expert-level benchmark of difficult academic reasoning and knowledge questions.

An instruction-following benchmark with diverse, verifiable out-of-domain output constraints.

A multimodal academic reasoning benchmark designed to reduce shortcuts and guessing across many disciplines.

Direct OpenHands SWE-Bench outcomes for resolving real repository issues with a pinned OpenHands agent and language-model configuration.

Scores are official OpenHands SWE-Bench resolved percentages for exact OpenHands and model configurations, not bare-model scores or SpringPrompt predictions. Twenty-nine exact task sidecars support marginal 95% bootstrap score intervals; five rows explicitly have no interval. No full-cohort rank confidence is claimed.

Directly measured ability to return accurate values in the requested structured schema across the benchmark's evaluated text, image and audio modalities.

Point order reproduces the source's direct Overall score. Rank ranges come from overlap of marginal record-cluster bootstrap intervals for Overall; they are not simultaneous confidence intervals for rank.

A terminal-based agent benchmark covering software engineering, system administration, data processing, model training, and security tasks.

A legacy agentic tool-use benchmark for conversational work in a telecom environment.