OpenAI · frontier
Is o1 good?
o1 has been tested across 1 task areas. It's strongest at landing pages. It's a top-tier (premium) option ($75/1M tokens).
Our take
Strengths
Weak spots
How o1 ranks, task by task
Rank is the position in each field; Rating is the absolute quality bar. A model can be rated "Excellent" yet sit mid-table when the whole field is strong — and vice-versa.
| Task area | Rank | Percentile | Rating |
|---|---|---|---|
| Landing Pages | #51 of 56 |
|
Needs editing |
Industry benchmarks
Standardized third-party scores, shown for context — these are independent of our real-task tests.
Headline vs. real-world
Source: Artificial Analysis (artificialanalysis.ai) via OpenRouter (openrouter.ai/rankings). (2026-06-29) · Source: Design Arena (www.designarena.ai) via OpenRouter (openrouter.ai/rankings). (2026-06-29)
Like o1, but…
Similar
- MiniMax M2.7 Budget
- Gemini 2.5 Flash Budget
- Qwen3 Coder Flash Budget
Cheaper
- DeepSeek V3.2 99% cheaper
- Gemini 2.5 Flash 99% cheaper
- MiniMax M2.7 99% cheaper
Smarter
- GPT-5.5 +75 pts
- Gemini 3.1 Pro Preview +75 pts
- Claude Opus 4.8 +70 pts
Frequently asked
Is o1 any good?
o1 places top-3 in 0 of 1 task areas we benchmarked. It performs best at Landing Pages.
What is o1 best at?
Its strongest task areas are Landing Pages.
Is there a cheaper alternative to o1?
DeepSeek V3.2 is 99% cheaper and stays competitive on quality across our benchmarks.
How we test & rank
Each model is scored on real tasks across 1 task areas by an LLM judge with deterministic checks. "Percentile" is this model's standing within each area's field; the cross-area figures are rank-based so quality and Elo scores are never mixed.
This page is Spring Prompt, running
We just did this for every model. Do it for your prompt.
The rankings above come from running real tasks through real models and scoring every output. Spring Prompt is that same engine — pointed at your prompt, your test cases, and your definition of good.
- Generate test cases from your prompt — no eval set required to start.
- Compare models side by side with quality, cost and latency in one matrix.
- Optimise the winner until the scores say it's ready to ship.
Prompt × model results
12 test cases · 3 evals