Models / GPT-4o (2024-08-06)

OpenAI

GPT-4o (2024-08-06)

GPT-4o (2024-08-06) trails most of the field on what it has been measured on; most buyers will do better with one of the alternatives below. The cheapest model of similar intelligence is Gemma 3 4B, at $0.04 per million tokens against $4.38.

Retiring 14 Jan 2027. OpenAI retires gpt-4o-2024-08-06; the official replacement is gpt-6-luna. How to re-test before you switch.

Results 16 Nov 2026 · 16 results · 4 sources

Test GPT-4o (2024-08-06) on your prompt → It runs beside the models you could use instead, with every answer checked and costed.

Price per million tokens
$2.50 in · $10.00 out
Typical host on OpenRouter, 10 Nov 2026 · compare prices
Speed
Not measured
Intelligence Index
7.7
Artificial Analysis
Spring Prompt overall
Not ranked yet
needs our benchmarks and two groups of results
Developer
OpenAI, based in the US
Weights not published
Released
6 Aug 2024 (Artificial Analysis)
128,000 tokens of context

Where it stands among the models you could choose

Available models grouped by price, intelligence, speed and developer location. Retired models are excluded.

AmongIntelligence IndexSpring Prompt overallPrice, blendedSpeed
Models available today 152nd of 185Claude Opus 5.5 – $4.38 blended, 86th percentilecheapest: Mistral Nemo –
Models priced $3–10 per million tokens 34th of 38Claude Opus 5.5 – sets this group –
Models with similar intelligence sets this group – $4.38 blended, 96th percentilecheapest: Gemma 3 4B –
Models from developers based in the US 76th of 92Claude Opus 5.5 – $4.38 blended, 73rd percentilecheapest: Gemma 3 4B –

The name under each rank is the leader of that group; green is the top quarter of the group and red the bottom quarter, by rank. Price is shown as a percentile: the share of the group that costs less, so lower is cheaper. "Sets this group" marks the measure the group is defined by. Spring Prompt overall is our score out of 100 across every source (how it works). Price is the developer's list price (or the typical OpenRouter host where we haven't read one) for three input tokens to one output; intelligence and speed are from Artificial Analysis (data sourced from Artificial Analysis); "similar intelligence" means within 4 points on its Intelligence Index. Developer locations are where each company is based, not where a model is served. Groups under 3 models are not ranked.

How good is it, and for what?

Each use case ranks the available models its benchmarks measured, then those priced $3–10 per million tokens. The bar shows its percentile in that field, best to the right. Open a row for the results behind it.

Product listingsTurning a sparse product feed and photos into listings that can go live Not measured
  • CatalogBench: has not measured this model.
Decks from an analysisTurning a finished analysis into a deck you could present as it is Not measured
  • DeckBench: has not measured this model.
User surveysPlanning a user survey and reading its results without being misled Not measured
  • SurveyBench: has not measured this model.
Marketing planningPlanning a year of ad spend without overspending Not measured
  • ROASBench: has not measured this model.
Agents and tool useMulti-step tasks with tools: support desks, coding agents, function calls Not measured
  • tau2-bench: has not measured this model.
  • Berkeley Function Calling Leaderboard (BFCL) V4: has not measured this model.
  • OpenHands Index: has not measured this model.
  • Microsoft STATE-Bench: has not measured this model.
  • Artificial Analysis: has not measured this model.
  • Vending-Bench 2: has not measured this model.
Professional workReal tasks from banking, consulting and law, business documents and freelance projects Not measured
  • APEX-Agents: has not measured this model.
  • GDP.pdf: has not measured this model.
  • Remote Labor Index: has not measured this model.
Reasoning and knowledgeHard questions across science, maths and general knowledge 168th of 187 available · 36th of 39 at its price
BenchmarkGPT-4o (2024-08-06)Rank among availableBest available
Artificial AnalysisArtificial Analysis: Artificial Analysis Intelligence Index · reported 7.7 152nd of 185 Claude Opus 5.5 57.6
Artificial AnalysisArtificial Analysis: Humanity's Last Exam · reported 2.3% 185th of 186 Claude Opus 5.5 61.4%
Artificial AnalysisArtificial Analysis: GPQA Diamond · reported 52.1% 144th of 168 GPT-6 Astra 96.3%
WritingWhat people prefer in blind comparisons, and judged writing quality 134th of 169 available · 32nd of 34 at its price
BenchmarkGPT-4o (2024-08-06)Rank among availableBest available
Arena (formerly LMArena)Arena Text: overall · reported 1,336 125th of 153 Gemini 4 Argon 1,525
  • UGI Leaderboard: has not measured this model.
Sticking to the factsSummarising without inventing things, and factual answers 96th of 139 available · 28th of 31 at its price
BenchmarkGPT-4o (2024-08-06)Rank among availableBest available
Vectara Hallucination LeaderboardVectara: hallucination rate · reported 9.6% 38th of 71 GPT-5.4 nano 3.1%
SimpleQA Verified (Epoch AI)SimpleQA Verified: correct answers · reported 26.0% 56th of 68 GPT-6 Astra 75.6%
  • Arena (formerly LMArena): has not measured this model.
Speed under pressureGood decisions against a real clock (fast chess) Not measured
  • BulletBench: has not measured this model.

Nearest alternatives

Against GPT-4o (2024-08-06) at $4.38 blended, Intelligence Index 7.7. "Similar intelligence" means within 4 points or better.

Where to run it

2 hosts on OpenRouter at the standard service tier, with a median of $4.38 blended per million tokens. Cheapest first.

HostQuantisationInputOutputBlended
Azurenot stated$2.50$10.00$4.38
OpenAInot stated$2.50$10.00$4.38

Prices per million tokens from OpenRouter's public endpoint list, checked 10 Nov 2026.

Against the alternatives

The models you would most likely weigh it against: the leaders of the groups above.

Scroll sideways to see every alternative.

GPT-4o (2024-08-06)Claude Opus 5.5
most intelligent at $3–10 per million tokens
Gemma 3 4B
cheapest with similar intelligence
Claude Fable 5.2
leads overall
GPT-6.1 Sol
OpenAI's best other model
Price per million tokens $4.38 $8.00$0.04$16.00$4.00
Tokens a second – 96––53
Intelligence Index 7.7 57.64.8–51.8
Spring Prompt overall – 82–9080
Rank among available models, by use case
Product listings – 13th–5th2nd
Decks from an analysis – 7th–4th5th
User surveys – 4th–1st3rd
Marketing planning – 9th–1st–
Agents and tool use – 3rd158th–6th
Professional work – 3rd––9th
Reasoning and knowledge 168th of 187 1st181st–6th
Writing 134th of 169 5th157th–16th
Sticking to the facts 96th of 139 3rd32nd–18th
Speed under pressure – ––8th3rd

Shaded figures are better than GPT-4o (2024-08-06)'s. A dash means no result.

Where it has been measured

34th most intelligent of the 38 models priced $3–10 per million tokens. Among models available today, in the bottom quarter for reasoning and knowledge, and writing.

Artificial Analysis lists it but has not published a speed for it yet

Every result

16 published results from 4 sources, each in the source's own units, with the configuration that produced it.

Arena (formerly LMArena) · reported by Arena (formerly LMArena) · 6 results
MeasureValueRankConfigurationDated
Arena Text: business, management and financeArena rating, higher is better 1,302
1,293–1,311
267 of 406 GPT-4o (2024-08-06) 2 Oct 2026
Arena Text: creative writingArena rating, higher is better 1,327
1,319–1,336
202 of 411 GPT-4o (2024-08-06) 2 Oct 2026
Arena Text: expert promptsArena rating, higher is better 1,311
1,299–1,324
250 of 363 GPT-4o (2024-08-06) 2 Oct 2026
Arena Text: instruction followingArena rating, higher is better 1,319
1,313–1,325
235 of 413 GPT-4o (2024-08-06) 2 Oct 2026
Arena Text: overallArena rating, higher is better 1,336
1,331–1,340
238 of 413 GPT-4o (2024-08-06) 2 Oct 2026
Arena Text: writing, literature and languageArena rating, higher is better 1,341
1,334–1,348
204 of 412 GPT-4o (2024-08-06) 2 Oct 2026

Not shown: Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.

Artificial Analysis · reported by Artificial Analysis · 7 results
MeasureValueRankConfigurationDated
Artificial Analysis: Artificial Analysis Intelligence Indexindex score, higher is better 7.7 357 of 413 GPT-4o (2024-08-06) 20 Oct 2026
Artificial Analysis: GPQA Diamond% of questions, higher is better 52.1% 316 of 360 GPT-4o (2024-08-06) 20 Oct 2026
Artificial Analysis: Humanity's Last Exam% of questions, higher is better 2.3% 416 of 419 GPT-4o (2024-08-06) 20 Oct 2026
Artificial Analysis: IFBench% of instructions, higher is better 36.0% 236 of 288 GPT-4o (2024-08-06) 20 Oct 2026
Artificial Analysis: Long-context reasoning (AA-LCR)% of questions, higher is better 41.0% 316 of 407 GPT-4o (2024-08-06) 20 Oct 2026
Artificial Analysis: Terminal-Bench Hard% of tasks, higher is better 8.3% 204 of 282 GPT-4o (2024-08-06) 20 Oct 2026
Artificial Analysis: τ²-bench telecom% of tasks, higher is better 28.9% 218 of 286 GPT-4o (2024-08-06) 20 Oct 2026

Not shown: Not business work, and a blend: read the parts for any one task.

SimpleQA Verified (Epoch AI) · reported by SimpleQA Verified (Epoch AI) · 1 result
MeasureValueRankConfigurationDated
SimpleQA Verified: correct answers% of questions, higher is better 26.0% 67 of 85 GPT-4o (2024-08-06) 31 Aug 2026

Not shown: Not answers grounded in your documents; tests what the model remembers.

Vectara Hallucination Leaderboard · reported by Vectara Hallucination Leaderboard · 2 results
MeasureValueRankConfigurationDated
Vectara: answer rate% of documents, higher is better 93.8% 96 of 108 GPT-4o (2024-08-06) 22 Sep 2026
Vectara: hallucination rate% of summaries, lower is better 9.6% 55 of 108 GPT-4o (2024-08-06) 22 Sep 2026

Not shown: Not a quality score: a low rate usually means content filters were triggered, and hallucination rates are measured on answered documents only.

Will GPT-4o (2024-08-06) work for your product?

Benchmarks aren't your task. Paste the prompt your product uses and run it beside the models you could use instead, with every answer checked and costed.

New here? Your email starts a free trial. No credit card needed.