Models / Llama 3.1 405B Instruct (BF16)

Meta

Llama 3.1 405B Instruct (BF16)

Early evidence, 6 results from 1 source, on 1 use case. Llama 3.1 405B Instruct (BF16) trails most of the field on what it has been measured on; it is not on sale through OpenRouter, so it is here for reference.

Results 16 Nov 2026 · 6 results · 1 source

Price per million tokens
Not available through OpenRouter
Speed
Not measured
Intelligence Index
Not measured
Spring Prompt overall
Not ranked yet
needs our benchmarks and two groups of results
Developer
Meta, based in the US
Weights not published
Released
23 Jul 2024

How good is it, and for what?

Each use case ranks the available models its benchmarks measured. The bar shows its percentile in that field, best to the right. Open a row for the results behind it.

Product listingsTurning a sparse product feed and photos into listings that can go live Not measured
  • CatalogBench: has not measured this model.
Decks from an analysisTurning a finished analysis into a deck you could present as it is Not measured
  • DeckBench: has not measured this model.
User surveysPlanning a user survey and reading its results without being misled Not measured
  • SurveyBench: has not measured this model.
Marketing planningPlanning a year of ad spend without overspending Not measured
  • ROASBench: has not measured this model.
Agents and tool useMulti-step tasks with tools: support desks, coding agents, function calls Not measured
  • tau2-bench: has not measured this model.
  • Berkeley Function Calling Leaderboard (BFCL) V4: has not measured this model.
  • OpenHands Index: has not measured this model.
  • Microsoft STATE-Bench: has not measured this model.
  • Artificial Analysis: has not measured this model.
  • Vending-Bench 2: has not measured this model.
Professional workReal tasks from banking, consulting and law, business documents and freelance projects Not measured
  • APEX-Agents: has not measured this model.
  • GDP.pdf: has not measured this model.
  • Remote Labor Index: has not measured this model.
Reasoning and knowledgeHard questions across science, maths and general knowledge Not measured
  • Artificial Analysis: has not measured this model.
WritingWhat people prefer in blind comparisons, and judged writing quality 135th of 170 available
BenchmarkLlama 3.1 405B Instruct (BF16)Rank among availableBest available
Arena (formerly LMArena)Arena Text: overall · reported 1,335 126th of 154 Gemini 4 Argon 1,525
  • UGI Leaderboard: has not measured this model.
Sticking to the factsSummarising without inventing things, and factual answers Not measured
  • Vectara Hallucination Leaderboard: has not measured this model.
  • Arena (formerly LMArena): has not measured this model.
  • SimpleQA Verified (Epoch AI): has not measured this model.
Speed under pressureGood decisions against a real clock (fast chess) Not measured
  • BulletBench: has not measured this model.

Nearest alternatives

  • Meta's newer, at least as capable modelMuse Wonder$8.00 blended · Intelligence Index 52.4
  • The most capable open-weights modelMiMo-V2.6-Pro$0.54 blended · Intelligence Index 46.3

Against Llama 3.1 405B Instruct (BF16). "Similar intelligence" means within 4 points or better.

Against the alternatives

The models you would most likely weigh it against: the leaders of the groups above.

Scroll sideways to see every alternative.

Llama 3.1 405B Instruct (BF16)Claude Fable 5.2
leads overall
Muse Wonder
Meta's best other model
Claude Opus 5.5
near the top overall
GPT-6.1 Sol
near the top overall
Price per million tokens – $16.00$8.00$8.00$4.00
Tokens a second – –1539653
Intelligence Index – –52.457.651.8
Spring Prompt overall – 90708280
Rank among available models, by use case
Product listings – 5th5th13th2nd
Decks from an analysis – 4th13th7th5th
User surveys – 1st2nd4th3rd
Marketing planning – 1st22nd9th–
Agents and tool use – –11th3rd6th
Professional work – ––3rd9th
Reasoning and knowledge – –8th1st6th
Writing 135th of 170 ––5th16th
Sticking to the facts – ––3rd18th
Speed under pressure – 8th14th–3rd

Shaded figures are better than Llama 3.1 405B Instruct (BF16)'s. A dash means no result.

Where it has been measured

Compared with the models available today (it is not on sale itself), in the bottom quarter for writing.

Not timed: Artificial Analysis, our source for speed, has not tested it

Every result

6 published results from 1 source, each in the source's own units, with the configuration that produced it.

Arena (formerly LMArena) · reported by Arena (formerly LMArena) · 6 results
MeasureValueRankConfigurationDated
Arena Text: business, management and financeArena rating, higher is better 1,313
1,304–1,322
257 of 406 Llama 3.1 405B Instruct (BF16) 2 Oct 2026
Arena Text: creative writingArena rating, higher is better 1,301
1,294–1,309
235 of 411 Llama 3.1 405B Instruct (BF16) 2 Oct 2026
Arena Text: expert promptsArena rating, higher is better 1,312
1,299–1,325
248 of 363 Llama 3.1 405B Instruct (BF16) 2 Oct 2026
Arena Text: instruction followingArena rating, higher is better 1,314
1,309–1,320
246 of 413 Llama 3.1 405B Instruct (BF16) 2 Oct 2026
Arena Text: overallArena rating, higher is better 1,335
1,332–1,339
239 of 413 Llama 3.1 405B Instruct (BF16) 2 Oct 2026
Arena Text: writing, literature and languageArena rating, higher is better 1,312
1,306–1,318
235 of 412 Llama 3.1 405B Instruct (BF16) 2 Oct 2026

Not shown: Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.

Test your own prompt.

Benchmarks aren't your task. Run your prompt on the models you could use, with every answer checked and costed.