Models / Llama 3.1 Nemotron Ultra 253B v1

NVIDIA

Llama 3.1 Nemotron Ultra 253B v1

Early evidence, 13 results from 2 sources, on 2 use cases. Llama 3.1 Nemotron Ultra 253B v1 trails most of the field on what it has been measured on; it is not on sale through OpenRouter, so it is here for reference.

Results 16 Nov 2026 · 13 results · 2 sources

Price per million tokens
Not available through OpenRouter
Speed
Not measured
Intelligence Index
Not measured
Spring Prompt overall
Not ranked yet
needs our benchmarks and two groups of results
Developer
NVIDIA, based in the US
Weights not published
Released
Not recorded
no launch date in our tracker or our sources

How good is it, and for what?

Each use case ranks the available models its benchmarks measured. The bar shows its percentile in that field, best to the right. Open a row for the results behind it.

Product listingsTurning a sparse product feed and photos into listings that can go live Not measured
  • CatalogBench: has not measured this model.
Decks from an analysisTurning a finished analysis into a deck you could present as it is Not measured
  • DeckBench: has not measured this model.
User surveysPlanning a user survey and reading its results without being misled Not measured
  • SurveyBench: has not measured this model.
Marketing planningPlanning a year of ad spend without overspending Not measured
  • ROASBench: has not measured this model.
Agents and tool useMulti-step tasks with tools: support desks, coding agents, function calls 160th of 160 available
BenchmarkLlama 3.1 Nemotron Ultra 253B v1Rank among availableBest available
Berkeley Function Calling Leaderboard (BFCL) V4BFCL: overall accuracy · reported 10.0% 37th of 37 Claude Opus 4.5 77.5%
  • tau2-bench: has not measured this model.
  • OpenHands Index: has not measured this model.
  • Microsoft STATE-Bench: has not measured this model.
  • Artificial Analysis: has not measured this model.
  • Vending-Bench 2: has not measured this model.
Professional workReal tasks from banking, consulting and law, business documents and freelance projects Not measured
  • APEX-Agents: has not measured this model.
  • GDP.pdf: has not measured this model.
  • Remote Labor Index: has not measured this model.
Reasoning and knowledgeHard questions across science, maths and general knowledge Not measured
  • Artificial Analysis: has not measured this model.
WritingWhat people prefer in blind comparisons, and judged writing quality 130th of 170 available
BenchmarkLlama 3.1 Nemotron Ultra 253B v1Rank among availableBest available
Arena (formerly LMArena)Arena Text: overall · reported 1,348 120th of 154 Gemini 4 Argon 1,525
  • UGI Leaderboard: has not measured this model.
Sticking to the factsSummarising without inventing things, and factual answers Not measured
  • Vectara Hallucination Leaderboard: has not measured this model.
  • Arena (formerly LMArena): has not measured this model.
  • SimpleQA Verified (Epoch AI): has not measured this model.
Speed under pressureGood decisions against a real clock (fast chess) Not measured
  • BulletBench: has not measured this model.

Nearest alternatives

  • The most capable open-weights modelMiMo-V2.6-Pro$0.54 blended · Intelligence Index 46.3

Against Llama 3.1 Nemotron Ultra 253B v1. "Similar intelligence" means within 4 points or better.

Against the alternatives

The models you would most likely weigh it against: the leaders of the groups above.

Scroll sideways to see every alternative.

Llama 3.1 Nemotron Ultra 253B v1Claude Fable 5.2
leads overall
Claude Opus 5.5
near the top overall
GPT-6.1 Sol
near the top overall
GPT-6.1 Terra
near the top overall
Price per million tokens – $16.00$8.00$4.00$2.00
Tokens a second – –9653–
Intelligence Index – –57.651.8–
Spring Prompt overall – 90828080
Rank among available models, by use case
Product listings – 5th13th2nd4th
Decks from an analysis – 4th7th5th8th
User surveys – 1st4th3rd8th
Marketing planning – 1st9th–2nd
Agents and tool use 160th of 160 –3rd6th7th
Professional work – –3rd9th–
Reasoning and knowledge – –1st6th22nd
Writing 130th of 170 –5th16th–
Sticking to the facts – –3rd18th–
Speed under pressure – 8th–3rd17th

Shaded figures are better than Llama 3.1 Nemotron Ultra 253B v1's. A dash means no result.

Where it has been measured

Compared with the models available today (it is not on sale itself), in the bottom quarter for agents and tool use, and writing.

Not timed: Artificial Analysis, our source for speed, has not tested it

Every result

13 published results from 2 sources, each in the source's own units, with the configuration that produced it.

Arena (formerly LMArena) · reported by Arena (formerly LMArena) · 5 results
MeasureValueRankConfigurationDated
Arena Text: business, management and financeArena rating, higher is better 1,342
1,308–1,376
225 of 406 Llama 3.1 Nemotron Ultra 253B v1 2 Oct 2026
Arena Text: creative writingArena rating, higher is better 1,332
1,305–1,359
199 of 411 Llama 3.1 Nemotron Ultra 253B v1 2 Oct 2026
Arena Text: instruction followingArena rating, higher is better 1,351
1,330–1,373
201 of 413 Llama 3.1 Nemotron Ultra 253B v1 2 Oct 2026
Arena Text: overallArena rating, higher is better 1,348
1,336–1,359
219 of 413 Llama 3.1 Nemotron Ultra 253B v1 2 Oct 2026
Arena Text: writing, literature and languageArena rating, higher is better 1,321
1,300–1,342
224 of 412 Llama 3.1 Nemotron Ultra 253B v1 2 Oct 2026

Not shown: Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.

Berkeley Function Calling Leaderboard (BFCL) V4 · reported by Berkeley Function Calling Leaderboard (BFCL) V4 · 8 results
MeasureValueRankConfigurationDated
BFCL: irrelevance detection% correct, higher is better 100.0% 1 of 109 Llama 3.1 Nemotron Ultra 253B v1 (bfcl fc) 16 Dec 2025
BFCL: memory% correct, higher is better 0.0% 106 of 109 Llama 3.1 Nemotron Ultra 253B v1 (bfcl fc) 16 Dec 2025
BFCL: multi-turn tasks% correct, higher is better 0.0% 105 of 109 Llama 3.1 Nemotron Ultra 253B v1 (bfcl fc) 16 Dec 2025
BFCL: overall accuracy% correct, higher is better 10.0% 108 of 109 Llama 3.1 Nemotron Ultra 253B v1 (bfcl fc) 16 Dec 2025
BFCL: relevance detection% correct, higher is better 0.0% 107 of 109 Llama 3.1 Nemotron Ultra 253B v1 (bfcl fc) 16 Dec 2025
BFCL: single-turn calls (curated)% correct, higher is better 0.0% 108 of 109 Llama 3.1 Nemotron Ultra 253B v1 (bfcl fc) 16 Dec 2025
BFCL: single-turn calls (user-contributed)% correct, higher is better 0.0% 108 of 109 Llama 3.1 Nemotron Ultra 253B v1 (bfcl fc) 16 Dec 2025
BFCL: web search% correct, higher is better 0.0% 92 of 109 Llama 3.1 Nemotron Ultra 253B v1 (bfcl fc) 16 Dec 2025

Not shown: Not general refusal or safety behaviour.

Test your own prompt.

Benchmarks aren't your task. Run your prompt on the models you could use, with every answer checked and costed.