Compare / Claude Sonnet 5 vs Llama 3.1 70B Instruct

Claude Sonnet 5 vs Llama 3.1 70B Instruct

Which is cheaper, which is more capable, and which does better at each kind of work, from 12 results on 3 sources that measured both models.

Claude Sonnet 5
Anthropic · profile
Llama 3.1 70B Instruct
Meta · profile
Results compared
12
Shared sources
3

Claude Sonnet 5 or Llama 3.1 70B Instruct? The short answer

  • Llama 3.1 70B Instruct is cheaper: $0.40 against $4.00 per million tokens, 10 times less.
  • Claude Sonnet 5 scores higher on the Artificial Analysis Intelligence Index: 38.2 against 6.6.
  • On our business benchmarks, Claude Sonnet 5 ranks higher for reasoning and knowledge and writing.

At a glance

Claude Sonnet 5Llama 3.1 70B Instruct
Price per million tokens$2.00 in · $10.00 out$0.40 in · $0.40 out
Blended (3 in : 1 out)$4.00$0.40
Cheapest host, blended$4.00 (Claude Platform on AWS)$0.40 (DeepInfra, FP8)
Intelligence Index38.26.6
Spring Prompt overall––
Output speed, tokens a second––
Context window1,000,000 tokens131,072 tokens
WeightsClosedOpen
Developer based inthe USthe US

Prices are the developer's list price where we have read it, otherwise the typical host on OpenRouter; see every model's price. Intelligence and speed from Artificial Analysis.

Which is better for what

Each model's rank among models available today, for each kind of work, from our own benchmarks and licensed sources. The better rank is in green.

Use caseClaude Sonnet 5Llama 3.1 70B Instruct
Agents and tool useMulti-step tasks with tools: support desks, coding agents, function calls 33 of 161 not measured
Professional workReal tasks from banking, consulting and law, business documents and freelance projects 19 of 51 not measured
Reasoning and knowledgeHard questions across science, maths and general knowledge 32 of 195 179 of 195
WritingWhat people prefer in blind comparisons, and judged writing quality 36 of 187 153 of 187
Sticking to the factsSummarising without inventing things, and factual answers 84 of 153 not measured

Every shared result

BenchmarkMetricClaude Sonnet 5Llama 3.1 70B Instruct
Arena (formerly LMArena)reportedBusiness, management and financeArena rating 1,4651,287
Arena (formerly LMArena)reportedCreative writingArena rating 1,4351,257
Arena (formerly LMArena)reportedExpert promptsArena rating 1,5121,275
Arena (formerly LMArena)reportedInstruction followingArena rating 1,4671,273
Arena (formerly LMArena)reportedOverallArena rating 1,4621,293
Arena (formerly LMArena)reportedWriting, literature and languageArena rating 1,4521,264
Artificial AnalysisreportedArtificial Analysis Intelligence Indexindex score 38.26.60
Artificial AnalysisreportedGPQA Diamond% of questions 91.1%40.9%
Artificial AnalysisreportedHumanity's Last Exam% of questions 41.3%4.5%
UGI LeaderboardreportedRequested-length error% off the requested word count 3.0%15.0%
UGI LeaderboardreportedStyle adherencescore from 0 to 1 0.380.38
UGI LeaderboardreportedWriting scorescore out of 100 62.732.8

Bold green marks the better value on that metric. Where a source reports ranges that overlap, the difference may not be meaningful; see the benchmark page for ranges.

Quick answers

Is Claude Sonnet 5 better than Llama 3.1 70B Instruct?

It depends on the task. Among models available today, on our benchmarks and licensed sources, Claude Sonnet 5 ranks higher for reasoning and knowledge and writing.

Which is cheaper, Claude Sonnet 5 or Llama 3.1 70B Instruct?

Llama 3.1 70B Instruct costs $0.40 per million tokens (three input to one output), against $4.00 for Claude Sonnet 5.

Run Claude Sonnet 5 and Llama 3.1 70B Instruct on your own prompt

Benchmarks aren't your data. Try both side by side in the playground, with the cost of every answer.