Compare / Gemma 3 27B vs Ministral 3 14B 2512

Gemma 3 27B vs Ministral 3 14B 2512

Which is cheaper, which is more capable, and which does better at each kind of work, from 17 results on 3 sources that measured both models.

Gemma 3 27B
Google · profile
Ministral 3 14B 2512
Mistral · profile
Results compared
17
Shared sources
3

Gemma 3 27B or Ministral 3 14B 2512? The short answer

  • Gemma 3 27B is cheaper: $0.14 against $0.20 per million tokens, 30% less.
  • Ministral 3 14B 2512 scores higher on the Artificial Analysis Intelligence Index: 6.0 against 4.9.
  • On our business benchmarks, Gemma 3 27B ranks higher for writing and sticking to the facts.
  • On our business benchmarks, Ministral 3 14B 2512 ranks higher for agents and tool use and reasoning and knowledge.

At a glance

Gemma 3 27BMinistral 3 14B 2512
Price per million tokens$0.12 in · $0.20 out$0.20 in · $0.20 out
Blended (3 in : 1 out)$0.14$0.20
Cheapest host, blended$0.10 (DeepInfra, FP8)$0.20 (Mistral)
Intelligence Index4.96.0
Spring Prompt overall––
Output speed, tokens a second–91
Context window131,072 tokens262,144 tokens
WeightsOpenOpen
Developer based inthe USFrance

Prices are the developer's list price where we have read it, otherwise the typical host on OpenRouter; see every model's price. Intelligence and speed from Artificial Analysis.

Which is better for what

Each model's rank among models available today, for each kind of work, from our own benchmarks and licensed sources. The better rank is in green.

Use caseGemma 3 27BMinistral 3 14B 2512
Agents and tool useMulti-step tasks with tools: support desks, coding agents, function calls 142 of 161 128 of 161
Reasoning and knowledgeHard questions across science, maths and general knowledge 188 of 195 167 of 195
WritingWhat people prefer in blind comparisons, and judged writing quality 111 of 187 143 of 187
Sticking to the factsSummarising without inventing things, and factual answers 96 of 153 146 of 153

Every shared result

BenchmarkMetricGemma 3 27BMinistral 3 14B 2512
Artificial AnalysisreportedArtificial Analysis Coding Indexindex score 10.114.4
Artificial AnalysisreportedArtificial Analysis Intelligence Indexindex score 4.906.00
Artificial AnalysisreportedGPQA Diamond% of questions 42.8%57.2%
Artificial AnalysisreportedHumanity's Last Exam% of questions 4.4%4.6%
Artificial AnalysisreportedIFBench% of instructions 31.8%32.0%
Artificial AnalysisreportedLong-context reasoning (AA-LCR)% of questions 7.3%26.3%
Artificial AnalysisreportedSciCode% of problems 23.3%23.8%
Artificial AnalysisreportedTerminal-Bench 2.1% of tasks 4.5%9.7%
Artificial AnalysisreportedTerminal-Bench 4.0% of tasks 0.0%0.0%
Artificial AnalysisreportedTerminal-Bench Hard% of tasks 3.8%4.5%
Artificial AnalysisreportedΤ-bench banking% of tasks 0.8%6.6%
Artificial AnalysisreportedΤ²-bench telecom% of tasks 10.5%27.2%
UGI LeaderboardreportedRequested-length error% off the requested word count 8.0%24.0%
UGI LeaderboardreportedStyle adherencescore from 0 to 1 0.290.32
UGI LeaderboardreportedWriting scorescore out of 100 45.031.4
Vectara Hallucination LeaderboardreportedAnswer rate% of documents 98.8%99.6%
Vectara Hallucination LeaderboardreportedHallucination rate% of summaries 7.4%19.4%

Bold green marks the better value on that metric. Where a source reports ranges that overlap, the difference may not be meaningful; see the benchmark page for ranges.

Quick answers

Is Gemma 3 27B better than Ministral 3 14B 2512?

It depends on the task. Among models available today, on our benchmarks and licensed sources, Gemma 3 27B ranks higher for writing and sticking to the facts; Ministral 3 14B 2512 ranks higher for agents and tool use and reasoning and knowledge.

Which is cheaper, Gemma 3 27B or Ministral 3 14B 2512?

Gemma 3 27B costs $0.14 per million tokens (three input to one output), against $0.20 for Ministral 3 14B 2512.

Run Gemma 3 27B and Ministral 3 14B 2512 on your own prompt

Benchmarks aren't your data. Try both side by side in the playground, with the cost of every answer.