Compare / Phi 4 vs Ministral 3 14B 2512

Phi 4 vs Ministral 3 14B 2512

Which is cheaper, which is more capable, and which does better at each kind of work, from 14 results on 3 sources that measured both models.

Phi 4
Microsoft · profile
Ministral 3 14B 2512
Mistral · profile
Results compared
14
Shared sources
3

Phi 4 or Ministral 3 14B 2512? The short answer

  • Phi 4 is cheaper: $0.088 against $0.20 per million tokens, 2.3 times less.
  • They score about the same on the Artificial Analysis Intelligence Index (5.9 and 6.0).
  • Ministral 3 14B 2512 writes faster: 91 tokens a second against 42.
  • On our business benchmarks, Phi 4 ranks higher for agents and tool use and sticking to the facts.
  • On our business benchmarks, Ministral 3 14B 2512 ranks higher for reasoning and knowledge and writing.

At a glance

Phi 4Ministral 3 14B 2512
Price per million tokens$0.070 in · $0.14 out$0.20 in · $0.20 out
Blended (3 in : 1 out)$0.088$0.20
Cheapest host, blended–$0.20 (Mistral)
Intelligence Index5.96.0
Spring Prompt overall––
Output speed, tokens a second4291
Context window16,384 tokens262,144 tokens
WeightsOpenOpen
Developer based inthe USFrance

Prices are the developer's list price where we have read it, otherwise the typical host on OpenRouter; see every model's price. Intelligence and speed from Artificial Analysis.

Which is better for what

Each model's rank among models available today, for each kind of work, from our own benchmarks and licensed sources. The better rank is in green.

Use casePhi 4Ministral 3 14B 2512
Agents and tool useMulti-step tasks with tools: support desks, coding agents, function calls 122 of 161 128 of 161
Reasoning and knowledgeHard questions across science, maths and general knowledge 178 of 195 167 of 195
WritingWhat people prefer in blind comparisons, and judged writing quality 175 of 187 143 of 187
Sticking to the factsSummarising without inventing things, and factual answers 3 of 153 146 of 153

Every shared result

BenchmarkMetricPhi 4Ministral 3 14B 2512
Artificial AnalysisreportedArtificial Analysis Intelligence Indexindex score 5.906.00
Artificial AnalysisreportedGPQA Diamond% of questions 57.5%57.2%
Artificial AnalysisreportedHumanity's Last Exam% of questions 3.8%4.6%
Artificial AnalysisreportedIFBench% of instructions 23.5%32.0%
Artificial AnalysisreportedLong-context reasoning (AA-LCR)% of questions 0.0%26.3%
Artificial AnalysisreportedOutput speedtokens per second 42.391.3
Artificial AnalysisreportedTerminal-Bench Hard% of tasks 3.8%4.5%
Artificial AnalysisreportedTime to first answer tokenseconds 1.030.50
Artificial AnalysisreportedΤ²-bench telecom% of tasks 0.0%27.2%
UGI LeaderboardreportedRequested-length error% off the requested word count 19.0%24.0%
UGI LeaderboardreportedStyle adherencescore from 0 to 1 0.340.32
UGI LeaderboardreportedWriting scorescore out of 100 25.731.4
Vectara Hallucination LeaderboardreportedAnswer rate% of documents 80.7%99.6%
Vectara Hallucination LeaderboardreportedHallucination rate% of summaries 3.7%19.4%

Bold green marks the better value on that metric. Where a source reports ranges that overlap, the difference may not be meaningful; see the benchmark page for ranges.

Quick answers

Is Phi 4 better than Ministral 3 14B 2512?

It depends on the task. Among models available today, on our benchmarks and licensed sources, Phi 4 ranks higher for agents and tool use and sticking to the facts; Ministral 3 14B 2512 ranks higher for reasoning and knowledge and writing.

Which is cheaper, Phi 4 or Ministral 3 14B 2512?

Phi 4 costs $0.088 per million tokens (three input to one output), against $0.20 for Ministral 3 14B 2512.

Which is faster, Phi 4 or Ministral 3 14B 2512?

Ministral 3 14B 2512 writes about 91 tokens a second on its usual API, against 42 for Phi 4 (Artificial Analysis).

Run Phi 4 and Ministral 3 14B 2512 on your own prompt

Benchmarks aren't your data. Try both side by side in the playground, with the cost of every answer.