Compare / Mistral Small 4 vs GPT-5.4 mini
Mistral Small 4 vs GPT-5.4 mini
Which is cheaper, which is more capable, and which does better at each kind of work, from 22 results on 2 sources that measured both models.
Results as of 8 October 2026 (catalogue release 2026-10-08-4199ce0620fe).
Mistral Small 4 or GPT-5.4 mini? The short answer
Pick GPT-5.4 mini if quality matters most: it scores higher (Intelligence Index 24.1 against 11.3). Pick Mistral Small 4 if cost matters more: it costs 5.3 times less per game of bullet chess on BulletBench.
- Mistral Small 4 is cheaper to run: $0.004 against $0.021 per game of bullet chess on BulletBench (5.3 times less).
- GPT-5.4 mini scores higher on the Artificial Analysis Intelligence Index: 24.1 against 11.3.
- GPT-5.4 mini is newer: released 17 Mar 2026, against 16 Mar 2026 for Mistral Small 4.
- On third-party benchmarks, on the results both models have: GPT-5.4 mini does better for agents and tool use and reasoning and knowledge.
At a glance
| Mistral Small 4 | GPT-5.4 mini | |
|---|---|---|
| Price per million tokens | $0.15 in · $0.60 out | $0.75 in · $4.50 out |
| Blended (3 in : 1 out) | $0.26 | $1.69 |
| Cheapest host, blended | $0.26 (Mistral) | $1.69 (Azure) |
| Cost per game of bullet chess (BulletBench) | $0.004 | $0.021 |
| Cached input, per million | $0.015 cached input | $0.075 cached input |
| Intelligence Index | 11.3 | 24.1 |
| Spring Prompt overall | – | – |
| Output speed, tokens a second | 164 | – |
| Context window | 262,144 tokens | 400,000 tokens |
| Released | 16 Mar 2026 | 17 Mar 2026 (newer) |
| Weights | Open | Closed |
| Developer based in | France | the US |
Prices are the developer's list price where we have read it, otherwise the typical host on OpenRouter; see every model's price. Intelligence and speed from Artificial Analysis.
Which is better for what
Each model's rank among models available today, for each kind of work, from our own benchmarks and licensed sources. The better rank is in green.
| Use case | Mistral Small 4 | GPT-5.4 mini |
|---|---|---|
| Agents and tool useMulti-step tasks with tools: support desks, coding agents, function calls | 132 of 164 | 56 of 164 |
| Reasoning and knowledgeHard questions across science, maths and general knowledge | 131 of 198 | 71 of 198 |
| WritingWhat people prefer in blind comparisons, and judged writing quality | 116 of 188 | 58 of 188 |
| Sticking to the factsSummarising without inventing things, and factual answers | not measured | 66 of 152 |
| Speed under pressureGood decisions against a real clock (fast chess) | 9 of 22 | 12 of 22 |
Every shared result
Each model's best result on every measure both have, grouped by benchmark, with the setting that produced it. The headline measures of each benchmark come first; the rest are under "Show all". Green marks the better value; where a source reports ranges that overlap, neither is marked.
| Measure | Mistral Small 4 | GPT-5.4 mini |
|---|---|---|
| BulletBench measured by Spring Prompt · 3 results | ||
| Cost per game · Bullet 60sUS dollars, lower is better | $0.0039no reasoning | $0.0205no reasoning |
| Ladder Elo · Bullet 60sladder Elo, higher is better | 367no reasoning | 197no reasoning |
| Ladder Elo · Lightning 10+1ladder Elo, higher is better | 571no reasoning | 571no reasoning |
| Artificial Analysis reported by Artificial Analysis · 3 results | ||
| Artificial Analysis Intelligence Indexindex score, higher is better | 11.3 | 24.1xhigh reasoning |
| GPQA Diamond% of questions, higher is better | 76.9% | 87.5%xhigh reasoning |
| Humanity's Last Exam% of questions, higher is better | 9.9% | 28.1%xhigh reasoning |
Show all 22 results (16 more)
| Measure | Mistral Small 4 | GPT-5.4 mini |
|---|---|---|
| BulletBench measured by Spring Prompt · 7 results | ||
| Cost per game · Lightning 10+1US dollars, lower is better | $0.0041no reasoning | $0.0136no reasoning |
| Games lost on time · Bullet 60s% of games, lower is better | 25.0%no reasoning | 50.0%no reasoning |
| Games lost on time · Lightning 10+1% of games, lower is better | 0.0%no reasoning | 0.0%no reasoning |
| Invalid moves · Bullet 60s% of moves, lower is better | 0.6%no reasoning | 0.0%no reasoning |
| Invalid moves · Lightning 10+1% of moves, lower is better | 1.0%no reasoning | 0.0%no reasoning |
| Median move time · Bullet 60smilliseconds, lower is better | 0.6 sno reasoning | 0.9 sno reasoning |
| Median move time · Lightning 10+1milliseconds, lower is better | 0.6 sno reasoning | 0.9 sno reasoning |
| Artificial Analysis reported by Artificial Analysis · 9 results | ||
| Terminal-Bench 2.1% of tasks, higher is better | 21.0% | 59.2%xhigh reasoning |
| Terminal-Bench 4.0% of tasks, higher is better | 0.0% | 2.0%xhigh reasoning |
| τ-bench banking% of tasks, higher is better | 4.9% | 25.6%xhigh reasoning |
| Artificial Analysis Coding Indexindex score, higher is better | 26.6 | 56.1xhigh reasoning |
| IFBench% of instructions, higher is better | 48.2% | 73.3%xhigh reasoning |
| Long-context reasoning (AA-LCR)% of questions, higher is better | 49.7% | 77.0%xhigh reasoning |
| SciCode% of problems, higher is better | 38.8% | 52.1%xhigh reasoning |
| Terminal-Bench Hard% of tasks, higher is better | 17.4% | 52.3%xhigh reasoning |
| τ²-bench telecom% of tasks, higher is better | 41.2% | 83.3%xhigh reasoning |
Quick answers
Is Mistral Small 4 better than GPT-5.4 mini?
Pick GPT-5.4 mini if quality matters most: it scores higher (Intelligence Index 24.1 against 11.3). Pick Mistral Small 4 if cost matters more: it costs 5.3 times less per game of bullet chess on BulletBench.
Which is cheaper, Mistral Small 4 or GPT-5.4 mini?
Mistral Small 4 is cheaper to run: $0.004 against $0.021 per game of bullet chess on BulletBench (5.3 times less).
Run Mistral Small 4 and GPT-5.4 mini on your own prompt
Benchmarks aren't your data. Try both side by side in the playground, with the cost of every answer.