Compare / Google vs Mistral AI
Google vs Mistral AI: which AI lab is ahead?
Each lab's best model on sale goes head to head on every kind of work we measure, from our own benchmarks and licensed sources. 28 models in all; a lab is only as good as the model you would actually pick from it.
Kinds of work led by each lab's best model there, of the 9 both are measured on.
Results as of 8 October 2026 (catalogue release 2026-10-08-4199ce0620fe). Models on sale means listed on OpenRouter today.
Google or Mistral AI? The short answer
Google is ahead: its best models beat Mistral AI's in 7 of the 9 kinds of work both are measured on; Mistral AI leads in 2.
- Pick Google for product listings, decks from an analysis, marketing planning, reasoning and knowledge, writing, sticking to the facts and speed under pressure.
- Pick Mistral AI for user surveys and agents and tool use.
- On our overall leaderboard, Gemini 3.8 Flash is #8 (61 of 100) and Mistral Large 4 is #17 (37).
- Prices start at $0.062 per million tokens for Google (Gemma 3 4B) and $0.058 for Mistral AI (Mistral Small 3).
Head to head
Each line names the model behind the number. Prices are blended, three input tokens to one output, at the developer's list price where we have read it; see every model's price. Intelligence Index from Artificial Analysis; overall score from our leaderboard.
Which lab is better for what
For each kind of work, each lab's best model there and its rank among every model on sale. Further right is better; the better rank is in green.
Every model, by intelligence and price
Each dot is a model on sale with an Intelligence Index from Artificial Analysis. Up is smarter; left is cheaper. Hover or tap a dot for its name.
GoogleMistral AI
On our overall leaderboard
The 5 of their models we rank overall: one score out of 100 across everything we publish (how the score works). Only models with enough of our own results are ranked.
- #8Gemini 3.8 Flash61
- #10Gemini 3.1 Pro Preview50
- #17Mistral Large 437
- #19Gemini 3.5 Flash-Lite27
- #20Mistral Medium 3.518
Benchmark by benchmark
The headline result of every benchmark both labs have models on: each lab's best model and its rank among the models on sale. Green marks the better rank.
| Measure | Mistral AI | |
|---|---|---|
| Agents and tool use | ||
| Berkeley Function Calling Leaderboard (BFCL) V4 · Overall accuracy · BFCL% correct, higher is better | 56.2%Gemini 2.5 Flash · 8 of 38 | 37.7%Mistral Medium 3 · 21 of 38 |
| Artificial Analysis · Terminal-Bench 4.0% of tasks, higher is better | 19.7%Gemini 3.8 Flash · 23 of 105 | 26.8%Mistral Large 4 · 17 of 105 |
| Artificial Analysis · Terminal-Bench 2.1% of tasks, higher is better | 87.6%Gemini 3.8 Flash · 8 of 115 | 50.6%Mistral Medium 3.5 · 58 of 115 |
| Artificial Analysis · τ-bench banking% of tasks, higher is better | 45.8%Gemini 3.8 Flash · 10 of 113 | 15.1%Mistral Medium 3.5 · 57 of 113 |
| Decks from an analysis | ||
| DeckBench · Deck ratingrating, higher is better | 894Gemini 3.8 Flash · 12 of 19 | 646Mistral Medium 3.5 · 16 of 19 |
| Marketing planning | ||
| ROASBench · Overall scorescore out of 100, higher is better | 51.4Gemini 3.8 Flash · 7 of 19 | 37.0Mistral Large 4 · 10 of 19 |
| Product listings | ||
| CatalogBench · Reliably publish-ready% of products, higher is better | 44.6%Gemini 3.1 Pro Preview · 8 of 20 | 17.9%Mistral Medium 3.5 · 16 of 20 |
| CatalogBench · Reliably publish-ready · sales brief% of products, higher is better | 16.1%Gemini 3.1 Pro Preview · 8 of 20 | 10.7%Mistral Medium 3.5 · 9 of 20 |
| Reasoning and knowledge | ||
| Artificial Analysis · Artificial Analysis Intelligence Indexindex score, higher is better | 40.9Gemini 3.8 Flash · 21 of 198 | 38.4Mistral Large 4 · 29 of 198 |
| Artificial Analysis · Humanity's Last Exam% of questions, higher is better | 47.9%Gemini 3.7 Flash · 12 of 197 | 35.0%Mistral Large 4 · 54 of 197 |
| Artificial Analysis · GPQA Diamond% of questions, higher is better | 95.3%Gemini 3.8 Flash · 2 of 187 | 76.9%Mistral Small 4 · 112 of 187 |
| Speed under pressure | ||
| BulletBench · Ladder Elo · Lightning 10+1ladder Elo, higher is better | 892Gemini 3.5 Flash-Lite · 1 of 14 | 571Mistral Small 4 · 4 of 14 |
| BulletBench · Ladder Elo · Bullet 60sladder Elo, higher is better | 1,068Gemini 3.8 Flash · 1 of 20 | 572Mistral Medium 3.5 · 6 of 20 |
| Sticking to the facts | ||
| Vectara Hallucination Leaderboard · Hallucination rate · Vectara% of summaries, lower is better | 3.3%Gemini 2.5 Flash-Lite · 2 of 79 | 5.1%Mistral Small 3 · 6 of 79 |
| Arena (formerly LMArena) · Overall · Text factualityArena rating, higher is better | 1,477Gemini 3.7 Flash · 12 of 113 | 1,434Mistral Large 3 · 71 of 113 |
| User surveys | ||
| SurveyBench · Analysis ratingrating, higher is better | 810Gemini 3.1 Pro Preview · 5 of 8 | 815Mistral Large 4 · 4 of 8 |
| Writing | ||
| Arena (formerly LMArena) · Overall · TextArena rating, higher is better | 1,495Gemini 3.8 Flash · 6 of 166 | 1,427Mistral Medium 3.5 · 73 of 166 |
| UGI Leaderboard · Writing score · UGIscore out of 100, higher is better | 78.6Gemini 3.8 Flash · 1 of 138 | 45.5Mistral Medium 3.5 · 68 of 138 |
Their models, one against one
- Gemini 3.8 Flash vs Mistral Large 4Benchmarks, price and which to pick
- Gemini 3.8 Flash vs Mistral Medium 3.5Benchmarks, price and which to pick
- Gemini 3.8 Flash vs Mistral Small 4Benchmarks, price and which to pick
- Gemini 3.1 Pro Preview vs Mistral Large 4Benchmarks, price and which to pick
- Gemini 3.1 Pro Preview vs Mistral Medium 3.5Benchmarks, price and which to pick
- Gemini 3.1 Pro Preview vs Mistral Small 4Benchmarks, price and which to pick
- Gemini 3.5 Flash-Lite vs Mistral Large 4Benchmarks, price and which to pick
- Gemini 3.5 Flash-Lite vs Mistral Medium 3.5Benchmarks, price and which to pick
Quick answers
Is Google or Mistral AI better?
Google is ahead: its best models beat Mistral AI's in 7 of the 9 kinds of work both are measured on; Mistral AI leads in 2.
What is Google's best model?
Gemini 3.8 Flash: #8 on the Spring Prompt overall leaderboard and 40.9 on the Artificial Analysis Intelligence Index.
What is Mistral AI's best model?
Mistral Large 4: #17 on the Spring Prompt overall leaderboard and 38.4 on the Artificial Analysis Intelligence Index.
Which is better for agents and tool use, Google or Mistral AI?
Mistral AI: its best model there, Mistral Large 4, ranks 21 of 164 models on sale, against 29 for Google's Gemini 3.7 Flash.
Which is better for reasoning and knowledge, Google or Mistral AI?
Google: its best model there, Gemini 3.8 Flash, ranks 12 of 198 models on sale, against 44 for Mistral AI's Mistral Large 4.
Which is better for writing, Google or Mistral AI?
Google: its best model there, Gemini 3.8 Flash, ranks 2 of 188 models on sale, against 86 for Mistral AI's Mistral Medium 3.5.
Which is cheaper, Google or Mistral AI?
Mistral AI's cheapest model with results, Mistral Small 3, costs $0.058 per million tokens (three input to one output), against $0.062 for Gemma 3 4B from Google.
Other labs compared
- Google vs OpenAIBest model against best model
- Anthropic vs GoogleBest model against best model
- Google vs xAIBest model against best model
- Google vs MetaBest model against best model
- DeepSeek vs GoogleBest model against best model
- Alibaba vs GoogleBest model against best model
- Mistral AI vs OpenAIBest model against best model
- Anthropic vs Mistral AIBest model against best model
Which model is best for your product?
Benchmarks aren't your data. We test the models from Google, Mistral AI and the rest on your own tasks, with the cost of every answer.