Compare / Gemini 3.8 Flash vs Mistral Large 4

Gemini 3.8 Flash vs Mistral Large 4

65 results from 4 sources that measured both models. Each row is in the source's own units; there is no overall winner.

Gemini 3.8 Flash
Google · profile
Mistral Large 4
Mistral · profile
Results compared
65
Shared sources
4
BenchmarkMetricGemini 3.8 FlashMistral Large 4
BulletBenchmeasured by usCost per gameUS dollars $0.0795$0.0082
BulletBenchmeasured by usGames lost on time% of games 12.5%0.0%
BulletBenchmeasured by usInvalid moves% of moves 0.0%0.6%
BulletBenchmeasured by usLadder Eloladder Elo 1,126555
BulletBenchmeasured by usMedian move timemilliseconds 4.0 s0.8 s
BulletBenchmeasured by usCost per gameUS dollars $0.0041$0.0117
BulletBenchmeasured by usGames lost on time% of games 83.3%58.3%
BulletBenchmeasured by usInvalid moves% of moves 0.0%1.8%
BulletBenchmeasured by usLadder Eloladder Elo 197249
BulletBenchmeasured by usMedian move timemilliseconds 1.8 s0.8 s
CatalogBenchmeasured by usChannel rules broken% of products 0.6%1.2%
CatalogBenchmeasured by usClaims to check% of products 5.4%3.3%
CatalogBenchmeasured by usContent quality% of checks 97.6%95.9%
CatalogBenchmeasured by usFailed outputs% of products 0.0%0.0%
CatalogBenchmeasured by usMissing UK information% of products 0.0%0.0%
CatalogBenchmeasured by usNot findable% of products 8.9%3.0%
CatalogBenchmeasured by usPublish-ready listings% of products 16.7%10.7%
CatalogBenchmeasured by usReliably publish-ready% of products 3.6%1.8%
CatalogBenchmeasured by usUnsupported claims% of products 81.5%80.4%
CatalogBenchmeasured by usUnsupported claimsclaims per product 3.083.69
CatalogBenchmeasured by usWrong attributes% of products 11.9%17.3%
CatalogBenchmeasured by usWrong category or variant% of products 3.0%1.8%
CatalogBenchmeasured by usChannel compliance% of products 99.4%100.0%
CatalogBenchmeasured by usChannel rules broken% of products 0.6%3.0%
CatalogBenchmeasured by usClaims to check% of products 0.0%0.7%
CatalogBenchmeasured by usConflicts caught% of conflicts 100.0%100.0%
CatalogBenchmeasured by usContent quality% of checks 97.7%96.5%
CatalogBenchmeasured by usCost per productUS dollars $0.0103$0.0033
CatalogBenchmeasured by usDecision accuracy% of decisions 96.4%93.1%
CatalogBenchmeasured by usFailed outputs% of products 0.0%0.0%
CatalogBenchmeasured by usField accuracy% of missing fields 92.7%94.4%
CatalogBenchmeasured by usInvented values% of filled values 0.2%3.5%
CatalogBenchmeasured by usMissing UK information% of products 0.0%0.0%
CatalogBenchmeasured by usNot findable% of products 8.3%4.2%
CatalogBenchmeasured by usPublish-ready listings% of products 54.8%39.9%
CatalogBenchmeasured by usReliably publish-ready% of products 35.7%10.7%
CatalogBenchmeasured by usUnsupported claimsclaims per product 0.790.91
CatalogBenchmeasured by usUnsupported claims% of products 31.6%33.3%
CatalogBenchmeasured by usWrong attributes% of products 15.5%19.6%
CatalogBenchmeasured by usWrong category or variant% of products 3.6%1.2%
DeckBenchmeasured by usAccurate decks% of tasks 16.7%0.0%
DeckBenchmeasured by usCaveat dropped% of tasks 0.0%16.7%
DeckBenchmeasured by usClean layout% of tasks 16.7%33.3%
DeckBenchmeasured by usCost per deckUS dollars $0.0613$0.0148
DeckBenchmeasured by usDeck ratingrating 904515
DeckBenchmeasured by usDesign quality% of the maximum 61.7%30.5%
DeckBenchmeasured by usDraft figure quoted% of tasks 50.0%16.7%
DeckBenchmeasured by usFindings missing% of tasks 0.0%0.0%
DeckBenchmeasured by usHead-to-head win rate% of comparisons 42.9%10.7%
DeckBenchmeasured by usLayout defects% of tasks 83.3%66.7%
DeckBenchmeasured by usMisleading metric used% of tasks 0.0%0.0%
DeckBenchmeasured by usPresentable decks% of tasks 0.0%0.0%
DeckBenchmeasured by usRecommendation late or wrong% of tasks 33.3%83.3%
DeckBenchmeasured by usSlides needing work% of tasks 33.3%100.0%
DeckBenchmeasured by usUnsupported claims% of tasks 50.0%50.0%
DeckBenchmeasured by usUnsupported numbers% of tasks 16.7%33.3%
ROASBenchmeasured by usAudience scorescore out of 100 67.155.8
ROASBenchmeasured by usBusiness scorescore out of 100 51.034.2
ROASBenchmeasured by usConsistency scorescore out of 100 36.416.7
ROASBenchmeasured by usContribution profitsimulated US dollars $842,432$533,401
ROASBenchmeasured by usCost of a runUS dollars $0.16$0.0657
ROASBenchmeasured by usMonths over budgetmonths of 12 00
ROASBenchmeasured by usOverall scorescore out of 100 51.437.0
ROASBenchmeasured by usPlanning scorescore out of 100 54.755.0
ROASBenchmeasured by usReturn on ad spendprofit per $1 spent $0.65$0.45

Bold green marks the better value on that metric. Where a source reports ranges that overlap, the difference may not be meaningful; see the benchmark page for ranges.