Models / Gemma 3 12B
Gemma 3 12B
Gemma 3 12B is best for sticking to the facts; a strong pick at a modest price. The cheapest model of similar intelligence is Gemma 3 4B, at $0.04 per million tokens against $0.08.
Results 16 Nov 2026 · 31 results · 5 sources
Test Gemma 3 12B on your prompt → It runs beside the models you could use instead, with every answer checked and costed.
- Price per million tokens
- $0.05 in · $0.15 out
Typical host on OpenRouter, 10 Nov 2026 · compare prices - Speed
- Not measured
- Intelligence Index
- 3.8
Artificial Analysis - Spring Prompt overall
- Not ranked yet
needs our benchmarks and two groups of results - Developer
- Google, based in the US
Weights published - Released
- 11 Mar 2025
131,072 tokens of context
Where it stands among the models you could choose
Available models grouped by price, intelligence, speed and developer location, plus models with published weights. Retired models are excluded.
| Among | Intelligence Index | Spring Prompt overall | Price, blended | Speed |
|---|---|---|---|---|
| Models available today | 185th of 185Claude Opus 5.5 | – | $0.08 blended, 4th percentilecheapest: Mistral Nemo | – |
| Models priced under $0.25 per million tokens | 41st of 41Claude Haiku 5.5 | – | sets this group | – |
| Models with similar intelligence | sets this group | – | $0.08 blended, 15th percentilecheapest: Gemma 3 4B | – |
| Models from developers based in the US | 92nd of 92Claude Opus 5.5 | – | $0.08 blended, 5th percentilecheapest: Gemma 3 4B | – |
| Open-weights models | 104th of 104MiMo-V2.6-Pro | – | $0.08 blended, 5th percentilecheapest: Mistral Nemo | – |
The name under each rank is the leader of that group; green is the top quarter of the group and red the bottom quarter, by rank. Price is shown as a percentile: the share of the group that costs less, so lower is cheaper. "Sets this group" marks the measure the group is defined by. Spring Prompt overall is our score out of 100 across every source (how it works). Price is the developer's list price (or the typical OpenRouter host where we haven't read one) for three input tokens to one output; intelligence and speed are from Artificial Analysis (data sourced from Artificial Analysis); "similar intelligence" means within 4 points on its Intelligence Index. Developer locations are where each company is based, not where a model is served. Groups under 3 models are not ranked.
How good is it, and for what?
Each use case ranks the available models its benchmarks measured, then those priced under $0.25 per million tokens. The bar shows its percentile in that field, best to the right. Open a row for the results behind it.
Product listingsTurning a sparse product feed and photos into listings that can go live
- CatalogBench: has not measured this model.
Decks from an analysisTurning a finished analysis into a deck you could present as it is
- DeckBench: has not measured this model.
User surveysPlanning a user survey and reading its results without being misled
- SurveyBench: has not measured this model.
Marketing planningPlanning a year of ad spend without overspending
- ROASBench: has not measured this model.
Agents and tool useMulti-step tasks with tools: support desks, coding agents, function calls
| Benchmark | Gemma 3 12B | Rank among available | Best available |
|---|---|---|---|
| Berkeley Function Calling Leaderboard (BFCL) V4BFCL: overall accuracy · reported | 30.4% | 25th of 36 | Claude Opus 4.5 77.5% |
| Artificial AnalysisArtificial Analysis: Terminal-Bench 4.0 · reported | 0.0% | 67th of 107 | Kimi K3.1 Pro 67.2% |
| Artificial AnalysisArtificial Analysis: Terminal-Bench 2.1 · reported | 0.0% | 106th of 107 | Claude Fable 5.1 91.4% |
| Artificial AnalysisArtificial Analysis: τ-bench banking · reported | 0.8% | 102nd of 104 | Grok 4.6 50.7% |
- tau2-bench: has not measured this model.
- OpenHands Index: has not measured this model.
- Microsoft STATE-Bench: has not measured this model.
- Vending-Bench 2: has not measured this model.
Professional workReal tasks from banking, consulting and law, business documents and freelance projects
- APEX-Agents: has not measured this model.
- GDP.pdf: has not measured this model.
- Remote Labor Index: has not measured this model.
Reasoning and knowledgeHard questions across science, maths and general knowledge
| Benchmark | Gemma 3 12B | Rank among available | Best available |
|---|---|---|---|
| Artificial AnalysisArtificial Analysis: Artificial Analysis Intelligence Index · reported | 3.8 | 185th of 185 | Claude Opus 5.5 57.6 |
| Artificial AnalysisArtificial Analysis: Humanity's Last Exam · reported | 4.2% | 165th of 186 | Claude Opus 5.5 61.4% |
| Artificial AnalysisArtificial Analysis: GPQA Diamond · reported | 34.9% | 163rd of 168 | GPT-6 Astra 96.3% |
WritingWhat people prefer in blind comparisons, and judged writing quality
| Benchmark | Gemma 3 12B | Rank among available | Best available |
|---|---|---|---|
| Arena (formerly LMArena)Arena Text: overall · reported | 1,342 | 123rd of 153 | Gemini 4 Argon 1,525 |
| UGI LeaderboardUGI: writing score · reported | 29.9 | 105th of 124 | Gemini 3.8 Flash 78.6 |
Sticking to the factsSummarising without inventing things, and factual answers
| Benchmark | Gemma 3 12B | Rank among available | Best available |
|---|---|---|---|
| Vectara Hallucination LeaderboardVectara: hallucination rate · reported | 4.4% | 4th of 71 | GPT-5.4 nano 3.1% |
- Arena (formerly LMArena): has not measured this model.
- SimpleQA Verified (Epoch AI): has not measured this model.
Speed under pressureGood decisions against a real clock (fast chess)
- BulletBench: has not measured this model.
Nearest alternatives
- Cheaper at similar intelligenceGemma 3 4B$0.04 blended · Intelligence Index 4.8Compare with Gemma 3 12B →
- Google's newer, at least as capable modelGemini 4 Argon$4.00 blended · Intelligence Index 52.6Compare with Gemma 3 12B →
Against Gemma 3 12B at $0.08 blended, Intelligence Index 3.8. "Similar intelligence" means within 4 points or better.
Where to run it
2 hosts on OpenRouter at the standard service tier, with a median of $0.08 blended per million tokens; quantisation where the host states it: BF16, INT4. Cheapest first.
| Host | Quantisation | Input | Output | Blended |
|---|---|---|---|---|
| DeepInfra | BF16 | $0.05 | $0.15 | $0.08 |
| NextBit | INT4 | $0.07 | $0.15 | $0.09 |
Other service tiers, not counted above: DeepInfra flex $0.04 in, $0.12 out; DeepInfra priority $0.07 in, $0.23 out. Flex and batch are cheaper but slower or queued; priority and fast cost more.
Prices per million tokens from OpenRouter's public endpoint list, checked 10 Nov 2026.
Against the alternatives
The models you would most likely weigh it against: the leaders of the groups above.
Scroll sideways to see every alternative.
| Gemma 3 12B | Claude Haiku 5.5 most intelligent at under $0.25 per million tokens | Gemma 3 4B cheapest with similar intelligence | Claude Opus 5.5 most intelligent available today | MiMo-V2.6-Pro most intelligent with open weights | |
|---|---|---|---|---|---|
| Price per million tokens | $0.08 | $0.20 | $0.04 | $8.00 | $0.54 |
| Tokens a second | – | 240 | – | 96 | 43 |
| Intelligence Index | 3.8 | 43.4 | 4.8 | 57.6 | 46.3 |
| Spring Prompt overall | – | 40 | – | 82 | – |
| Rank among available models, by use case | |||||
| Product listings | – | 20th | – | 13th | – |
| Decks from an analysis | – | 18th | – | 7th | – |
| User surveys | – | 7th | – | 4th | – |
| Marketing planning | – | 30th | – | 9th | – |
| Agents and tool use | 144th of 159 | 28th | 158th | 3rd | 23rd |
| Professional work | – | – | – | 3rd | – |
| Reasoning and knowledge | 187th of 187 | 25th | 181st | 1st | 13th |
| Writing | 137th of 169 | – | 157th | 5th | 23rd |
| Sticking to the facts | 6th of 139 | – | 32nd | 3rd | 10th |
| Speed under pressure | – | 21st | – | – | – |
| Side by side → | Side by side → | Side by side → | |||
Shaded figures are better than Gemma 3 12B's. A dash means no result.
Where it has been measured
41st most intelligent of the 41 models priced under $0.25 per million tokens. Among models available today, in the top quarter (by percentile) for sticking to the facts; in the bottom quarter for agents and tool use, reasoning and knowledge, and writing.
Artificial Analysis lists it but has not published a speed for it yet
- Arena (formerly LMArena)6 results
- Artificial Analysis12 results
- Berkeley Function Calling Leaderboard (BFCL) V48 results
- UGI Leaderboard3 results
- Vectara Hallucination Leaderboard2 results
- BulletBenchNot measured
- CatalogBenchNot measured
- DeckBenchNot measured
- ROASBenchNot measured
- SurveyBenchNot measured
- APEX-AgentsNot measured
- GDP.pdfNot measured
- Microsoft STATE-BenchNot measured
- OpenHands IndexNot measured
- Remote Labor IndexNot measured
- SimpleQA Verified (Epoch AI)Not measured
- tau2-benchNot measured
- Vending-Bench 2Not measured
Every result
31 published results from 5 sources, each in the source's own units, with the configuration that produced it.
Arena (formerly LMArena) · reported by Arena (formerly LMArena) · 6 results
| Measure | Value | Rank | Configuration | Dated |
|---|---|---|---|---|
| Arena Text: business, management and financeArena rating, higher is better | 1,386 1,356–1,417 |
177 of 406 | Gemma 3 12B | 2 Oct 2026 |
| Arena Text: creative writingArena rating, higher is better | 1,333 1,309–1,356 |
197 of 411 | Gemma 3 12B | 2 Oct 2026 |
| Arena Text: expert promptsArena rating, higher is better | 1,274 1,232–1,315 |
282 of 363 | Gemma 3 12B | 2 Oct 2026 |
| Arena Text: instruction followingArena rating, higher is better | 1,321 1,305–1,337 |
233 of 413 | Gemma 3 12B | 2 Oct 2026 |
| Arena Text: overallArena rating, higher is better | 1,342 1,332–1,351 |
230 of 413 | Gemma 3 12B | 2 Oct 2026 |
| Arena Text: writing, literature and languageArena rating, higher is better | 1,313 1,296–1,331 |
234 of 412 | Gemma 3 12B | 2 Oct 2026 |
Not shown: Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
Artificial Analysis · reported by Artificial Analysis · 12 results
| Measure | Value | Rank | Configuration | Dated |
|---|---|---|---|---|
| Artificial Analysis: Artificial Analysis Coding Indexindex score, higher is better | 5.8 | 180 of 187 | Gemma 3 12B | 20 Oct 2026 |
| Artificial Analysis: Artificial Analysis Intelligence Indexindex score, higher is better | 3.8 | 413 of 413 | Gemma 3 12B | 20 Oct 2026 |
| Artificial Analysis: GPQA Diamond% of questions, higher is better | 34.9% | 352 of 360 | Gemma 3 12B | 20 Oct 2026 |
| Artificial Analysis: Humanity's Last Exam% of questions, higher is better | 4.2% | 374 of 419 | Gemma 3 12B | 20 Oct 2026 |
| Artificial Analysis: IFBench% of instructions, higher is better | 36.7% | 227 of 288 | Gemma 3 12B | 20 Oct 2026 |
| Artificial Analysis: Long-context reasoning (AA-LCR)% of questions, higher is better | 8.3% | 383 of 407 | Gemma 3 12B | 20 Oct 2026 |
| Artificial Analysis: SciCode% of problems, higher is better | 16.4% | 204 of 205 | Gemma 3 12B | 20 Oct 2026 |
| Artificial Analysis: Terminal-Bench 2.1% of tasks, higher is better | 0.0% | 185 of 188 | Gemma 3 12B | 20 Oct 2026 |
| Artificial Analysis: Terminal-Bench 4.0% of tasks, higher is better | 0.0% | 152 of 204 | Gemma 3 12B | 20 Oct 2026 |
| Artificial Analysis: Terminal-Bench Hard% of tasks, higher is better | 0.8% | 271 of 282 | Gemma 3 12B | 20 Oct 2026 |
| Artificial Analysis: τ-bench banking% of tasks, higher is better | 0.8% | 173 of 175 | Gemma 3 12B | 20 Oct 2026 |
| Artificial Analysis: τ²-bench telecom% of tasks, higher is better | 10.8% | 276 of 286 | Gemma 3 12B | 20 Oct 2026 |
Not shown: Not your codebase or tools.
Berkeley Function Calling Leaderboard (BFCL) V4 · reported by Berkeley Function Calling Leaderboard (BFCL) V4 · 8 results
| Measure | Value | Rank | Configuration | Dated |
|---|---|---|---|---|
| BFCL: irrelevance detection% correct, higher is better | 70.3% | 83 of 109 | Gemma 3 12B (bfcl prompt) | 16 Dec 2025 |
| BFCL: memory% correct, higher is better | 27.5% | 25 of 109 | Gemma 3 12B (bfcl prompt) | 16 Dec 2025 |
| BFCL: multi-turn tasks% correct, higher is better | 5.8% | 79 of 109 | Gemma 3 12B (bfcl prompt) | 16 Dec 2025 |
| BFCL: overall accuracy% correct, higher is better | 30.4% | 66 of 109 | Gemma 3 12B (bfcl prompt) | 16 Dec 2025 |
| BFCL: relevance detection% correct, higher is better | 93.8% | 8 of 109 | Gemma 3 12B (bfcl prompt) | 16 Dec 2025 |
| BFCL: single-turn calls (curated)% correct, higher is better | 79.4% | 77 of 109 | Gemma 3 12B (bfcl prompt) | 16 Dec 2025 |
| BFCL: single-turn calls (user-contributed)% correct, higher is better | 74.2% | 46 of 109 | Gemma 3 12B (bfcl prompt) | 16 Dec 2025 |
| BFCL: web search% correct, higher is better | 4.0% | 67 of 109 | Gemma 3 12B (bfcl prompt) | 16 Dec 2025 |
Not shown: Not general refusal or safety behaviour.
UGI Leaderboard · reported by UGI Leaderboard · 3 results
| Measure | Value | Rank | Configuration | Dated |
|---|---|---|---|---|
| UGI: requested-length error% off the requested word count, lower is better | 9.0% | 75 of 379 | Gemma 3 12B | 6 Sep 2025 |
| UGI: style adherencescore from 0 to 1, higher is better | 0.29 | 352 of 379 | Gemma 3 12B | 6 Sep 2025 |
| UGI: writing scorescore out of 100, higher is better | 29.9 | 283 of 379 | Gemma 3 12B | 6 Sep 2025 |
Not shown: Not other format limits such as character counts or bullet counts.
Vectara Hallucination Leaderboard · reported by Vectara Hallucination Leaderboard · 2 results
| Measure | Value | Rank | Configuration | Dated |
|---|---|---|---|---|
| Vectara: answer rate% of documents, higher is better | 97.4% | 86 of 108 | Gemma 3 12B | 22 Sep 2026 |
| Vectara: hallucination rate% of summaries, lower is better | 4.4% | 7 of 108 | Gemma 3 12B | 22 Sep 2026 |
Not shown: Not a quality score: a low rate usually means content filters were triggered, and hallucination rates are measured on answered documents only.
Will Gemma 3 12B work for your product?
Benchmarks aren't your task. Paste the prompt your product uses and run it beside the models you could use instead, with every answer checked and costed.
New here? Your email starts a free trial. No credit card needed.