Compare / Qwen3 14B vs Gemma 3 27B

Qwen3 14B vs Gemma 3 27B

13 results from 3 sources that measured both models. Each row is in the source's own units; there is no overall winner.

Qwen3 14B
Alibaba · profile
Gemma 3 27B
Google · profile
Results compared
13
Shared sources
3
BenchmarkMetricQwen3 14BGemma 3 27B
Berkeley Function Calling Leaderboard (BFCL) V4reportedIrrelevance detection% correct 87.2%73.7%
Berkeley Function Calling Leaderboard (BFCL) V4reportedMemory% correct 19.6%13.6%
Berkeley Function Calling Leaderboard (BFCL) V4reportedMulti-turn tasks% correct 34.8%10.8%
Berkeley Function Calling Leaderboard (BFCL) V4reportedOverall accuracy% correct 41.0%29.5%
Berkeley Function Calling Leaderboard (BFCL) V4reportedRelevance detection% correct 87.5%81.2%
Berkeley Function Calling Leaderboard (BFCL) V4reportedSingle-turn calls (curated)% correct 89.5%87.2%
Berkeley Function Calling Leaderboard (BFCL) V4reportedSingle-turn calls (user-contributed)% correct 80.0%74.5%
Berkeley Function Calling Leaderboard (BFCL) V4reportedWeb search% correct 10.5%0.0%
UGI LeaderboardreportedRequested-length error% off the requested word count 20.0%8.0%
UGI LeaderboardreportedStyle adherencescore from 0 to 1 0.370.29
UGI LeaderboardreportedWriting scorescore out of 100 34.845.0
Vectara Hallucination LeaderboardreportedAnswer rate% of documents 99.9%98.8%
Vectara Hallucination LeaderboardreportedHallucination rate% of summaries 5.4%7.4%

Bold green marks the better value on that metric. Where a source reports ranges that overlap, the difference may not be meaningful; see the benchmark page for ranges.