Model comparison

Gemma 3 1B vs Gemma 3 27B

Gemma 3 27B is the stronger model overall, scoring 30.8 to 21.1 on the Noometry Index.

Last verified . 4 shared benchmarks.

Gemma 3 1B Google

21.1

Rank #353 Reported

Gemma 3 27B Google

30.8

Rank #284 Confirmed

Summary

  • They share 4 benchmarks with published results for both. Gemma 3 1B scores higher in 1 category and Gemma 3 27B in 3 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Gemma 3 27B leads 25.5 to 7.0.
  • The biggest single-benchmark swing is GPQA Diamond: 19.9% for Gemma 3 1B and 47.7% for Gemma 3 27B.

Side by side

Gemma 3 1B and Gemma 3 27B specifications
Gemma 3 1BGemma 3 27B
ProviderGoogleGoogle
Noometry Index21.130.8
Released2025-03-122025-03-11
WeightsOpenOpen
Context window—131K
Max output—8K
Input $ / M tokens—$0.08
Output $ / M tokens—$0.16
Results tracked443

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 1B: —, Gemma 3 27B: 22.5 (#334)

Coding benchmarks
BenchmarkGemma 3 1BGemma 3 27B
Aider Polyglot—4.9%
SciCode—21.2%
LiveBench Coding—39.9%
LMArena Coding—1322

Agentic & Tool Use Gemma 3 27B leads

Gemma 3 1B: 13.7 (#152), Gemma 3 27B: 25.1 (#110)

Agentic & Tool Use benchmarks
BenchmarkGemma 3 1BGemma 3 27B
Berkeley Function Calling Leaderboard7.2%29.5%

Reasoning Gemma 3 1B leads

Gemma 3 1B: 19.2 (#264), Gemma 3 27B: 16.7 (#301)

Reasoning benchmarks
BenchmarkGemma 3 1BGemma 3 27B
Chess Puzzles0%0%
Kagi LLM Benchmark—40.4%
CritPt—0%
LiveBench Reasoning—43.8%
LMArena Hard Prompts—1340
DTBench—52.5%
LiveBench Data Analysis—51.5%
LMCA—12.3%
Epoch Capabilities Index—130.04
LiveBench—50%

Math Gemma 3 27B leads

Gemma 3 1B: 10.2 (#316), Gemma 3 27B: 25.9 (#265)

Math benchmarks
BenchmarkGemma 3 1BGemma 3 27B
OTIS Mock AIME 2024-20251.1%22.5%
LiveBench Math—55.4%
LMArena Math—1312
MATH Level 5—74%

Knowledge Gemma 3 27B leads

Gemma 3 1B: 7.0 (#314), Gemma 3 27B: 25.5 (#261)

Knowledge benchmarks
BenchmarkGemma 3 1BGemma 3 27B
GPQA Diamond19.9%47.7%
Confabulations—40.3%
Vectara Hallucination Rate—7.4%
LMArena Expert—1304

Multimodal Not comparable

Gemma 3 1B: —, Gemma 3 27B: 32.6 (#100)

Multimodal benchmarks
BenchmarkGemma 3 1BGemma 3 27B
LMArena Vision—1164
GeoBench—52%

Multilingual Not comparable

Gemma 3 1B: —, Gemma 3 27B: 46.9 (#155)

Multilingual benchmarks
BenchmarkGemma 3 1BGemma 3 27B
LMArena Non-English—1334
LMArena Chinese—1346
LMArena French—1368
LMArena German—1362
LMArena Japanese—1287
LMArena Korean—1308
LMArena Russian—1349
LMArena Spanish—1349

Instruction Following Not comparable

Gemma 3 1B: —, Gemma 3 27B: 70.6 (#160)

Instruction Following benchmarks
BenchmarkGemma 3 1BGemma 3 27B
LiveBench Instruction Following—74.9%
LMArena Instruction Following—1321

Long Context Not comparable

Gemma 3 1B: —, Gemma 3 27B: 27.6 (#293)

Long Context benchmarks
BenchmarkGemma 3 1BGemma 3 27B
Fiction.LiveBench—33.3%
LMArena Longer Query—1333

Writing & Preference Not comparable

Gemma 3 1B: —, Gemma 3 27B: 52.5 (#168)

Writing & Preference benchmarks
BenchmarkGemma 3 1BGemma 3 27B
LMArena Text—1358
LMArena Creative Writing—1346
Short-Story Creative Writing—79.9%
EQ-Bench Creative Writing—1266
LMArena Multi-Turn—1345
LiveBench Language—34.6%

Frequently asked questions

Is Gemma 3 1B better than Gemma 3 27B?

Gemma 3 27B is the stronger model overall, scoring 30.8 to 21.1 on the Noometry Index.

How many benchmarks do Gemma 3 1B and Gemma 3 27B share?

4 benchmarks have published results for both models. Gemma 3 1B has 4 scored results on Noometry and Gemma 3 27B has 43.

Related comparisons

Go deeper