Model comparison

Gemini 3 Pro vs Gemma 2 2b IT

Gemini 3 Pro is the stronger model overall, scoring 54.7 to 32.5 on the Noometry Index.

Last verified . 17 shared benchmarks.

Gemini 3 Pro Google

54.7

Rank #23 Confirmed

Gemma 2 2b IT Google

32.5

Rank #244 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Gemini 3 Pro scores higher in 8 categories and Gemma 2 2b IT in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Gemini 3 Pro leads 64.3 to 29.3.
  • Gemma 2 2b IT has downloadable open weights; the other is API-only.

Side by side

Gemini 3 Pro and Gemma 2 2b IT specifications
Gemini 3 ProGemma 2 2b IT
ProviderGoogleGoogle
Noometry Index54.732.5
Released2025-11-18—
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked6717

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3 Pro leads

Gemini 3 Pro: 52.1 (#33), Gemma 2 2b IT: 31.8 (#268)

Coding benchmarks
BenchmarkGemini 3 ProGemma 2 2b IT
LMArena Coding14821112
SWE-bench Verified72.9%—
SWE-bench Verified (bash only)74.2%—
LMArena WebDev1439—
SWE-bench Multilingual68.7%—
GSO18.6%—
WeirdML69.9%—
ALE-Bench1,177—
AlgoTune1.83—

Agentic & Tool Use Not comparable

Gemini 3 Pro: 40.5 (#21), Gemma 2 2b IT: —

Agentic & Tool Use benchmarks
BenchmarkGemini 3 ProGemma 2 2b IT
Terminal-Bench69.4%—
Berkeley Function Calling Leaderboard72.5%—
GDPval40.3%—
Remote Labor Index1.3%—
τ²-bench Airline80.5%—
τ²-bench Banking18%—
τ²-bench Retail75.9%—
τ²-bench Telecom91%—
DeepResearch Bench46.3%—
BALROG58.1%—
LMArena Search1207—
METR Time Horizons71%—
Vending-Bench 25,478—

Reasoning Gemini 3 Pro leads

Gemini 3 Pro: 52.5 (#28), Gemma 2 2b IT: 20.5 (#219)

Reasoning benchmarks
BenchmarkGemini 3 ProGemma 2 2b IT
LMArena Hard Prompts14811113
ARC-AGI-231.1%—
SimpleBench76.4%—
Kagi LLM Benchmark80.1%—
NYT Connections (extended)94.4%—
ARC-AGI-175%—
CritPt6.9%—
Chess Puzzles31%—
EnigmaEval18.2%—
Epoch Capabilities Index152.96—
ForecastBench61.2—

Math Gemini 3 Pro leads

Gemini 3 Pro: 48.8 (#50), Gemma 2 2b IT: 30.1 (#212)

Math benchmarks
BenchmarkGemini 3 ProGemma 2 2b IT
LMArena Math14751135
MathArena Final-Answer Competitions67%—
OTIS Mock AIME 2024-202591.4%—
ProofBench20%—
Omni-MATH55.5%—
FrontierMath (Feb 2025 set)37.6%—
FrontierMath Tier 4 (v1)18.8%—

Knowledge Gemini 3 Pro leads

Gemini 3 Pro: 64.3 (#15), Gemma 2 2b IT: 29.3 (#229)

Knowledge benchmarks
BenchmarkGemini 3 ProGemma 2 2b IT
LMArena Expert14751096
GPQA Diamond92.6%—
Humanity's Last Exam37.5%—
MMLU-Pro90.3%—
Vectara Hallucination Rate13.6%—
GPQA (HELM)80.3%—

Multimodal Not comparable

Gemini 3 Pro: 56.9 (#1), Gemma 2 2b IT: —

Multimodal benchmarks
BenchmarkGemini 3 ProGemma 2 2b IT
LMArena Vision1305—
GeoBench84%—
VPCT91%—
LMArena Document1434—

Multilingual Gemini 3 Pro leads

Gemini 3 Pro: 57.1 (#14), Gemma 2 2b IT: 32.5 (#252)

Multilingual benchmarks
BenchmarkGemini 3 ProGemma 2 2b IT
LMArena Non-English14741121
LMArena Chinese15221132
LMArena French14921156
LMArena German15171114
LMArena Japanese15131083
LMArena Korean14491055
LMArena Russian14931118
LMArena Spanish14681140

Instruction Following Gemini 3 Pro leads

Gemini 3 Pro: 76.4 (#42), Gemma 2 2b IT: 58.1 (#258)

Instruction Following benchmarks
BenchmarkGemini 3 ProGemma 2 2b IT
LMArena Instruction Following14581118
IFEval87.7%—

Long Context Gemini 3 Pro leads

Gemini 3 Pro: 44.0 (#75), Gemma 2 2b IT: 34.2 (#245)

Long Context benchmarks
BenchmarkGemini 3 ProGemma 2 2b IT
LMArena Longer Query14721130
CL-bench15.8%—

Writing & Preference Gemini 3 Pro leads

Gemini 3 Pro: 66.6 (#34), Gemma 2 2b IT: 36.6 (#258)

Writing & Preference benchmarks
BenchmarkGemini 3 ProGemma 2 2b IT
LMArena Text14791156
LMArena Creative Writing14821147
LMArena Multi-Turn14841118
EQ-Bench Creative Writing1525—
WildBench85.9%—

Frequently asked questions

Is Gemini 3 Pro better than Gemma 2 2b IT?

Gemini 3 Pro is the stronger model overall, scoring 54.7 to 32.5 on the Noometry Index.

Is Gemini 3 Pro or Gemma 2 2b IT better for coding?

Gemini 3 Pro scores higher on coding benchmarks: 52.1 versus 31.8 in the Noometry coding category.

How many benchmarks do Gemini 3 Pro and Gemma 2 2b IT share?

17 benchmarks have published results for both models. Gemini 3 Pro has 67 scored results on Noometry and Gemma 2 2b IT has 17.

Related comparisons

Go deeper