Noometry

Model comparison

Gemini 3.5 Flash vs Gemma 2B

Gemini 3.5 Flash is the stronger model overall, scoring 54.2 to 29.6 on the Noometry Index.

Last verified . 12 shared benchmarks.

Gemini 3.5 Flash Google

54.2

Rank #32 Confirmed

Gemma 2B Google

29.6

Rank #307 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Gemini 3.5 Flash scores higher in 7 categories and Gemma 2B in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3.5 Flash leads 62.8 to 18.8.
  • Gemma 2B has downloadable open weights; the other is API-only.

Side by side

Gemini 3.5 FlashGemma 2B
ProviderGoogleGoogle
Noometry Index54.229.6
Released2026-05-192024-02-21
WeightsProprietaryOpen
Context window1.05M—
Max output66K—
Input $ / M tokens$1.50—
Output $ / M tokens$9—
Results tracked5423

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.5 Flash leads

Gemini 3.5 Flash: 49.4 (#49), Gemma 2B: 29.4 (#305)

BenchmarkGemini 3.5 FlashGemma 2B
LMArena Coding14921010
SWE-bench Verified79.3%—
DeepSWE37.4%—
LMArena WebDev1499—
SciCode53.1%—
WeirdML62.6%—
ALE-Bench911.02—
HumanEval+—20.7%
MBPP+—34.1%

Agentic & Tool Use Not comparable

Gemini 3.5 Flash: 24.7 (#114), Gemma 2B: —

BenchmarkGemini 3.5 FlashGemma 2B
APEX-Agents27.5%—
GBAEval6.7%—
GDP.pdf14%—
Vending-Bench 25,396—

Reasoning Gemini 3.5 Flash leads

Gemini 3.5 Flash: 62.8 (#18), Gemma 2B: 18.8 (#275)

BenchmarkGemini 3.5 FlashGemma 2B
LMArena Hard Prompts1488989
Epoch Capabilities Index154.4694.2
ARC-AGI-272.1%—
SimpleBench76.7%—
NYT Connections (extended)92.6%—
ARC-AGI-192.5%—
CritPt13.1%—
Chess Puzzles50%—
EnigmaEval25.4%—
EBR-Bench4.8%—
Mystery Game Puzzles32%—
DTBench94.7%—
LMCA47.1%—
Surface Evolver Bench58.1%—
BIG-Bench Hard—35.2%
ForecastBench59—
HellaSwag—71.4%
PIQA—77.3%
WinoGrande—65.4%

Math Gemini 3.5 Flash leads

Gemini 3.5 Flash: 60.7 (#36), Gemma 2B: 30.0 (#239)

BenchmarkGemini 3.5 FlashGemma 2B
LMArena Math15041009
FrontierMath (Tiers 1-3)62.8%—
FrontierMath Tier 426.8%—
MathArena Final-Answer Competitions76.3%—
OTIS Mock AIME 2024-202595.6%—
ProofBench31%—
FrontierMath (Feb 2025 set)39%—
FrontierMath Tier 4 (v1)14.6%—
GSM8K—17.7%

Knowledge Not comparable

Gemini 3.5 Flash: 66.3 (#11), Gemma 2B: —

BenchmarkGemini 3.5 FlashGemma 2B
GPQA Diamond92.8%—
SimpleQA Verified66.2%—
LMArena Expert1495—
ARC (AI2) Challenge—42.1%
BoolQ—69.4%
MMLU—42.3%
TriviaQA—53.2%

Multimodal Not comparable

Gemini 3.5 Flash: 45.7 (#15), Gemma 2B: —

BenchmarkGemini 3.5 FlashGemma 2B
LMArena Vision1310—
Blueprint-Bench 233.6%—
LMArena Document1463—

Multilingual Gemini 3.5 Flash leads

Gemini 3.5 Flash: 57.0 (#13), Gemma 2B: 23.0 (#294)

BenchmarkGemini 3.5 FlashGemma 2B
LMArena Non-English1476958
LMArena Chinese1526986
LMArena Russian1493937
LMArena French1490—
LMArena German1492—
LMArena Japanese1486—
LMArena Korean1451—
LMArena Spanish1480—

Instruction Following Gemini 3.5 Flash leads

Gemini 3.5 Flash: 77.0 (#30), Gemma 2B: 48.5 (#302)

BenchmarkGemini 3.5 FlashGemma 2B
LMArena Instruction Following1467970

Long Context Gemini 3.5 Flash leads

Gemini 3.5 Flash: 45.4 (#38), Gemma 2B: 29.9 (#291)

BenchmarkGemini 3.5 FlashGemma 2B
LMArena Longer Query1482981

Writing & Preference Gemini 3.5 Flash leads

Gemini 3.5 Flash: 65.5 (#47), Gemma 2B: 24.0 (#308)

BenchmarkGemini 3.5 FlashGemma 2B
LMArena Text14821002
LMArena Creative Writing1470987
LMArena Multi-Turn1481945
EQ-Bench 41087—

Frequently asked questions

Is Gemini 3.5 Flash better than Gemma 2B?

Gemini 3.5 Flash is the stronger model overall, scoring 54.2 to 29.6 on the Noometry Index.

Is Gemini 3.5 Flash or Gemma 2B better for coding?

Gemini 3.5 Flash scores higher on coding benchmarks: 49.4 versus 29.4 in the Noometry coding category.

How many benchmarks do Gemini 3.5 Flash and Gemma 2B share?

12 benchmarks have published results for both models. Gemini 3.5 Flash has 54 scored results on Noometry and Gemma 2B has 23.

Related comparisons

Go deeper