Model comparison

Gemma 2B vs Mistral Small 3.2

Mistral Small 3.2 is the stronger model overall, scoring 31.2 to 29.6 on the Noometry Index.

Last verified . 1 shared benchmarks.

Gemma 2B Google

29.6

Rank #307 Confirmed

Mistral Small 3.2 Mistral AI

31.2

Rank #280 Confirmed

Summary

  • They share 1 benchmark with published results for both. Gemma 2B scores higher in 2 categories and Mistral Small 3.2 in 1 category; 2 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Mistral Small 3.2 leads 45.0 to 24.0.

Side by side

Gemma 2B and Mistral Small 3.2 specifications
Gemma 2BMistral Small 3.2
ProviderGoogleMistral AI
Noometry Index29.631.2
Released2024-02-212025-06-20
WeightsOpenOpen
Context window—256K
Max output—16K
Input $ / M tokens—$0.0938
Output $ / M tokens—$0.25
Results tracked236

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 2B: 29.4 (#305), Mistral Small 3.2: —

Coding benchmarks
BenchmarkGemma 2BMistral Small 3.2
LMArena Coding1010—
HumanEval+20.7%—
MBPP+34.1%—

Reasoning Too close to call

Gemma 2B: 18.8 (#275), Mistral Small 3.2: 18.1 (#287)

Reasoning benchmarks
BenchmarkGemma 2BMistral Small 3.2
Epoch Capabilities Index94.2131.74
Kagi LLM Benchmark—40.4%
Chess Puzzles—1%
LMArena Hard Prompts989—
BIG-Bench Hard35.2%—
HellaSwag71.4%—
PIQA77.3%—
WinoGrande65.4%—

Math Gemma 2B leads

Gemma 2B: 30.0 (#239), Mistral Small 3.2: 26.3 (#260)

Math benchmarks
BenchmarkGemma 2BMistral Small 3.2
OTIS Mock AIME 2024-2025—30.3%
LMArena Math1009—
GSM8K17.7%—

Knowledge Not comparable

Gemma 2B: —, Mistral Small 3.2: 26.7 (#256)

Knowledge benchmarks
BenchmarkGemma 2BMistral Small 3.2
GPQA Diamond—49.1%
ARC (AI2) Challenge42.1%—
BoolQ69.4%—
MMLU42.3%—
TriviaQA53.2%—

Multilingual Not comparable

Gemma 2B: 23.0 (#294), Mistral Small 3.2: —

Multilingual benchmarks
BenchmarkGemma 2BMistral Small 3.2
LMArena Non-English958—
LMArena Chinese986—
LMArena Russian937—

Instruction Following Not comparable

Gemma 2B: 48.5 (#302), Mistral Small 3.2: —

Instruction Following benchmarks
BenchmarkGemma 2BMistral Small 3.2
LMArena Instruction Following970—

Long Context Not comparable

Gemma 2B: 29.9 (#291), Mistral Small 3.2: —

Long Context benchmarks
BenchmarkGemma 2BMistral Small 3.2
LMArena Longer Query981—

Writing & Preference Mistral Small 3.2 leads

Gemma 2B: 24.0 (#308), Mistral Small 3.2: 45.0 (#224)

Writing & Preference benchmarks
BenchmarkGemma 2BMistral Small 3.2
LMArena Text1002—
LMArena Creative Writing987—
EQ-Bench Creative Writing—1255
LMArena Multi-Turn945—

Frequently asked questions

Is Gemma 2B better than Mistral Small 3.2?

Mistral Small 3.2 is the stronger model overall, scoring 31.2 to 29.6 on the Noometry Index.

How many benchmarks do Gemma 2B and Mistral Small 3.2 share?

1 benchmark has published results for both models. Gemma 2B has 23 scored results on Noometry and Mistral Small 3.2 has 6.

Related comparisons

Go deeper