Noometry

Model comparison

Gemma 3 4B vs Ministral 8B

Gemma 3 4B and Ministral 8B score almost the same on the Noometry Index (28.1 vs 28.2), so choose on price, context window or the category you care about most.

Last verified . 15 shared benchmarks.

Gemma 3 4B Google

28.1

Rank #326 Confirmed

Ministral 8B Mistral AI

28.2

Rank #325 Confirmed

Summary

  • They share 15 benchmarks with published results for both. Gemma 3 4B scores higher in 6 categories and Ministral 8B in 3 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in math, where Ministral 8B leads 25.7 to 16.8.
  • The biggest single-benchmark swing is Berkeley Function Calling Leaderboard: 19.6% for Gemma 3 4B and 11.1% for Ministral 8B.
  • Gemma 3 4B is cheaper at $0.04 / $0.08 per million input/output tokens, against $0.15 / $0.15 for Ministral 8B.
  • Ministral 8B accepts more context: 262K tokens versus 131K.

Side by side

Gemma 3 4BMinistral 8B
ProviderGoogleMistral AI
Noometry Index28.128.2
Released2025-03-122024-10-01
WeightsOpenOpen
Context window131K262K
Max output4K262K
Input $ / M tokens$0.04$0.15
Output $ / M tokens$0.08$0.15
Results tracked2217

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Gemma 3 4B: 35.9 (#215), Ministral 8B: 35.0 (#230)

BenchmarkGemma 3 4BMinistral 8B
LMArena Coding12301202

Agentic & Tool Use Gemma 3 4B leads

Gemma 3 4B: 20.9 (#142), Ministral 8B: 16.4 (#148)

BenchmarkGemma 3 4BMinistral 8B
Berkeley Function Calling Leaderboard19.6%11.1%

Reasoning Ministral 8B leads

Gemma 3 4B: 13.2 (#335), Ministral 8B: 18.4 (#281)

BenchmarkGemma 3 4BMinistral 8B
LMArena Hard Prompts12531191
DTBench50.9%45.7%
Kagi LLM Benchmark25.2%—
Chess Puzzles0%—
LMCA2.8%—
Epoch Capabilities Index116.02—

Math Ministral 8B leads

Gemma 3 4B: 16.8 (#292), Ministral 8B: 25.7 (#267)

BenchmarkGemma 3 4BMinistral 8B
LMArena Math12391188
OTIS Mock AIME 2024-20257.5%—
MATH Level 5—14.9%

Knowledge Too close to call

Gemma 3 4B: 11.8 (#299), Ministral 8B: 12.6 (#297)

BenchmarkGemma 3 4BMinistral 8B
GPQA Diamond23.2%27.1%
Vectara Hallucination Rate6.4%7.4%
LMArena Expert12231170

Multilingual Gemma 3 4B leads

Gemma 3 4B: 42.5 (#194), Ministral 8B: 35.1 (#247)

BenchmarkGemma 3 4BMinistral 8B
LMArena Non-English12731165
LMArena Russian12941195
LMArena Chinese—1193
LMArena German1281—

Instruction Following Gemma 3 4B leads

Gemma 3 4B: 65.2 (#225), Ministral 8B: 60.5 (#250)

BenchmarkGemma 3 4BMinistral 8B
LMArena Instruction Following12391161

Long Context Gemma 3 4B leads

Gemma 3 4B: 38.7 (#194), Ministral 8B: 36.7 (#227)

BenchmarkGemma 3 4BMinistral 8B
LMArena Longer Query12731212

Writing & Preference Gemma 3 4B leads

Gemma 3 4B: 42.0 (#239), Ministral 8B: 39.6 (#246)

BenchmarkGemma 3 4BMinistral 8B
LMArena Text12911191
LMArena Creative Writing12711175
LMArena Multi-Turn12551166
EQ-Bench Creative Writing1068—

Frequently asked questions

Is Gemma 3 4B better than Ministral 8B?

Gemma 3 4B and Ministral 8B score almost the same on the Noometry Index (28.1 vs 28.2), so choose on price, context window or the category you care about most.

Which is cheaper, Gemma 3 4B or Ministral 8B?

Gemma 3 4B is cheaper. It lists at $0.04 per million input tokens and $0.08 per million output tokens; Ministral 8B lists at $0.15 and $0.15.

Is Gemma 3 4B or Ministral 8B better for coding?

They score almost the same on coding (35.9 vs 35.0); test both on your own repository before choosing.

Which has the bigger context window?

Ministral 8B does, with 262K tokens against 131K.

How many benchmarks do Gemma 3 4B and Ministral 8B share?

15 benchmarks have published results for both models. Gemma 3 4B has 22 scored results on Noometry and Ministral 8B has 17.

Related comparisons

Go deeper