Model comparison

Gemma 3 1B vs Mistral 7B

Mistral 7B is the stronger model overall, scoring 23.0 to 21.1 on the Noometry Index.

Last verified October 10, 2026. 3 shared benchmarks.

Gemma 3 1B

Google

21.1

Rank #353 Reported

Mistral 7B

Mistral AI

23.0

Rank #351 Confirmed

Summary

They share 3 benchmarks with published results for both. Gemma 3 1B scores higher in 2 categories and Mistral 7B in 1 category; 2 gaps are clear of the uncertainty.
The widest gap is in reasoning, where Gemma 3 1B leads 19.2 to 13.1.

Side by side

Gemma 3 1B and Mistral 7B specifications
	Gemma 3 1B	Mistral 7B
Provider	Google	Mistral AI
Noometry Index	21.1	23.0
Released	2025-03-12	2023-09-27
Weights	Open	Open
Context window	—	8K
Max output	—	8K
Input $ / M tokens	—	$0.25
Output $ / M tokens	—	$0.25
Results tracked	4	37

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 1B: —, Mistral 7B: 26.4 (#326)

Coding benchmarks
Benchmark	Gemma 3 1B	Mistral 7B
BigCodeBench Instruct	—	19.5%
LMArena Coding	—	1082
BigCodeBench Complete	—	27.3%
HumanEval+	—	36%
MBPP+	—	42.1%

Agentic & Tool Use Not comparable

Gemma 3 1B: 13.7 (#152), Mistral 7B: —

Agentic & Tool Use benchmarks
Benchmark	Gemma 3 1B	Mistral 7B
Berkeley Function Calling Leaderboard	7.2%	—

Reasoning Gemma 3 1B leads

Gemma 3 1B: 19.2 (#264), Mistral 7B: 13.1 (#336)

Reasoning benchmarks
Benchmark	Gemma 3 1B	Mistral 7B
Chess Puzzles	0%	0%
LMArena Hard Prompts	—	1067
DTBench	—	42.5%
Adversarial NLI	—	47.1%
BIG-Bench Hard	—	56.1%
Epoch Capabilities Index	—	112.21
HellaSwag	—	81%
PIQA	—	83%
WinoGrande	—	75.3%

Math Gemma 3 1B leads

Gemma 3 1B: 10.2 (#316), Mistral 7B: 8.1 (#325)

Math benchmarks
Benchmark	Gemma 3 1B	Mistral 7B
OTIS Mock AIME 2024-2025	1.1%	0.3%
LMArena Math	—	1085
MATH Level 5	—	3.7%
GSM8K	—	54.4%

Knowledge Too close to call

Gemma 3 1B: 7.0 (#314), Mistral 7B: 7.4 (#311)

Knowledge benchmarks
Benchmark	Gemma 3 1B	Mistral 7B
GPQA Diamond	19.9%	15.2%
LMArena Expert	—	1036
ARC (AI2) Challenge	—	78.6%
BoolQ	—	87.4%
MMLU	—	62.5%
OpenBookQA	—	79.8%
TriviaQA	—	75.2%

Multilingual Not comparable

Gemma 3 1B: —, Mistral 7B: 25.8 (#283)

Multilingual benchmarks
Benchmark	Gemma 3 1B	Mistral 7B
LMArena Non-English	—	1012
LMArena Chinese	—	1009
LMArena French	—	1037
LMArena German	—	987
LMArena Japanese	—	878
LMArena Russian	—	1018
LMArena Spanish	—	1026

Instruction Following Not comparable

Gemma 3 1B: —, Mistral 7B: 54.2 (#280)

Instruction Following benchmarks
Benchmark	Gemma 3 1B	Mistral 7B
LMArena Instruction Following	—	1060

Long Context Not comparable

Gemma 3 1B: —, Mistral 7B: 32.2 (#271)

Long Context benchmarks
Benchmark	Gemma 3 1B	Mistral 7B
LMArena Longer Query	—	1060

Writing & Preference Not comparable

Gemma 3 1B: —, Mistral 7B: 30.7 (#286)

Writing & Preference benchmarks
Benchmark	Gemma 3 1B	Mistral 7B
LMArena Text	—	1090
LMArena Creative Writing	—	1068
LMArena Multi-Turn	—	1062

Frequently asked questions

Is Gemma 3 1B better than Mistral 7B?