Model comparison

Gemma 3 1B vs Llama 2-7B

Llama 2-7B is the stronger model overall, scoring 28.6 to 20.7 on the Noometry Index.

Last verified October 10, 2026. 1 shared benchmarks.

Gemma 3 1B

Google

20.7

Rank #348 Reported

Llama 2-7B

Summary

They share 1 benchmark with published results for both. Gemma 3 1B scores higher in 1 category and Llama 2-7B in 2 categories; 3 gaps are clear of the uncertainty.
The widest gap is in knowledge, where Llama 2-7B leads 27.7 to 7.1.

Side by side

Gemma 3 1B and Llama 2-7B specifications
	Gemma 3 1B	Llama 2-7B
Provider	Google	Meta
Noometry Index	20.7	28.6
Released	2025-03-12	2023-07-18
Weights	Open	Open
Context window	—	—
Max output	—	—
Input $ / M tokens	—	—
Output $ / M tokens	—	—
Results tracked	4	29

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 1B: —, Llama 2-7B: 28.7 (#302)

Coding benchmarks
Benchmark	Gemma 3 1B	Llama 2-7B
LMArena Coding	—	1002

Agentic & Tool Use Not comparable

Gemma 3 1B: 13.5 (#144), Llama 2-7B: —

Agentic & Tool Use benchmarks
Benchmark	Gemma 3 1B	Llama 2-7B
Berkeley Function Calling Leaderboard	7.2%	—

Reasoning Gemma 3 1B leads

Gemma 3 1B: 18.5 (#260), Llama 2-7B: 15.1 (#309)

Reasoning benchmarks
Benchmark	Gemma 3 1B	Llama 2-7B
Chess Puzzles	0%	0%
LMArena Hard Prompts	—	1009
BIG-Bench Hard	—	39.2%
Epoch Capabilities Index	—	98.54
HellaSwag	—	77.2%
LAMBADA	—	73.3%
PIQA	—	78.8%
WinoGrande	—	69.2%

Math Llama 2-7B leads

Gemma 3 1B: 9.6 (#310), Llama 2-7B: 28.2 (#231)

Math benchmarks
Benchmark	Gemma 3 1B	Llama 2-7B
OTIS Mock AIME 2024-2025	1.1%	—
LMArena Math	—	1042
GSM8K	—	16.7%

Knowledge Llama 2-7B leads

Gemma 3 1B: 7.1 (#309), Llama 2-7B: 27.7 (#243)

Knowledge benchmarks
Benchmark	Gemma 3 1B	Llama 2-7B
GPQA Diamond	19.9%	—
LMArena Expert	—	1036
ARC (AI2) Challenge	—	45.9%
BoolQ	—	77.9%
MMLU	—	45.8%
OpenBookQA	—	58.6%
TriviaQA	—	73.7%

Multimodal Not comparable

Gemma 3 1B: —, Llama 2-7B: —

Multimodal benchmarks
Benchmark	Gemma 3 1B	Llama 2-7B
ScienceQA	—	43.1%

Multilingual Not comparable

Gemma 3 1B: —, Llama 2-7B: 23.9 (#288)

Multilingual benchmarks
Benchmark	Gemma 3 1B	Llama 2-7B
LMArena Non-English	—	973
LMArena Chinese	—	973
LMArena French	—	969
LMArena German	—	978
LMArena Russian	—	995
LMArena Spanish	—	1007

Instruction Following Not comparable

Gemma 3 1B: —, Llama 2-7B: 51.0 (#293)

Instruction Following benchmarks
Benchmark	Gemma 3 1B	Llama 2-7B
LMArena Instruction Following	—	1006

Long Context Not comparable

Gemma 3 1B: —, Llama 2-7B: 30.4 (#282)

Long Context benchmarks
Benchmark	Gemma 3 1B	Llama 2-7B
LMArena Longer Query	—	999

Writing & Preference Not comparable

Gemma 3 1B: —, Llama 2-7B: 28.1 (#293)

Writing & Preference benchmarks
Benchmark	Gemma 3 1B	Llama 2-7B
LMArena Text	—	1053
LMArena Creative Writing	—	1033
LMArena Multi-Turn	—	1029

Frequently asked questions

Is Gemma 3 1B better than Llama 2-7B?