Model comparison

Gemma 7B vs Qwen3-1.7B

Gemma 7B is the stronger model overall, scoring 29.5 to 26.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemma 7B Google

29.5

Rank #295 Confirmed

Qwen3-1.7B Alibaba (Qwen)

26.2

Rank #331 Reported

Summary

  • The widest gap is in math, where Gemma 7B leads 28.7 to 15.4.

Side by side

Gemma 7B and Qwen3-1.7B specifications
Gemma 7BQwen3-1.7B
ProviderGoogleAlibaba (Qwen)
Noometry Index29.526.2
Released2024-02-212025-04-29
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked274

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 7B: 29.9 (#290), Qwen3-1.7B: —

Coding benchmarks
BenchmarkGemma 7BQwen3-1.7B
LMArena Coding1048—
HumanEval+28.7%—
MBPP+43.4%—

Agentic & Tool Use Not comparable

Gemma 7B: —, Qwen3-1.7B: 24.5 (#108)

Agentic & Tool Use benchmarks
BenchmarkGemma 7BQwen3-1.7B
Berkeley Function Calling Leaderboard—28.4%

Reasoning Too close to call

Gemma 7B: 19.0 (#247), Qwen3-1.7B: 18.5 (#263)

Reasoning benchmarks
BenchmarkGemma 7BQwen3-1.7B
Chess Puzzles—0%
LMArena Hard Prompts1042—
Adversarial NLI48.7%—
BIG-Bench Hard55.1%—
Epoch Capabilities Index111.74—
HellaSwag82.2%—
PIQA81.2%—
WinoGrande79%—

Math Gemma 7B leads

Gemma 7B: 28.7 (#225), Qwen3-1.7B: 15.4 (#288)

Math benchmarks
BenchmarkGemma 7BQwen3-1.7B
OTIS Mock AIME 2024-2025—8.1%
LMArena Math1066—
GSM8K46.4%—

Knowledge Gemma 7B leads

Gemma 7B: 26.8 (#248), Qwen3-1.7B: 19.6 (#273)

Knowledge benchmarks
BenchmarkGemma 7BQwen3-1.7B
GPQA Diamond—38%
LMArena Expert1002—
ARC (AI2) Challenge78.3%—
BoolQ83.2%—
MMLU66.1%—
OpenBookQA78.6%—
TriviaQA72.3%—

Multilingual Not comparable

Gemma 7B: 25.3 (#282), Qwen3-1.7B: —

Multilingual benchmarks
BenchmarkGemma 7BQwen3-1.7B
LMArena Non-English999—
LMArena Chinese1035—
LMArena French1024—
LMArena Russian993—

Instruction Following Not comparable

Gemma 7B: 51.7 (#290), Qwen3-1.7B: —

Instruction Following benchmarks
BenchmarkGemma 7BQwen3-1.7B
LMArena Instruction Following1017—

Long Context Not comparable

Gemma 7B: 31.1 (#277), Qwen3-1.7B: —

Long Context benchmarks
BenchmarkGemma 7BQwen3-1.7B
LMArena Longer Query1022—

Writing & Preference Not comparable

Gemma 7B: 27.2 (#297), Qwen3-1.7B: —

Writing & Preference benchmarks
BenchmarkGemma 7BQwen3-1.7B
LMArena Text1056—
LMArena Creative Writing1024—
LMArena Multi-Turn963—

Frequently asked questions

Is Gemma 7B better than Qwen3-1.7B?

Gemma 7B is the stronger model overall, scoring 29.5 to 26.2 on the Noometry Index.

How many benchmarks do Gemma 7B and Qwen3-1.7B share?

0 benchmarks have published results for both models. Gemma 7B has 27 scored results on Noometry and Qwen3-1.7B has 4.

Related comparisons

Go deeper