Model comparison

Gemma 2B vs GLM-5V-Turbo

GLM-5V-Turbo is the stronger model overall, scoring 43.1 to 29.1 on the Noometry Index.

Last verified . 11 shared benchmarks.

Gemma 2B Google

29.1

Rank #305 Confirmed

GLM-5V-Turbo Z.ai (Zhipu)

43.1

Rank #86 Confirmed

Summary

  • They share 11 benchmarks with published results for both. Gemma 2B scores higher in 0 categories and GLM-5V-Turbo in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where GLM-5V-Turbo leads 62.6 to 24.1.
  • Gemma 2B has downloadable open weights; the other is API-only.

Side by side

Gemma 2B and GLM-5V-Turbo specifications
Gemma 2BGLM-5V-Turbo
ProviderGoogleZ.ai (Zhipu)
Noometry Index29.143.1
Released2024-02-212026-04-01
WeightsOpenProprietary
Context window—200K
Max output—131K
Input $ / M tokens—$1.20
Output $ / M tokens—$4
Results tracked2319

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-5V-Turbo leads

Gemma 2B: 28.9 (#300), GLM-5V-Turbo: 41.8 (#105)

Coding benchmarks
BenchmarkGemma 2BGLM-5V-Turbo
LMArena Coding10101467
LMArena WebDev—1400
HumanEval+20.7%—
MBPP+34.1%—

Reasoning GLM-5V-Turbo leads

Gemma 2B: 17.9 (#275), GLM-5V-Turbo: 28.5 (#87)

Reasoning benchmarks
BenchmarkGemma 2BGLM-5V-Turbo
LMArena Hard Prompts9891443
BIG-Bench Hard35.2%—
Epoch Capabilities Index93.57—
HellaSwag71.4%—
PIQA77.3%—
WinoGrande65.4%—

Math GLM-5V-Turbo leads

Gemma 2B: 27.6 (#237), GLM-5V-Turbo: 36.6 (#109)

Math benchmarks
BenchmarkGemma 2BGLM-5V-Turbo
LMArena Math10091440
GSM8K17.7%—

Knowledge Not comparable

Gemma 2B: —, GLM-5V-Turbo: 39.9 (#113)

Knowledge benchmarks
BenchmarkGemma 2BGLM-5V-Turbo
LMArena Expert—1451
ARC (AI2) Challenge42.1%—
BoolQ69.4%—
MMLU42.3%—
TriviaQA53.2%—

Multimodal Not comparable

Gemma 2B: —, GLM-5V-Turbo: 40.1 (#41)

Multimodal benchmarks
BenchmarkGemma 2BGLM-5V-Turbo
LMArena Vision—1264
LMArena Document—1416

Multilingual GLM-5V-Turbo leads

Gemma 2B: 23.1 (#289), GLM-5V-Turbo: 53.2 (#69)

Multilingual benchmarks
BenchmarkGemma 2BGLM-5V-Turbo
LMArena Non-English9581420
LMArena Chinese9861488
LMArena Russian9371432
LMArena French—1443
LMArena German—1422
LMArena Korean—1399
LMArena Spanish—1446

Instruction Following GLM-5V-Turbo leads

Gemma 2B: 48.8 (#297), GLM-5V-Turbo: 75.1 (#75)

Instruction Following benchmarks
BenchmarkGemma 2BGLM-5V-Turbo
LMArena Instruction Following9711422

Long Context GLM-5V-Turbo leads

Gemma 2B: 29.9 (#286), GLM-5V-Turbo: 44.0 (#76)

Long Context benchmarks
BenchmarkGemma 2BGLM-5V-Turbo
LMArena Longer Query9811439

Writing & Preference GLM-5V-Turbo leads

Gemma 2B: 24.1 (#303), GLM-5V-Turbo: 62.6 (#69)

Writing & Preference benchmarks
BenchmarkGemma 2BGLM-5V-Turbo
LMArena Text10021437
LMArena Creative Writing9861414
LMArena Multi-Turn9451432

Frequently asked questions

Is Gemma 2B better than GLM-5V-Turbo?

GLM-5V-Turbo is the stronger model overall, scoring 43.1 to 29.1 on the Noometry Index.

Is Gemma 2B or GLM-5V-Turbo better for coding?

GLM-5V-Turbo scores higher on coding benchmarks: 41.8 versus 28.9 in the Noometry coding category.

How many benchmarks do Gemma 2B and GLM-5V-Turbo share?

11 benchmarks have published results for both models. Gemma 2B has 23 scored results on Noometry and GLM-5V-Turbo has 19.

Related comparisons

Go deeper