Model comparison

Gemma 2 2b IT vs Wizardlm 13b

Gemma 2 2b IT is the stronger model overall, scoring 33.1 to 31.4 on the Noometry Index.

Last verified . 10 shared benchmarks.

Gemma 2 2b IT Google

33.1

Rank #248 Confirmed

Wizardlm 13b Microsoft

31.4

Rank #274 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Gemma 2 2b IT scores higher in 7 categories and Wizardlm 13b in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Gemma 2 2b IT leads 36.5 to 30.5.

Side by side

Gemma 2 2b IT and Wizardlm 13b specifications
Gemma 2 2b ITWizardlm 13b
ProviderGoogleMicrosoft
Noometry Index33.131.4
Released——
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1710

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemma 2 2b IT leads

Gemma 2 2b IT: 32.3 (#273), Wizardlm 13b: 30.1 (#298)

Coding benchmarks
BenchmarkGemma 2 2b ITWizardlm 13b
LMArena Coding11121035

Reasoning Gemma 2 2b IT leads

Gemma 2 2b IT: 21.4 (#224), Wizardlm 13b: 19.4 (#259)

Reasoning benchmarks
BenchmarkGemma 2 2b ITWizardlm 13b
LMArena Hard Prompts11131018

Math Gemma 2 2b IT leads

Gemma 2 2b IT: 32.6 (#212), Wizardlm 13b: 30.2 (#238)

Math benchmarks
BenchmarkGemma 2 2b ITWizardlm 13b
LMArena Math11351017

Knowledge Not comparable

Gemma 2 2b IT: 29.9 (#231), Wizardlm 13b: —

Knowledge benchmarks
BenchmarkGemma 2 2b ITWizardlm 13b
LMArena Expert1096—

Multilingual Gemma 2 2b IT leads

Gemma 2 2b IT: 32.3 (#257), Wizardlm 13b: 27.1 (#277)

Multilingual benchmarks
BenchmarkGemma 2 2b ITWizardlm 13b
LMArena Non-English11211034
LMArena Chinese11321023
LMArena French1157—
LMArena German1114—
LMArena Japanese1083—
LMArena Korean1055—
LMArena Russian1118—
LMArena Spanish1140—

Instruction Following Gemma 2 2b IT leads

Gemma 2 2b IT: 57.8 (#263), Wizardlm 13b: 53.5 (#285)

Instruction Following benchmarks
BenchmarkGemma 2 2b ITWizardlm 13b
LMArena Instruction Following11181048

Long Context Gemma 2 2b IT leads

Gemma 2 2b IT: 34.3 (#250), Wizardlm 13b: 32.0 (#273)

Long Context benchmarks
BenchmarkGemma 2 2b ITWizardlm 13b
LMArena Longer Query11301054

Writing & Preference Gemma 2 2b IT leads

Gemma 2 2b IT: 36.5 (#263), Wizardlm 13b: 30.5 (#287)

Writing & Preference benchmarks
BenchmarkGemma 2 2b ITWizardlm 13b
LMArena Text11561077
LMArena Creative Writing11471091
LMArena Multi-Turn11181047

Frequently asked questions

Is Gemma 2 2b IT better than Wizardlm 13b?

Gemma 2 2b IT is the stronger model overall, scoring 33.1 to 31.4 on the Noometry Index.

Is Gemma 2 2b IT or Wizardlm 13b better for coding?

Gemma 2 2b IT scores higher on coding benchmarks: 32.3 versus 30.1 in the Noometry coding category.

How many benchmarks do Gemma 2 2b IT and Wizardlm 13b share?

10 benchmarks have published results for both models. Gemma 2 2b IT has 17 scored results on Noometry and Wizardlm 13b has 10.

Related comparisons

Go deeper