Model comparison

Qwen1.5-110B vs Wizardlm 13b

Qwen1.5-110B is the stronger model overall, scoring 33.6 to 30.8 on the Noometry Index.

Last verified . 10 shared benchmarks.

Qwen1.5-110B Alibaba (Qwen)

33.6

Rank #231 Confirmed

Wizardlm 13b Microsoft

30.8

Rank #272 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Qwen1.5-110B scores higher in 7 categories and Wizardlm 13b in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen1.5-110B leads 38.1 to 30.7.

Side by side

Qwen1.5-110B and Wizardlm 13b specifications
Qwen1.5-110BWizardlm 13b
ProviderAlibaba (Qwen)Microsoft
Noometry Index33.630.8
Released2024-04-25—
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2010

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen1.5-110B leads

Qwen1.5-110B: 32.4 (#260), Wizardlm 13b: 29.6 (#293)

Coding benchmarks
BenchmarkQwen1.5-110BWizardlm 13b
LMArena Coding11841035
BigCodeBench Instruct35%—
BigCodeBench Complete44.4%—

Reasoning Qwen1.5-110B leads

Qwen1.5-110B: 21.7 (#192), Wizardlm 13b: 18.5 (#265)

Reasoning benchmarks
BenchmarkQwen1.5-110BWizardlm 13b
LMArena Hard Prompts11681018
ForecastBench57.7—

Math Qwen1.5-110B leads

Qwen1.5-110B: 31.1 (#199), Wizardlm 13b: 27.8 (#235)

Math benchmarks
BenchmarkQwen1.5-110BWizardlm 13b
LMArena Math11851017

Knowledge Not comparable

Qwen1.5-110B: 30.7 (#217), Wizardlm 13b: —

Knowledge benchmarks
BenchmarkQwen1.5-110BWizardlm 13b
LMArena Expert1144—

Multilingual Qwen1.5-110B leads

Qwen1.5-110B: 33.8 (#245), Wizardlm 13b: 27.3 (#272)

Multilingual benchmarks
BenchmarkQwen1.5-110BWizardlm 13b
LMArena Non-English11421034
LMArena Chinese12061023
LMArena French1150—
LMArena German1123—
LMArena Japanese1074—
LMArena Korean1044—
LMArena Russian1118—
LMArena Spanish1141—

Instruction Following Qwen1.5-110B leads

Qwen1.5-110B: 60.6 (#247), Wizardlm 13b: 53.7 (#280)

Instruction Following benchmarks
BenchmarkQwen1.5-110BWizardlm 13b
LMArena Instruction Following11581049

Long Context Qwen1.5-110B leads

Qwen1.5-110B: 35.0 (#237), Wizardlm 13b: 32.0 (#268)

Long Context benchmarks
BenchmarkQwen1.5-110BWizardlm 13b
LMArena Longer Query11571054

Writing & Preference Qwen1.5-110B leads

Qwen1.5-110B: 38.1 (#250), Wizardlm 13b: 30.7 (#282)

Writing & Preference benchmarks
BenchmarkQwen1.5-110BWizardlm 13b
LMArena Text11751077
LMArena Creative Writing11481090
LMArena Multi-Turn11601047

Frequently asked questions

Is Qwen1.5-110B better than Wizardlm 13b?

Qwen1.5-110B is the stronger model overall, scoring 33.6 to 30.8 on the Noometry Index.

Is Qwen1.5-110B or Wizardlm 13b better for coding?

Qwen1.5-110B scores higher on coding benchmarks: 32.4 versus 29.6 in the Noometry coding category.

How many benchmarks do Qwen1.5-110B and Wizardlm 13b share?

10 benchmarks have published results for both models. Qwen1.5-110B has 20 scored results on Noometry and Wizardlm 13b has 10.

Related comparisons

Go deeper