Model comparison

Qwen-14B vs Wizardlm 13b

Qwen-14B and Wizardlm 13b score almost the same on the Noometry Index (31.4 vs 31.4), so choose on price, context window or the category you care about most.

Last verified . 10 shared benchmarks.

Qwen-14B Alibaba (Qwen)

31.4

Rank #275 Confirmed

Wizardlm 13b Microsoft

31.4

Rank #274 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Qwen-14B scores higher in 4 categories and Wizardlm 13b in 3 categories; 4 gaps are clear of the uncertainty.

Side by side

Qwen-14B and Wizardlm 13b specifications
Qwen-14BWizardlm 13b
ProviderAlibaba (Qwen)Microsoft
Noometry Index31.431.4
Released2023-09-24—
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1810

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen-14B leads

Qwen-14B: 31.2 (#288), Wizardlm 13b: 30.1 (#298)

Coding benchmarks
BenchmarkQwen-14BWizardlm 13b
LMArena Coding10711035

Reasoning Too close to call

Qwen-14B: 19.6 (#257), Wizardlm 13b: 19.4 (#259)

Reasoning benchmarks
BenchmarkQwen-14BWizardlm 13b
LMArena Hard Prompts10271018
BIG-Bench Hard55%—
Epoch Capabilities Index113.03—
LAMBADA71.1%—
PIQA79.9%—

Math Qwen-14B leads

Qwen-14B: 31.2 (#227), Wizardlm 13b: 30.2 (#238)

Math benchmarks
BenchmarkQwen-14BWizardlm 13b
LMArena Math10681017
GSM8K61.3%—

Knowledge Not comparable

Qwen-14B: —, Wizardlm 13b: —

Knowledge benchmarks
BenchmarkQwen-14BWizardlm 13b
ARC (AI2) Challenge84.4%—
BoolQ86.2%—
MMLU66.3%—

Multilingual Too close to call

Qwen-14B: 27.5 (#275), Wizardlm 13b: 27.1 (#277)

Multilingual benchmarks
BenchmarkQwen-14BWizardlm 13b
LMArena Non-English10411034
LMArena Chinese10771023

Instruction Following Wizardlm 13b leads

Qwen-14B: 52.4 (#289), Wizardlm 13b: 53.5 (#285)

Instruction Following benchmarks
BenchmarkQwen-14BWizardlm 13b
LMArena Instruction Following10311048

Long Context Too close to call

Qwen-14B: 31.3 (#280), Wizardlm 13b: 32.0 (#273)

Long Context benchmarks
BenchmarkQwen-14BWizardlm 13b
LMArena Longer Query10281054

Writing & Preference Wizardlm 13b leads

Qwen-14B: 27.6 (#299), Wizardlm 13b: 30.5 (#287)

Writing & Preference benchmarks
BenchmarkQwen-14BWizardlm 13b
LMArena Text10511077
LMArena Creative Writing10281091
LMArena Multi-Turn10221047

Frequently asked questions

Is Qwen-14B better than Wizardlm 13b?

Qwen-14B and Wizardlm 13b score almost the same on the Noometry Index (31.4 vs 31.4), so choose on price, context window or the category you care about most.

Is Qwen-14B or Wizardlm 13b better for coding?

Qwen-14B scores higher on coding benchmarks: 31.2 versus 30.1 in the Noometry coding category.

How many benchmarks do Qwen-14B and Wizardlm 13b share?

10 benchmarks have published results for both models. Qwen-14B has 18 scored results on Noometry and Wizardlm 13b has 10.

Related comparisons

Go deeper