Model comparison

Wizardlm 70b vs Yi-Lightning

Yi-Lightning is the stronger model overall, scoring 36.5 to 32.4 on the Noometry Index.

Last verified . 12 shared benchmarks.

Wizardlm 70b Microsoft

32.4

Rank #245 Confirmed

Yi-Lightning 01.AI

36.5

Rank #206 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Wizardlm 70b scores higher in 1 category and Yi-Lightning in 6 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Yi-Lightning leads 50.4 to 34.9.
  • Wizardlm 70b has downloadable open weights; the other is API-only.

Side by side

Wizardlm 70b and Yi-Lightning specifications
Wizardlm 70bYi-Lightning
ProviderMicrosoft01.AI
Noometry Index32.436.5
Released—2024-12-02
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1218

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Wizardlm 70b leads

Wizardlm 70b: 30.9 (#280), Yi-Lightning: 27.0 (#315)

Coding benchmarks
BenchmarkWizardlm 70bYi-Lightning
LMArena Coding10811313
Aider Polyglot—12.9%

Reasoning Yi-Lightning leads

Wizardlm 70b: 19.8 (#231), Yi-Lightning: 24.9 (#137)

Reasoning benchmarks
BenchmarkWizardlm 70bYi-Lightning
LMArena Hard Prompts10791302

Math Yi-Lightning leads

Wizardlm 70b: 29.7 (#216), Yi-Lightning: 33.5 (#173)

Math benchmarks
BenchmarkWizardlm 70bYi-Lightning
LMArena Math11161300

Knowledge Not comparable

Wizardlm 70b: —, Yi-Lightning: 34.8 (#182)

Knowledge benchmarks
BenchmarkWizardlm 70bYi-Lightning
LMArena Expert—1286

Multilingual Yi-Lightning leads

Wizardlm 70b: 29.8 (#260), Yi-Lightning: 42.4 (#191)

Multilingual benchmarks
BenchmarkWizardlm 70bYi-Lightning
LMArena Non-English10781269
LMArena Chinese10521320
LMArena German10831267
LMArena Russian11551255
LMArena French—1304
LMArena Japanese—1228
LMArena Korean—1192
LMArena Spanish—1315

Instruction Following Yi-Lightning leads

Wizardlm 70b: 56.5 (#268), Yi-Lightning: 67.6 (#191)

Instruction Following benchmarks
BenchmarkWizardlm 70bYi-Lightning
LMArena Instruction Following10931278

Long Context Yi-Lightning leads

Wizardlm 70b: 33.3 (#258), Yi-Lightning: 39.4 (#176)

Long Context benchmarks
BenchmarkWizardlm 70bYi-Lightning
LMArena Longer Query10971297

Writing & Preference Yi-Lightning leads

Wizardlm 70b: 34.9 (#264), Yi-Lightning: 50.4 (#178)

Writing & Preference benchmarks
BenchmarkWizardlm 70bYi-Lightning
LMArena Text11201302
LMArena Creative Writing11491280
LMArena Multi-Turn11081311

Frequently asked questions

Is Wizardlm 70b better than Yi-Lightning?

Yi-Lightning is the stronger model overall, scoring 36.5 to 32.4 on the Noometry Index.

Is Wizardlm 70b or Yi-Lightning better for coding?

Wizardlm 70b scores higher on coding benchmarks: 30.9 versus 27.0 in the Noometry coding category.

How many benchmarks do Wizardlm 70b and Yi-Lightning share?

12 benchmarks have published results for both models. Wizardlm 70b has 12 scored results on Noometry and Yi-Lightning has 18.

Related comparisons

Go deeper