Model comparison

Amazon Nova Experimental Chat 26 01 10 vs Yi-Lightning

Amazon Nova Experimental Chat 26 01 10 is the stronger model overall, scoring 42.8 to 37.1 on the Noometry Index.

Last verified . 13 shared benchmarks.

Yi-Lightning 01.AI

37.1

Rank #209 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Amazon Nova Experimental Chat 26 01 10 scores higher in 8 categories and Yi-Lightning in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in coding, where Amazon Nova Experimental Chat 26 01 10 leads 42.7 to 27.4.

Side by side

Amazon Nova Experimental Chat 26 01 10 and Yi-Lightning specifications
Amazon Nova Experimental Chat 26 01 10Yi-Lightning
ProviderAmazon01.AI
Noometry Index42.837.1
Released—2024-12-02
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1318

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 42.7 (#96), Yi-Lightning: 27.4 (#320)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Yi-Lightning
LMArena Coding14471312
Aider Polyglot—12.9%

Reasoning Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 28.9 (#98), Yi-Lightning: 25.9 (#139)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Yi-Lightning
LMArena Hard Prompts14151302

Math Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 38.5 (#136), Yi-Lightning: 36.2 (#172)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Yi-Lightning
LMArena Math14041300

Knowledge Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 40.3 (#120), Yi-Lightning: 35.4 (#185)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Yi-Lightning
LMArena Expert14441286

Multilingual Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 50.2 (#126), Yi-Lightning: 42.2 (#196)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Yi-Lightning
LMArena Non-English13811269
LMArena Chinese13721320
LMArena Russian13911255
LMArena Spanish13901315
LMArena French—1305
LMArena German—1267
LMArena Japanese—1228
LMArena Korean—1192

Instruction Following Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 72.9 (#126), Yi-Lightning: 67.4 (#196)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Yi-Lightning
LMArena Instruction Following13811278

Long Context Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 42.7 (#119), Yi-Lightning: 39.4 (#181)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Yi-Lightning
LMArena Longer Query14001297

Writing & Preference Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 57.4 (#129), Yi-Lightning: 50.2 (#184)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Yi-Lightning
LMArena Text13961302
LMArena Creative Writing13311280
LMArena Multi-Turn13801311

Frequently asked questions

Is Amazon Nova Experimental Chat 26 01 10 better than Yi-Lightning?

Amazon Nova Experimental Chat 26 01 10 is the stronger model overall, scoring 42.8 to 37.1 on the Noometry Index.

Is Amazon Nova Experimental Chat 26 01 10 or Yi-Lightning better for coding?

Amazon Nova Experimental Chat 26 01 10 scores higher on coding benchmarks: 42.7 versus 27.4 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 26 01 10 and Yi-Lightning share?

13 benchmarks have published results for both models. Amazon Nova Experimental Chat 26 01 10 has 13 scored results on Noometry and Yi-Lightning has 18.

Related comparisons

Go deeper