Model comparison

Amazon Nova Experimental Chat 10 20 vs Command R

Amazon Nova Experimental Chat 10 20 is the stronger model overall, scoring 42.1 to 31.4 on the Noometry Index.

Last verified . 17 shared benchmarks.

Command R Cohere

31.4

Rank #272 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Amazon Nova Experimental Chat 10 20 scores higher in 8 categories and Command R in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Amazon Nova Experimental Chat 10 20 leads 56.6 to 38.2.
  • Command R has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Experimental Chat 10 20 and Command R specifications
Amazon Nova Experimental Chat 10 20Command R
ProviderAmazonCohere
Noometry Index42.131.4
Released—2024-08-30
WeightsProprietaryOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.15
Output $ / M tokens—$0.60
Results tracked1729

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 41.6 (#123), Command R: 29.3 (#306)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Command R
LMArena Coding14121169
BigCodeBench Instruct—37.1%
LiveBench Coding—17.9%
BigCodeBench Complete—45.2%

Reasoning Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 28.4 (#106), Command R: 13.8 (#331)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Command R
LMArena Hard Prompts13961164
LiveBench Reasoning—21.9%
DTBench—46.4%
LiveBench Data Analysis—33.3%
LMCA—9.2%
LiveBench—27.5%

Math Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 39.0 (#119), Command R: 28.0 (#246)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Command R
LMArena Math14251155
LiveBench Math—19.4%

Knowledge Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 38.5 (#144), Command R: 31.0 (#221)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Command R
LMArena Expert13861138
MMLU—65.2%

Multilingual Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 49.5 (#131), Command R: 35.7 (#245)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Command R
LMArena Non-English13721174
LMArena Chinese14041182
LMArena French14251162
LMArena German13911176
LMArena Japanese13601143
LMArena Korean13241163
LMArena Russian13711174
LMArena Spanish13821151

Instruction Following Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 72.1 (#141), Command R: 58.1 (#261)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Command R
LMArena Instruction Following13651167
LiveBench Instruction Following—55.6%

Long Context Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 41.7 (#133), Command R: 36.3 (#231)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Command R
LMArena Longer Query13701198

Writing & Preference Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 56.6 (#136), Command R: 38.2 (#254)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Command R
LMArena Text13941187
LMArena Creative Writing13181170
LMArena Multi-Turn13641163
LiveBench Language—16.7%

Frequently asked questions

Is Amazon Nova Experimental Chat 10 20 better than Command R?

Amazon Nova Experimental Chat 10 20 is the stronger model overall, scoring 42.1 to 31.4 on the Noometry Index.

Is Amazon Nova Experimental Chat 10 20 or Command R better for coding?

Amazon Nova Experimental Chat 10 20 scores higher on coding benchmarks: 41.6 versus 29.3 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 10 20 and Command R share?

17 benchmarks have published results for both models. Amazon Nova Experimental Chat 10 20 has 17 scored results on Noometry and Command R has 29.

Related comparisons

Go deeper