Model comparison

Amazon Nova Experimental Chat 12 10 vs Command R

Amazon Nova Experimental Chat 12 10 is the stronger model overall, scoring 42.9 to 31.4 on the Noometry Index.

Last verified . 12 shared benchmarks.

Command R Cohere

31.4

Rank #272 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Amazon Nova Experimental Chat 12 10 scores higher in 8 categories and Command R in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Amazon Nova Experimental Chat 12 10 leads 59.5 to 38.2.
  • Command R has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Experimental Chat 12 10 and Command R specifications
Amazon Nova Experimental Chat 12 10Command R
ProviderAmazonCohere
Noometry Index42.931.4
Released—2024-08-30
WeightsProprietaryOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.15
Output $ / M tokens—$0.60
Results tracked1229

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 12 10 leads

Amazon Nova Experimental Chat 12 10: 42.2 (#110), Command R: 29.3 (#306)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 12 10Command R
LMArena Coding14301169
BigCodeBench Instruct—37.1%
LiveBench Coding—17.9%
BigCodeBench Complete—45.2%

Reasoning Amazon Nova Experimental Chat 12 10 leads

Amazon Nova Experimental Chat 12 10: 29.3 (#94), Command R: 13.8 (#331)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 12 10Command R
LMArena Hard Prompts14271164
LiveBench Reasoning—21.9%
DTBench—46.4%
LiveBench Data Analysis—33.3%
LMCA—9.2%
LiveBench—27.5%

Math Amazon Nova Experimental Chat 12 10 leads

Amazon Nova Experimental Chat 12 10: 38.9 (#124), Command R: 28.0 (#246)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 12 10Command R
LMArena Math14191155
LiveBench Math—19.4%

Knowledge Amazon Nova Experimental Chat 12 10 leads

Amazon Nova Experimental Chat 12 10: 39.2 (#136), Command R: 31.0 (#221)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 12 10Command R
LMArena Expert14081138
MMLU—65.2%

Multilingual Amazon Nova Experimental Chat 12 10 leads

Amazon Nova Experimental Chat 12 10: 51.4 (#108), Command R: 35.7 (#245)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 12 10Command R
LMArena Non-English13981174
LMArena Chinese14401182
LMArena Russian13951174
LMArena French—1162
LMArena German—1176
LMArena Japanese—1143
LMArena Korean—1163
LMArena Spanish—1151

Instruction Following Amazon Nova Experimental Chat 12 10 leads

Amazon Nova Experimental Chat 12 10: 73.2 (#123), Command R: 58.1 (#261)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 12 10Command R
LMArena Instruction Following13871167
LiveBench Instruction Following—55.6%

Long Context Amazon Nova Experimental Chat 12 10 leads

Amazon Nova Experimental Chat 12 10: 42.4 (#125), Command R: 36.3 (#231)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 12 10Command R
LMArena Longer Query13911198

Writing & Preference Amazon Nova Experimental Chat 12 10 leads

Amazon Nova Experimental Chat 12 10: 59.5 (#110), Command R: 38.2 (#254)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 12 10Command R
LMArena Text14201187
LMArena Creative Writing13501170
LMArena Multi-Turn14091163
LiveBench Language—16.7%

Frequently asked questions

Is Amazon Nova Experimental Chat 12 10 better than Command R?

Amazon Nova Experimental Chat 12 10 is the stronger model overall, scoring 42.9 to 31.4 on the Noometry Index.

Is Amazon Nova Experimental Chat 12 10 or Command R better for coding?

Amazon Nova Experimental Chat 12 10 scores higher on coding benchmarks: 42.2 versus 29.3 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 12 10 and Command R share?

12 benchmarks have published results for both models. Amazon Nova Experimental Chat 12 10 has 12 scored results on Noometry and Command R has 29.

Related comparisons

Go deeper