Model comparison

Amazon Nova Experimental Chat 11 10 vs Sonar

Amazon Nova Experimental Chat 11 10 is the stronger model overall, scoring 43.0 to 38.5 on the Noometry Index.

Last verified . 0 shared benchmarks.

Sonar Perplexity

38.5

Rank #187 Confirmed

Summary

  • The widest gap is in reasoning, where Amazon Nova Experimental Chat 11 10 leads 29.1 to 21.1.

Side by side

Amazon Nova Experimental Chat 11 10 and Sonar specifications
Amazon Nova Experimental Chat 11 10Sonar
ProviderAmazonPerplexity
Noometry Index43.038.5
Released—2024-01-01
WeightsProprietaryProprietary
Context window—128K
Max output—4K
Input $ / M tokens—$1
Output $ / M tokens—$1
Results tracked177

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 42.3 (#107), Sonar: 35.7 (#221)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Sonar
LiveBench Coding—35.1%
LMArena Coding1433—

Reasoning Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 29.1 (#95), Sonar: 21.1 (#227)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Sonar
LiveBench Reasoning—46.3%
LMArena Hard Prompts1422—
LiveBench Data Analysis—37.9%
LiveBench—46.9%

Math Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 39.1 (#114), Sonar: 33.7 (#200)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Sonar
LiveBench Math—41.6%
LMArena Math1431—

Knowledge Not comparable

Amazon Nova Experimental Chat 11 10: 39.9 (#127), Sonar: —

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Sonar
LMArena Expert1431—

Multilingual Not comparable

Amazon Nova Experimental Chat 11 10: 51.9 (#98), Sonar: —

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Sonar
LMArena Non-English1405—
LMArena Chinese1463—
LMArena French1449—
LMArena German1395—
LMArena Japanese1383—
LMArena Korean1384—
LMArena Russian1394—
LMArena Spanish1444—

Instruction Following Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 73.2 (#122), Sonar: 71.4 (#150)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Sonar
LiveBench Instruction Following—76.2%
LMArena Instruction Following1387—

Long Context Not comparable

Amazon Nova Experimental Chat 11 10: 42.5 (#121), Sonar: —

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Sonar
LMArena Longer Query1395—

Writing & Preference Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 58.8 (#114), Sonar: 52.6 (#167)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Sonar
LMArena Text1415—
LMArena Creative Writing1349—
LMArena Multi-Turn1380—
LiveBench Language—44.1%

Frequently asked questions

Is Amazon Nova Experimental Chat 11 10 better than Sonar?

Amazon Nova Experimental Chat 11 10 is the stronger model overall, scoring 43.0 to 38.5 on the Noometry Index.

Is Amazon Nova Experimental Chat 11 10 or Sonar better for coding?

Amazon Nova Experimental Chat 11 10 scores higher on coding benchmarks: 42.3 versus 35.7 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 11 10 and Sonar share?

0 benchmarks have published results for both models. Amazon Nova Experimental Chat 11 10 has 17 scored results on Noometry and Sonar has 7.

Related comparisons

Go deeper