Model comparison

Mercury vs Sonar

Mercury and Sonar score almost the same on the Noometry Index (37.6 vs 38.5), so choose on price, context window or the category you care about most.

Last verified . 0 shared benchmarks.

Mercury Inception

37.6

Rank #199 Confirmed

Sonar Perplexity

38.5

Rank #187 Confirmed

Summary

  • The widest gap is in writing & preference, where Sonar leads 52.6 to 46.2.

Side by side

Mercury and Sonar specifications
MercurySonar
ProviderInceptionPerplexity
Noometry Index37.638.5
Released—2024-01-01
WeightsProprietaryProprietary
Context window—128K
Max output—4K
Input $ / M tokens—$1
Output $ / M tokens—$1
Results tracked97

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mercury leads

Mercury: 38.7 (#170), Sonar: 35.7 (#221)

Coding benchmarks
BenchmarkMercurySonar
LiveBench Coding—35.1%
LMArena Coding1322—

Reasoning Sonar leads

Mercury: 17.5 (#293), Sonar: 21.1 (#227)

Reasoning benchmarks
BenchmarkMercurySonar
Kagi LLM Benchmark21.6%—
LiveBench Reasoning—46.3%
LMArena Hard Prompts1285—
LiveBench Data Analysis—37.9%
LiveBench—46.9%

Math Not comparable

Mercury: —, Sonar: 33.7 (#200)

Math benchmarks
BenchmarkMercurySonar
LiveBench Math—41.6%

Multilingual Not comparable

Mercury: 41.6 (#206), Sonar: —

Multilingual benchmarks
BenchmarkMercurySonar
LMArena Non-English1260—

Instruction Following Sonar leads

Mercury: 65.2 (#224), Sonar: 71.4 (#150)

Instruction Following benchmarks
BenchmarkMercurySonar
LiveBench Instruction Following—76.2%
LMArena Instruction Following1239—

Long Context Not comparable

Mercury: 38.4 (#198), Sonar: —

Long Context benchmarks
BenchmarkMercurySonar
LMArena Longer Query1266—

Writing & Preference Sonar leads

Mercury: 46.2 (#221), Sonar: 52.6 (#167)

Writing & Preference benchmarks
BenchmarkMercurySonar
LMArena Text1282—
LMArena Creative Writing1191—
LMArena Multi-Turn1282—
LiveBench Language—44.1%

Frequently asked questions

Is Mercury better than Sonar?

Mercury and Sonar score almost the same on the Noometry Index (37.6 vs 38.5), so choose on price, context window or the category you care about most.

Is Mercury or Sonar better for coding?

Mercury scores higher on coding benchmarks: 38.7 versus 35.7 in the Noometry coding category.

How many benchmarks do Mercury and Sonar share?

0 benchmarks have published results for both models. Mercury has 9 scored results on Noometry and Sonar has 7.

Related comparisons

Go deeper