Model comparison

Molmo 2 8b vs Sonar

Molmo 2 8b and Sonar score almost the same on the Noometry Index (39.1 vs 38.5), so choose on price, context window or the category you care about most.

Last verified . 0 shared benchmarks.

Sonar Perplexity

38.5

Rank #187 Confirmed

Summary

  • The widest gap is in instruction following, where Sonar leads 71.4 to 67.0.
  • Molmo 2 8b has downloadable open weights; the other is API-only.

Side by side

Molmo 2 8b and Sonar specifications
Molmo 2 8bSonar
ProviderAllen Institute for AI (Ai2)Perplexity
Noometry Index39.138.5
Released—2024-01-01
WeightsOpenProprietary
Context window—128K
Max output—4K
Input $ / M tokens—$1
Output $ / M tokens—$1
Results tracked57

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Molmo 2 8b: —, Sonar: 35.7 (#221)

Coding benchmarks
BenchmarkMolmo 2 8bSonar
LiveBench Coding—35.1%

Reasoning Molmo 2 8b leads

Molmo 2 8b: 25.6 (#146), Sonar: 21.1 (#227)

Reasoning benchmarks
BenchmarkMolmo 2 8bSonar
LiveBench Reasoning—46.3%
LMArena Hard Prompts1287—
LiveBench Data Analysis—37.9%
LiveBench—46.9%

Math Not comparable

Molmo 2 8b: —, Sonar: 33.7 (#200)

Math benchmarks
BenchmarkMolmo 2 8bSonar
LiveBench Math—41.6%

Multimodal Not comparable

Molmo 2 8b: 30.2 (#112), Sonar: —

Multimodal benchmarks
BenchmarkMolmo 2 8bSonar
LMArena Vision1081—

Multilingual Not comparable

Molmo 2 8b: 42.7 (#190), Sonar: —

Multilingual benchmarks
BenchmarkMolmo 2 8bSonar
LMArena Non-English1276—

Instruction Following Sonar leads

Molmo 2 8b: 67.0 (#201), Sonar: 71.4 (#150)

Instruction Following benchmarks
BenchmarkMolmo 2 8bSonar
LiveBench Instruction Following—76.2%
LMArena Instruction Following1270—

Writing & Preference Sonar leads

Molmo 2 8b: 49.4 (#191), Sonar: 52.6 (#167)

Writing & Preference benchmarks
BenchmarkMolmo 2 8bSonar
LMArena Text1288—
LiveBench Language—44.1%

Frequently asked questions

Is Molmo 2 8b better than Sonar?

Molmo 2 8b and Sonar score almost the same on the Noometry Index (39.1 vs 38.5), so choose on price, context window or the category you care about most.

How many benchmarks do Molmo 2 8b and Sonar share?

0 benchmarks have published results for both models. Molmo 2 8b has 5 scored results on Noometry and Sonar has 7.

Related comparisons

Go deeper