Noometry

Model comparison

Claude Sonnet 5.5 vs Olmo 7b Instruct

Claude Sonnet 5.5 is the stronger model overall, scoring 61.9 to 30.3 on the Noometry Index.

Last verified . 10 shared benchmarks.

Claude Sonnet 5.5 Anthropic

61.9

Rank #10 Confirmed

Olmo 7b Instruct Allen Institute for AI (Ai2)

30.3

Rank #295 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Claude Sonnet 5.5 scores higher in 6 categories and Olmo 7b Instruct in 0 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in math, where Claude Sonnet 5.5 leads 87.9 to 30.2.
  • Olmo 7b Instruct has downloadable open weights; the other is API-only.

Side by side

Claude Sonnet 5.5Olmo 7b Instruct
ProviderAnthropicAllen Institute for AI (Ai2)
Noometry Index61.930.3
Released2026-09-28—
WeightsProprietaryOpen
Context window1M—
Max output128K—
Input $ / M tokens$2—
Output $ / M tokens$10—
Results tracked3210

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 67.3 (#6), Olmo 7b Instruct: 29.6 (#303)

BenchmarkClaude Sonnet 5.5Olmo 7b Instruct
LMArena Coding15131016
FrontierCode52.1%—
CursorBench55.5%—
LMArena WebDev1774—
FrontierSWE61.9%—
SciCode61%—
ALE-Bench1,819—

Agentic & Tool Use Not comparable

Claude Sonnet 5.5: 45.0 (#16), Olmo 7b Instruct: —

BenchmarkClaude Sonnet 5.5Olmo 7b Instruct
APEX-Agents75.5%—

Reasoning Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 54.0 (#28), Olmo 7b Instruct: 18.8 (#274)

BenchmarkClaude Sonnet 5.5Olmo 7b Instruct
LMArena Hard Prompts1495993
NYT Connections (extended)80.5%—
CritPt31.4%—
Mystery Game Puzzles65%—
Epoch Capabilities Index165.03—

Math Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 87.9 (#6), Olmo 7b Instruct: 30.2 (#237)

BenchmarkClaude Sonnet 5.5Olmo 7b Instruct
LMArena Math15101018
FrontierMath (Tiers 1-3)88.8%—
FrontierMath Tier 480.5%—
OTIS Mock AIME 2024-2025100%—
ProofBench100%—
FrontierMath Erdős2.9%—

Knowledge Not comparable

Claude Sonnet 5.5: 66.0 (#12), Olmo 7b Instruct: —

BenchmarkClaude Sonnet 5.5Olmo 7b Instruct
GPQA Diamond95.6%—
SimpleQA Verified46.5%—
LMArena Expert1540—

Multimodal Not comparable

Claude Sonnet 5.5: 51.5 (#6), Olmo 7b Instruct: —

BenchmarkClaude Sonnet 5.5Olmo 7b Instruct
LMArena Vision1289—
Furniture Assembly75%—

Multilingual Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 55.3 (#30), Olmo 7b Instruct: 24.0 (#291)

BenchmarkClaude Sonnet 5.5Olmo 7b Instruct
LMArena Non-English1452977
LMArena Chinese15221014
LMArena Russian1451947

Instruction Following Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 78.3 (#11), Olmo 7b Instruct: 49.0 (#301)

BenchmarkClaude Sonnet 5.5Olmo 7b Instruct
LMArena Instruction Following1495978

Long Context Not comparable

Claude Sonnet 5.5: 45.9 (#28), Olmo 7b Instruct: —

BenchmarkClaude Sonnet 5.5Olmo 7b Instruct
LMArena Longer Query1498—

Writing & Preference Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 66.0 (#40), Olmo 7b Instruct: 25.8 (#303)

BenchmarkClaude Sonnet 5.5Olmo 7b Instruct
LMArena Text14711032
LMArena Creative Writing1465990
LMArena Multi-Turn14741007

Frequently asked questions

Is Claude Sonnet 5.5 better than Olmo 7b Instruct?

Claude Sonnet 5.5 is the stronger model overall, scoring 61.9 to 30.3 on the Noometry Index.

Is Claude Sonnet 5.5 or Olmo 7b Instruct better for coding?

Claude Sonnet 5.5 scores higher on coding benchmarks: 67.3 versus 29.6 in the Noometry coding category.

How many benchmarks do Claude Sonnet 5.5 and Olmo 7b Instruct share?

10 benchmarks have published results for both models. Claude Sonnet 5.5 has 32 scored results on Noometry and Olmo 7b Instruct has 10.

Related comparisons

Go deeper