Model comparison

Claude 3.5 Sonnet vs Claude Sonnet 5

Claude Sonnet 5 is the stronger model overall, scoring 54.6 to 34.6 on the Noometry Index.

Last verified . 27 shared benchmarks.

Claude 3.5 Sonnet Anthropic

34.6

Rank #231 Confirmed

Claude Sonnet 5 Anthropic

54.6

Rank #29 Confirmed

Summary

  • They share 27 benchmarks with published results for both. Claude 3.5 Sonnet scores higher in 0 categories and Claude Sonnet 5 in 10 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in math, where Claude Sonnet 5 leads 66.2 to 19.2.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 8.5% for Claude 3.5 Sonnet and 94.7% for Claude Sonnet 5.

Side by side

Claude 3.5 Sonnet and Claude Sonnet 5 specifications
Claude 3.5 SonnetClaude Sonnet 5
ProviderAnthropicAnthropic
Noometry Index34.654.6
Released2024-06-202026-06-29
WeightsProprietaryProprietary
Context window—1M
Max output—128K
Input $ / M tokens—$2
Output $ / M tokens—$10
Results tracked6051

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Sonnet 5 leads

Claude 3.5 Sonnet: 39.0 (#165), Claude Sonnet 5: 55.5 (#26)

Coding benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5
GSO4.6%37.3%
WeirdML40%68.8%
LMArena Coding13421483
DeepSWE—53.8%
FrontierCode—42.7%
Aider Polyglot51.6%—
CursorBench—34.1%
LMArena WebDev—1541
SciCode—54.3%
BigCodeBench Instruct46.8%—
LiveBench Coding67.1%—
BigCodeBench Complete58.6%—
CadEval48%—
ALE-Bench—1,463
HumanEval+81.7%—
MBPP+74.3%—

Agentic & Tool Use Claude Sonnet 5 leads

Claude 3.5 Sonnet: 32.3 (#67), Claude Sonnet 5: 42.8 (#18)

Agentic & Tool Use benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5
APEX-Agents—54.5%
TheAgentCompany24%—
Cybench17.5%—
BALROG32.6%—
GBAEval—65.3%
LMArena Search—1194
METR Time Horizons45.2%—
Vending-Bench 2—6,378

Reasoning Claude Sonnet 5 leads

Claude 3.5 Sonnet: 23.1 (#183), Claude Sonnet 5: 49.1 (#39)

Reasoning benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5
SimpleBench41.4%60.6%
LMArena Hard Prompts13051461
DTBench67.8%92.5%
Epoch Capabilities Index133.55156.21
ForecastBench60.761.1
NYT Connections (extended)—75.1%
CritPt—16.9%
Chess Puzzles—35%
EnigmaEval0.9%—
LiveBench Reasoning56.7%—
Mystery Game Puzzles—35%
LiveBench Data Analysis55%—
LMCA—50%
Surface Evolver Bench—60%
Bench to the Future 3—0.14
LiveBench59%—

Math Claude Sonnet 5 leads

Claude 3.5 Sonnet: 19.2 (#288), Claude Sonnet 5: 66.2 (#27)

Math benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5
OTIS Mock AIME 2024-20258.5%94.7%
LMArena Math13071467
FrontierMath (Tiers 1-3)—65.6%
FrontierMath Tier 4—29.3%
ProofBench—77%
Omni-MATH27.6%—
LiveBench Math52.3%—
MATH Level 556.9%—
FrontierMath (Feb 2025 set)2.1%—
FrontierMath Tier 4 (v1)0%—

Knowledge Claude Sonnet 5 leads

Claude 3.5 Sonnet: 28.6 (#245), Claude Sonnet 5: 55.6 (#47)

Knowledge benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5
GPQA Diamond55.3%90.5%
LMArena Expert12651490
Humanity's Last Exam4.1%—
SimpleQA Verified—33.7%
MMLU-Pro77.7%—
Confabulations19.9%—
GPQA (HELM)56.5%—
MMLU87.3%—

Multimodal Claude Sonnet 5 leads

Claude 3.5 Sonnet: 26.5 (#120), Claude Sonnet 5: 42.4 (#31)

Multimodal benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5
LMArena Vision11251274
Video-MME60%—
GeoBench62%—
VPCT33%—
Blueprint-Bench 2—24.9%
LMArena Document—1466

Multilingual Claude Sonnet 5 leads

Claude 3.5 Sonnet: 43.2 (#185), Claude Sonnet 5: 53.8 (#55)

Multilingual benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5
LMArena Non-English12831431
LMArena Chinese12721477
LMArena French13051460
LMArena German12971440
LMArena Japanese12341422
LMArena Korean12001411
LMArena Russian13061451
LMArena Spanish12901437

Instruction Following Claude Sonnet 5 leads

Claude 3.5 Sonnet: 68.8 (#182), Claude Sonnet 5: 76.3 (#41)

Instruction Following benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5
LMArena Instruction Following12971452
LiveBench Instruction Following69.3%—
IFEval85.5%—

Long Context Claude Sonnet 5 leads

Claude 3.5 Sonnet: 39.9 (#167), Claude Sonnet 5: 44.8 (#55)

Long Context benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5
LMArena Longer Query13111463

Writing & Preference Claude Sonnet 5 leads

Claude 3.5 Sonnet: 52.9 (#164), Claude Sonnet 5: 69.2 (#25)

Writing & Preference benchmarks
BenchmarkClaude 3.5 SonnetClaude Sonnet 5
LMArena Text12981442
LMArena Creative Writing12921416
EQ-Bench Creative Writing14511794
LMArena Multi-Turn13261454
Short-Story Creative Writing80.3%—
WildBench79.2%—
EQ-Bench 4—1236
LiveBench Language53.8%—

Frequently asked questions

Is Claude 3.5 Sonnet better than Claude Sonnet 5?

Claude Sonnet 5 is the stronger model overall, scoring 54.6 to 34.6 on the Noometry Index.

Is Claude 3.5 Sonnet or Claude Sonnet 5 better for coding?

Claude Sonnet 5 scores higher on coding benchmarks: 55.5 versus 39.0 in the Noometry coding category.

How many benchmarks do Claude 3.5 Sonnet and Claude Sonnet 5 share?

27 benchmarks have published results for both models. Claude 3.5 Sonnet has 60 scored results on Noometry and Claude Sonnet 5 has 51.

Related comparisons

Go deeper