Noometry

Model comparison

Claude Sonnet 5 vs ERNIE 5.1

Claude Sonnet 5 is the stronger model overall, scoring 54.5 to 43.1 on the Noometry Index.

Last verified . 19 shared benchmarks.

Claude Sonnet 5 Anthropic

54.5

Rank #26 Confirmed

ERNIE 5.1 Baidu

43.1

Rank #87 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Claude Sonnet 5 scores higher in 6 categories and ERNIE 5.1 in 2 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in math, where Claude Sonnet 5 leads 66.1 to 37.5.
  • The biggest single-benchmark swing is NYT Connections (extended): 75.1% for Claude Sonnet 5 and 23.4% for ERNIE 5.1.

Side by side

Claude Sonnet 5ERNIE 5.1
ProviderAnthropicBaidu
Noometry Index54.543.1
Released2026-06-29—
WeightsProprietaryProprietary
Context window1M—
Max output128K—
Input $ / M tokens$2—
Output $ / M tokens$10—
Results tracked5119

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Sonnet 5 leads

Claude Sonnet 5: 55.5 (#20), ERNIE 5.1: 43.4 (#78)

BenchmarkClaude Sonnet 5ERNIE 5.1
LMArena Coding14831488
DeepSWE53.8%—
FrontierCode42.7%—
CursorBench34.1%—
LMArena WebDev1540—
SciCode53.6%—
GSO37.3%—
WeirdML68.8%—
ALE-Bench1,463—

Agentic & Tool Use Not comparable

Claude Sonnet 5: 42.7 (#16), ERNIE 5.1: —

BenchmarkClaude Sonnet 5ERNIE 5.1
LMArena Search11941227
APEX-Agents54.5%—
GBAEval65.3%—
Vending-Bench 26,378—

Reasoning Claude Sonnet 5 leads

Claude Sonnet 5: 48.2 (#37), ERNIE 5.1: 20.9 (#209)

BenchmarkClaude Sonnet 5ERNIE 5.1
NYT Connections (extended)75.1%23.4%
LMArena Hard Prompts14611481
SimpleBench60.6%—
CritPt16.9%—
Chess Puzzles35%—
Mystery Game Puzzles35%—
DTBench92.5%—
LMCA50%—
Surface Evolver Bench60%—
Bench to the Future 30.14—
Epoch Capabilities Index156.34—
ForecastBench61.1—

Math Claude Sonnet 5 leads

Claude Sonnet 5: 66.1 (#21), ERNIE 5.1: 37.5 (#96)

BenchmarkClaude Sonnet 5ERNIE 5.1
LMArena Math14671481
FrontierMath (Tiers 1-3)65.6%—
FrontierMath Tier 429.3%—
OTIS Mock AIME 2024-202594.7%—
ProofBench77%—

Knowledge Claude Sonnet 5 leads

Claude Sonnet 5: 55.7 (#42), ERNIE 5.1: 41.2 (#103)

BenchmarkClaude Sonnet 5ERNIE 5.1
LMArena Expert14911491
GPQA Diamond90.5%—
SimpleQA Verified33.7%—

Multimodal Not comparable

Claude Sonnet 5: 42.4 (#26), ERNIE 5.1: —

BenchmarkClaude Sonnet 5ERNIE 5.1
LMArena Vision1275—
Blueprint-Bench 224.9%—
LMArena Document1466—

Multilingual ERNIE 5.1 leads

Claude Sonnet 5: 54.0 (#55), ERNIE 5.1: 55.7 (#28)

BenchmarkClaude Sonnet 5ERNIE 5.1
LMArena Non-English14311455
LMArena Chinese14751507
LMArena French14571486
LMArena German14481470
LMArena Japanese14221422
LMArena Korean14111428
LMArena Russian14521459
LMArena Spanish14361472

Instruction Following Too close to call

Claude Sonnet 5: 76.6 (#39), ERNIE 5.1: 76.9 (#35)

BenchmarkClaude Sonnet 5ERNIE 5.1
LMArena Instruction Following14531460

Long Context Too close to call

Claude Sonnet 5: 44.8 (#53), ERNIE 5.1: 44.7 (#56)

BenchmarkClaude Sonnet 5ERNIE 5.1
LMArena Longer Query14641462

Writing & Preference Claude Sonnet 5 leads

Claude Sonnet 5: 69.4 (#24), ERNIE 5.1: 65.3 (#50)

BenchmarkClaude Sonnet 5ERNIE 5.1
LMArena Text14431468
LMArena Creative Writing14161440
LMArena Multi-Turn14541471
EQ-Bench Creative Writing1794—
EQ-Bench 41236—

Frequently asked questions

Is Claude Sonnet 5 better than ERNIE 5.1?

Claude Sonnet 5 is the stronger model overall, scoring 54.5 to 43.1 on the Noometry Index.

Is Claude Sonnet 5 or ERNIE 5.1 better for coding?

Claude Sonnet 5 scores higher on coding benchmarks: 55.5 versus 43.4 in the Noometry coding category.

How many benchmarks do Claude Sonnet 5 and ERNIE 5.1 share?

19 benchmarks have published results for both models. Claude Sonnet 5 has 51 scored results on Noometry and ERNIE 5.1 has 19.

Related comparisons

Go deeper