Noometry

Model comparison

Claude Sonnet 5 vs Gemini 2.5 Pro

Claude Sonnet 5 is the stronger model overall, scoring 54.5 to 44.9 on the Noometry Index.

Last verified . 38 shared benchmarks.

Claude Sonnet 5 Anthropic

54.5

Rank #26 Confirmed

Gemini 2.5 Pro Google

44.9

Rank #67 Confirmed

Summary

  • They share 38 benchmarks with published results for both. Claude Sonnet 5 scores higher in 6 categories and Gemini 2.5 Pro in 4 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where Claude Sonnet 5 leads 66.1 to 31.9.
  • The biggest single-benchmark swing is FrontierMath (Tiers 1-3): 65.6% for Claude Sonnet 5 and 24.6% for Gemini 2.5 Pro.
  • Gemini 2.5 Pro is cheaper at $1.25 / $10 per million input/output tokens, against $2 / $10 for Claude Sonnet 5.
  • Gemini 2.5 Pro accepts more context: 1.05M tokens versus 1M.

Side by side

Claude Sonnet 5Gemini 2.5 Pro
ProviderAnthropicGoogle
Noometry Index54.544.9
Released2026-06-292025-03-25
WeightsProprietaryProprietary
Context window1M1.05M
Max output128K66K
Input $ / M tokens$2$1.25
Output $ / M tokens$10$10
Results tracked5178

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Sonnet 5 leads

Claude Sonnet 5: 55.5 (#20), Gemini 2.5 Pro: 42.8 (#86)

BenchmarkClaude Sonnet 5Gemini 2.5 Pro
LMArena WebDev15401227
SciCode53.6%42.8%
GSO37.3%3.9%
WeirdML68.8%54%
LMArena Coding14831452
ALE-Bench1,463785.52
SWE-bench Verified—57.6%
DeepSWE53.8%—
FrontierCode42.7%—
SWE-bench Verified (bash only)—53.6%
Aider Polyglot—83.1%
CursorBench34.1%—
LiveBench Coding—85.9%
CadEval—64%
AlgoTune—1.51

Agentic & Tool Use Claude Sonnet 5 leads

Claude Sonnet 5: 42.7 (#16), Gemini 2.5 Pro: 29.1 (#81)

BenchmarkClaude Sonnet 5Gemini 2.5 Pro
LMArena Search11941142
Vending-Bench 26,378573.64
Terminal-Bench—32.6%
APEX-Agents54.5%—
GDPval—23.3%
Remote Labor Index—0.8%
TheAgentCompany—30.3%
τ²-bench Banking—13.7%
DeepResearch Bench—42.8%
BALROG—43.3%
GBAEval65.3%—
METR Time Horizons—55.4%

Reasoning Claude Sonnet 5 leads

Claude Sonnet 5: 48.2 (#37), Gemini 2.5 Pro: 28.8 (#85)

BenchmarkClaude Sonnet 5Gemini 2.5 Pro
SimpleBench60.6%62.4%
CritPt16.9%2%
Chess Puzzles35%20%
LMArena Hard Prompts14611455
DTBench92.5%82.4%
LMCA50%34.8%
Epoch Capabilities Index156.34145.32
ForecastBench61.161.3
ARC-AGI-2—4.9%
Kagi LLM Benchmark—70.3%
NYT Connections (extended)75.1%—
ARC-AGI-1—41%
EnigmaEval—5.6%
LiveBench Reasoning—89.8%
Mystery Game Puzzles35%—
LiveBench Data Analysis—79.9%
Surface Evolver Bench60%—
Bench to the Future 30.14—
LiveBench—82.3%

Math Claude Sonnet 5 leads

Claude Sonnet 5: 66.1 (#21), Gemini 2.5 Pro: 31.9 (#191)

BenchmarkClaude Sonnet 5Gemini 2.5 Pro
FrontierMath (Tiers 1-3)65.6%24.6%
FrontierMath Tier 429.3%0%
OTIS Mock AIME 2024-202594.7%84.7%
LMArena Math14671450
ProofBench77%—
Omni-MATH—41.6%
LiveBench Math—90.2%
MATH Level 5—95.9%
FrontierMath (Feb 2025 set)—14.1%
FrontierMath Tier 4 (v1)—4.2%

Knowledge Too close to call

Claude Sonnet 5: 55.7 (#42), Gemini 2.5 Pro: 55.8 (#41)

BenchmarkClaude Sonnet 5Gemini 2.5 Pro
GPQA Diamond90.5%85.3%
LMArena Expert14911452
Humanity's Last Exam—21.6%
SimpleQA Verified33.7%—
MMLU-Pro—86.3%
Confabulations—10.6%
Vectara Hallucination Rate—7%
GPQA (HELM)—74.9%

Multimodal Gemini 2.5 Pro leads

Claude Sonnet 5: 42.4 (#26), Gemini 2.5 Pro: 44.5 (#16)

BenchmarkClaude Sonnet 5Gemini 2.5 Pro
LMArena Vision12751263
LMArena Document14661421
GeoBench—86%
VPCT—48%
Blueprint-Bench 224.9%—
SpatialViz-Bench—44.7%

Multilingual Gemini 2.5 Pro leads

Claude Sonnet 5: 54.0 (#55), Gemini 2.5 Pro: 55.5 (#30)

BenchmarkClaude Sonnet 5Gemini 2.5 Pro
LMArena Non-English14311452
LMArena Chinese14751507
LMArena French14571473
LMArena German14481487
LMArena Japanese14221462
LMArena Korean14111435
LMArena Russian14521460
LMArena Spanish14361473

Instruction Following Claude Sonnet 5 leads

Claude Sonnet 5: 76.6 (#39), Gemini 2.5 Pro: 75.2 (#71)

BenchmarkClaude Sonnet 5Gemini 2.5 Pro
LMArena Instruction Following14531436
LiveBench Instruction Following—80.6%
IFEval—84%

Long Context Gemini 2.5 Pro leads

Claude Sonnet 5: 44.8 (#53), Gemini 2.5 Pro: 59.7 (#5)

BenchmarkClaude Sonnet 5Gemini 2.5 Pro
LMArena Longer Query14641449
Fiction.LiveBench—91.7%

Writing & Preference Claude Sonnet 5 leads

Claude Sonnet 5: 69.4 (#24), Gemini 2.5 Pro: 63.9 (#60)

BenchmarkClaude Sonnet 5Gemini 2.5 Pro
LMArena Text14431458
LMArena Creative Writing14161453
EQ-Bench Creative Writing17941421
LMArena Multi-Turn14541453
Short-Story Creative Writing—83.8%
WildBench—85.7%
EQ-Bench 41236—
LiveBench Language—67.8%

Frequently asked questions

Is Claude Sonnet 5 better than Gemini 2.5 Pro?

Claude Sonnet 5 is the stronger model overall, scoring 54.5 to 44.9 on the Noometry Index.

Which is cheaper, Claude Sonnet 5 or Gemini 2.5 Pro?

Gemini 2.5 Pro is cheaper. It lists at $1.25 per million input tokens and $10 per million output tokens; Claude Sonnet 5 lists at $2 and $10.

Is Claude Sonnet 5 or Gemini 2.5 Pro better for coding?

Claude Sonnet 5 scores higher on coding benchmarks: 55.5 versus 42.8 in the Noometry coding category.

Which has the bigger context window?

Gemini 2.5 Pro does, with 1.05M tokens against 1M.

How many benchmarks do Claude Sonnet 5 and Gemini 2.5 Pro share?

38 benchmarks have published results for both models. Claude Sonnet 5 has 51 scored results on Noometry and Gemini 2.5 Pro has 78.

Related comparisons

Go deeper