Model comparison

Claude 3.7 Sonnet vs Gemini 3.7 Flash

Gemini 3.7 Flash is the stronger model overall, scoring 59.8 to 39.5 on the Noometry Index.

Last verified . 24 shared benchmarks.

Claude 3.7 Sonnet Anthropic

39.5

Rank #164 Confirmed

Gemini 3.7 Flash Google

59.8

Rank #14 Confirmed

Summary

  • They share 24 benchmarks with published results for both. Claude 3.7 Sonnet scores higher in 1 category and Gemini 3.7 Flash in 9 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3.7 Flash leads 70.0 to 18.6.
  • The biggest single-benchmark swing is ARC-AGI-2: 0.9% for Claude 3.7 Sonnet and 84.6% for Gemini 3.7 Flash.

Side by side

Claude 3.7 Sonnet and Gemini 3.7 Flash specifications
Claude 3.7 SonnetGemini 3.7 Flash
ProviderAnthropicGoogle
Noometry Index39.559.8
Released2025-02-242026-08-13
WeightsProprietaryProprietary
Context window—1.05M
Max output—66K
Input $ / M tokens—$0.75
Output $ / M tokens—$3.75
Results tracked5844

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.7 Flash leads

Claude 3.7 Sonnet: 40.6 (#136), Gemini 3.7 Flash: 56.2 (#22)

Coding benchmarks
BenchmarkClaude 3.7 SonnetGemini 3.7 Flash
LMArena Coding13611497
SWE-bench Verified61%—
DeepSWE—65.5%
FrontierCode—43.6%
SWE-bench Verified (bash only)52.8%—
Aider Polyglot64.9%—
LMArena WebDev—1592
FrontierSWE—20.3%
SciCode—59.8%
GSO3.8%—
LiveBench Coding74.5%—
CadEval54%—
ALE-Bench—904.3

Agentic & Tool Use Gemini 3.7 Flash leads

Claude 3.7 Sonnet: 34.1 (#50), Gemini 3.7 Flash: 42.1 (#19)

Agentic & Tool Use benchmarks
BenchmarkClaude 3.7 SonnetGemini 3.7 Flash
APEX-Agents—67.8%
Remote Labor Index—5%
TheAgentCompany30.9%—
Cybench20%—
DeepResearch Bench43.6%—
OSWorld35.8%—
GDP.pdf—23.8%
METR Time Horizons60%—

Reasoning Gemini 3.7 Flash leads

Claude 3.7 Sonnet: 18.6 (#277), Gemini 3.7 Flash: 70.0 (#15)

Reasoning benchmarks
BenchmarkClaude 3.7 SonnetGemini 3.7 Flash
ARC-AGI-20.9%84.6%
ARC-AGI-128.6%95.5%
LMArena Hard Prompts13331494
Epoch Capabilities Index141.16157.27
SimpleBench46.4%—
NYT Connections (extended)—94%
CritPt—14.3%
Chess Puzzles—47%
EnigmaEval4.2%—
LiveBench Reasoning87.8%—
Mystery Game Puzzles—37%
DTBench—96.8%
LiveBench Data Analysis74%—
LMCA—50.4%
ForecastBench61.8—
LiveBench76.1%—

Math Gemini 3.7 Flash leads

Claude 3.7 Sonnet: 37.5 (#153), Gemini 3.7 Flash: 69.6 (#23)

Math benchmarks
BenchmarkClaude 3.7 SonnetGemini 3.7 Flash
OTIS Mock AIME 2024-202557.8%97.2%
LMArena Math13371507
FrontierMath (Tiers 1-3)—71.6%
FrontierMath Tier 4—36.6%
ProofBench—58%
Omni-MATH33%—
LiveBench Math79%—
MATH Level 591.2%—
FrontierMath (Feb 2025 set)4.1%—

Knowledge Gemini 3.7 Flash leads

Claude 3.7 Sonnet: 39.8 (#130), Gemini 3.7 Flash: 69.7 (#5)

Knowledge benchmarks
BenchmarkClaude 3.7 SonnetGemini 3.7 Flash
GPQA Diamond79.7%94.8%
LMArena Expert13211508
Humanity's Last Exam8%—
SimpleQA Verified—69.2%
MMLU-Pro78.4%—
Confabulations14.7%—
GPQA (HELM)60.8%—

Multimodal Gemini 3.7 Flash leads

Claude 3.7 Sonnet: 33.7 (#95), Gemini 3.7 Flash: 37.3 (#73)

Multimodal benchmarks
BenchmarkClaude 3.7 SonnetGemini 3.7 Flash
LMArena Vision11691316
GeoBench68%—
VPCT39%—
Furniture Assembly—26.7%
SpatialViz-Bench33.9%—

Multilingual Gemini 3.7 Flash leads

Claude 3.7 Sonnet: 44.1 (#179), Gemini 3.7 Flash: 57.6 (#7)

Multilingual benchmarks
BenchmarkClaude 3.7 SonnetGemini 3.7 Flash
LMArena Non-English12961484
LMArena Chinese12991548
LMArena French13031505
LMArena German13011498
LMArena Japanese12671512
LMArena Korean12491483
LMArena Russian13111516
LMArena Spanish12981503

Instruction Following Gemini 3.7 Flash leads

Claude 3.7 Sonnet: 72.9 (#125), Gemini 3.7 Flash: 77.7 (#15)

Instruction Following benchmarks
BenchmarkClaude 3.7 SonnetGemini 3.7 Flash
LMArena Instruction Following13521483
LiveBench Instruction Following81.3%—
IFEval83.4%—

Long Context Claude 3.7 Sonnet leads

Claude 3.7 Sonnet: 50.3 (#10), Gemini 3.7 Flash: 45.7 (#30)

Long Context benchmarks
BenchmarkClaude 3.7 SonnetGemini 3.7 Flash
LMArena Longer Query13731492
Fiction.LiveBench83.3%—

Writing & Preference Gemini 3.7 Flash leads

Claude 3.7 Sonnet: 54.4 (#150), Gemini 3.7 Flash: 71.2 (#20)

Writing & Preference benchmarks
BenchmarkClaude 3.7 SonnetGemini 3.7 Flash
LMArena Text13141486
LMArena Creative Writing13321490
EQ-Bench Creative Writing14121723
LMArena Multi-Turn13391489
Short-Story Creative Writing81.1%—
WildBench81.4%—
LiveBench Language59.9%—

Frequently asked questions

Is Claude 3.7 Sonnet better than Gemini 3.7 Flash?

Gemini 3.7 Flash is the stronger model overall, scoring 59.8 to 39.5 on the Noometry Index.

Is Claude 3.7 Sonnet or Gemini 3.7 Flash better for coding?

Gemini 3.7 Flash scores higher on coding benchmarks: 56.2 versus 40.6 in the Noometry coding category.

How many benchmarks do Claude 3.7 Sonnet and Gemini 3.7 Flash share?

24 benchmarks have published results for both models. Claude 3.7 Sonnet has 58 scored results on Noometry and Gemini 3.7 Flash has 44.

Related comparisons

Go deeper