Model comparison

Claude 2.1 vs Gemini 3.7 Flash

Gemini 3.7 Flash is the stronger model overall, scoring 59.8 to 24.9 on the Noometry Index.

Last verified . 4 shared benchmarks.

Claude 2.1 Anthropic

24.9

Rank #340 Reported

Gemini 3.7 Flash Google

59.8

Rank #11 Confirmed

Summary

  • They share 4 benchmarks with published results for both. Claude 2.1 scores higher in 0 categories and Gemini 3.7 Flash in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini 3.7 Flash leads 69.5 to 9.6.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 1.9% for Claude 2.1 and 97.2% for Gemini 3.7 Flash.

Side by side

Claude 2.1 and Gemini 3.7 Flash specifications
Claude 2.1Gemini 3.7 Flash
ProviderAnthropicGoogle
Noometry Index24.959.8
Released2023-11-212026-08-13
WeightsProprietaryProprietary
Context window—1.05M
Max output—66K
Input $ / M tokens—$0.75
Output $ / M tokens—$3.75
Results tracked744

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.7 Flash leads

Claude 2.1: 25.8 (#322), Gemini 3.7 Flash: 55.7 (#19)

Coding benchmarks
BenchmarkClaude 2.1Gemini 3.7 Flash
DeepSWE—65.5%
FrontierCode—43.6%
LMArena WebDev—1593
FrontierSWE—20.3%
SciCode—59.8%
WeirdML7.1%—
LMArena Coding—1499
ALE-Bench—904.3

Agentic & Tool Use Not comparable

Claude 2.1: —, Gemini 3.7 Flash: 42.2 (#18)

Agentic & Tool Use benchmarks
BenchmarkClaude 2.1Gemini 3.7 Flash
APEX-Agents—67.8%
Remote Labor Index—5%
GDP.pdf—23.8%

Reasoning Gemini 3.7 Flash leads

Claude 2.1: 20.6 (#216), Gemini 3.7 Flash: 70.1 (#12)

Reasoning benchmarks
BenchmarkClaude 2.1Gemini 3.7 Flash
DTBench51%96.8%
Epoch Capabilities Index119.22157.72
ARC-AGI-2—84.6%
NYT Connections (extended)—94%
ARC-AGI-1—95.5%
CritPt—14.3%
Chess Puzzles—47%
LMArena Hard Prompts—1497
Mystery Game Puzzles—37%
LMCA—50.4%
ForecastBench54.2—

Math Gemini 3.7 Flash leads

Claude 2.1: 9.6 (#309), Gemini 3.7 Flash: 69.5 (#18)

Math benchmarks
BenchmarkClaude 2.1Gemini 3.7 Flash
OTIS Mock AIME 2024-20251.9%97.2%
FrontierMath (Tiers 1-3)—71.6%
FrontierMath Tier 4—36.6%
ProofBench—58%
LMArena Math—1511

Knowledge Gemini 3.7 Flash leads

Claude 2.1: 15.5 (#287), Gemini 3.7 Flash: 69.8 (#4)

Knowledge benchmarks
BenchmarkClaude 2.1Gemini 3.7 Flash
GPQA Diamond33%94.8%
SimpleQA Verified—69.2%
LMArena Expert—1508
MMLU73.5%—

Multimodal Not comparable

Claude 2.1: —, Gemini 3.7 Flash: 36.9 (#69)

Multimodal benchmarks
BenchmarkClaude 2.1Gemini 3.7 Flash
LMArena Vision—1314
Furniture Assembly—26.7%

Multilingual Not comparable

Claude 2.1: —, Gemini 3.7 Flash: 57.8 (#7)

Multilingual benchmarks
BenchmarkClaude 2.1Gemini 3.7 Flash
LMArena Non-English—1485
LMArena Chinese—1553
LMArena French—1512
LMArena German—1485
LMArena Japanese—1506
LMArena Korean—1486
LMArena Russian—1519
LMArena Spanish—1507

Instruction Following Not comparable

Claude 2.1: —, Gemini 3.7 Flash: 78.0 (#12)

Instruction Following benchmarks
BenchmarkClaude 2.1Gemini 3.7 Flash
LMArena Instruction Following—1486

Long Context Not comparable

Claude 2.1: —, Gemini 3.7 Flash: 45.8 (#28)

Long Context benchmarks
BenchmarkClaude 2.1Gemini 3.7 Flash
LMArena Longer Query—1493

Writing & Preference Not comparable

Claude 2.1: —, Gemini 3.7 Flash: 71.4 (#19)

Writing & Preference benchmarks
BenchmarkClaude 2.1Gemini 3.7 Flash
LMArena Text—1487
LMArena Creative Writing—1490
EQ-Bench Creative Writing—1723
LMArena Multi-Turn—1495

Frequently asked questions

Is Claude 2.1 better than Gemini 3.7 Flash?

Gemini 3.7 Flash is the stronger model overall, scoring 59.8 to 24.9 on the Noometry Index.

Is Claude 2.1 or Gemini 3.7 Flash better for coding?

Gemini 3.7 Flash scores higher on coding benchmarks: 55.7 versus 25.8 in the Noometry coding category.

How many benchmarks do Claude 2.1 and Gemini 3.7 Flash share?

4 benchmarks have published results for both models. Claude 2.1 has 7 scored results on Noometry and Gemini 3.7 Flash has 44.

Related comparisons

Go deeper