Noometry

Model comparison

Claude 2 vs Gemini 3.5 Flash

Gemini 3.5 Flash is the stronger model overall, scoring 54.1 to 24.7 on the Noometry Index.

Last verified . 4 shared benchmarks.

Claude 2 Anthropic

24.7

Rank #342 Reported

Gemini 3.5 Flash Google

54.1

Rank #29 Confirmed

Summary

  • They share 4 benchmarks with published results for both. Claude 2 scores higher in 0 categories and Gemini 3.5 Flash in 3 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini 3.5 Flash leads 60.5 to 8.7.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 2.5% for Claude 2 and 95.6% for Gemini 3.5 Flash.

Side by side

Claude 2Gemini 3.5 Flash
ProviderAnthropicGoogle
Noometry Index24.754.1
Released2023-07-112026-05-19
WeightsProprietaryProprietary
Context window—1.05M
Max output—66K
Input $ / M tokens—$1.50
Output $ / M tokens—$9
Results tracked854

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude 2: —, Gemini 3.5 Flash: 49.1 (#46)

BenchmarkClaude 2Gemini 3.5 Flash
SWE-bench Verified—79.3%
DeepSWE—37.4%
LMArena WebDev—1499
SciCode—53.1%
WeirdML—62.6%
LMArena Coding—1492
ALE-Bench—911.02
HumanEval+61.6%—

Agentic & Tool Use Not comparable

Claude 2: —, Gemini 3.5 Flash: 24.8 (#107)

BenchmarkClaude 2Gemini 3.5 Flash
APEX-Agents—27.5%
GBAEval—6.7%
GDP.pdf—14%
Vending-Bench 2—5,396

Reasoning Gemini 3.5 Flash leads

Claude 2: 20.8 (#213), Gemini 3.5 Flash: 62.7 (#16)

BenchmarkClaude 2Gemini 3.5 Flash
DTBench51.9%94.7%
Epoch Capabilities Index120.08154.55
ARC-AGI-2—72.1%
SimpleBench—76.7%
NYT Connections (extended)—92.6%
ARC-AGI-1—92.5%
CritPt—13.1%
Chess Puzzles—50%
EnigmaEval—25.4%
EBR-Bench—4.8%
LMArena Hard Prompts—1488
Mystery Game Puzzles—32%
LMCA—47.1%
Surface Evolver Bench—58.1%
ForecastBench—59

Math Gemini 3.5 Flash leads

Claude 2: 8.7 (#314), Gemini 3.5 Flash: 60.5 (#30)

BenchmarkClaude 2Gemini 3.5 Flash
OTIS Mock AIME 2024-20252.5%95.6%
FrontierMath (Tiers 1-3)—62.8%
FrontierMath Tier 4—26.8%
MathArena Final-Answer Competitions—76.3%
ProofBench—31%
LMArena Math—1502
MATH Level 511.7%—
FrontierMath (Feb 2025 set)—39%
FrontierMath Tier 4 (v1)—14.6%

Knowledge Gemini 3.5 Flash leads

Claude 2: 17.0 (#282), Gemini 3.5 Flash: 66.3 (#10)

BenchmarkClaude 2Gemini 3.5 Flash
GPQA Diamond34.7%92.8%
SimpleQA Verified—66.2%
LMArena Expert—1493
MMLU78.5%—
TriviaQA87.5%—

Multimodal Not comparable

Claude 2: —, Gemini 3.5 Flash: 45.7 (#13)

BenchmarkClaude 2Gemini 3.5 Flash
LMArena Vision—1311
Blueprint-Bench 2—33.6%
LMArena Document—1463

Multilingual Not comparable

Claude 2: —, Gemini 3.5 Flash: 57.1 (#12)

BenchmarkClaude 2Gemini 3.5 Flash
LMArena Non-English—1475
LMArena Chinese—1525
LMArena French—1490
LMArena German—1500
LMArena Japanese—1481
LMArena Korean—1453
LMArena Russian—1491
LMArena Spanish—1478

Instruction Following Not comparable

Claude 2: —, Gemini 3.5 Flash: 77.2 (#29)

BenchmarkClaude 2Gemini 3.5 Flash
LMArena Instruction Following—1466

Long Context Not comparable

Claude 2: —, Gemini 3.5 Flash: 45.3 (#39)

BenchmarkClaude 2Gemini 3.5 Flash
LMArena Longer Query—1481

Writing & Preference Not comparable

Claude 2: —, Gemini 3.5 Flash: 65.5 (#46)

BenchmarkClaude 2Gemini 3.5 Flash
LMArena Text—1481
LMArena Creative Writing—1467
EQ-Bench 4—1087
LMArena Multi-Turn—1482

Frequently asked questions

Is Claude 2 better than Gemini 3.5 Flash?

Gemini 3.5 Flash is the stronger model overall, scoring 54.1 to 24.7 on the Noometry Index.

How many benchmarks do Claude 2 and Gemini 3.5 Flash share?

4 benchmarks have published results for both models. Claude 2 has 8 scored results on Noometry and Gemini 3.5 Flash has 54.

Related comparisons

Go deeper