Noometry

Model comparison

Claude Opus 4 vs Gemini 3 Flash Preview

Gemini 3 Flash Preview is the stronger model overall, scoring 52.3 to 43.1 on the Noometry Index.

Last verified . 38 shared benchmarks.

Claude Opus 4 Anthropic

43.1

Rank #100 Confirmed

Gemini 3 Flash Preview Google

52.3

Rank #40 Confirmed

Summary

  • They share 38 benchmarks with published results for both. Claude Opus 4 scores higher in 1 category and Gemini 3 Flash Preview in 9 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3 Flash Preview leads 49.2 to 27.3.
  • The biggest single-benchmark swing is ARC-AGI-1: 35.7% for Claude Opus 4 and 84.7% for Gemini 3 Flash Preview.
  • Gemini 3 Flash Preview is cheaper at $0.50 / $3 per million input/output tokens, against $15 / $75 for Claude Opus 4.
  • Gemini 3 Flash Preview accepts more context: 1.05M tokens versus 200K.

Side by side

Claude Opus 4Gemini 3 Flash Preview
ProviderAnthropicGoogle
Noometry Index43.152.3
Released2025-05-222025-12-17
WeightsProprietaryProprietary
Context window200K1.05M
Max output32K66K
Input $ / M tokens$15$0.50
Output $ / M tokens$75$3
Results tracked5659

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3 Flash Preview leads

Claude Opus 4: 47.2 (#62), Gemini 3 Flash Preview: 50.9 (#42)

BenchmarkClaude Opus 4Gemini 3 Flash Preview
SWE-bench Verified70.7%75.4%
SWE-bench Verified (bash only)67.6%75.8%
GSO6.9%9.8%
WeirdML43.7%61.6%
LMArena Coding14421460
Aider Polyglot72%—
LMArena WebDev—1439
SWE-bench Multilingual—72.7%
ALE-Bench—1,367
AlgoTune1.33—

Agentic & Tool Use Gemini 3 Flash Preview leads

Claude Opus 4: 34.8 (#42), Gemini 3 Flash Preview: 38.7 (#29)

BenchmarkClaude Opus 4Gemini 3 Flash Preview
DeepResearch Bench46.8%49.8%
LMArena Search11271198
Terminal-Bench—64.3%
τ²-bench Airline—82.5%
τ²-bench Banking—27.3%
τ²-bench Retail—76.8%
τ²-bench Telecom—91.2%
Cybench38%—
BALROG—48.1%
GDP.pdf—10%
METR Time Horizons63.9%—
Vending-Bench 2—3,635

Reasoning Gemini 3 Flash Preview leads

Claude Opus 4: 27.3 (#121), Gemini 3 Flash Preview: 49.2 (#37)

BenchmarkClaude Opus 4Gemini 3 Flash Preview
ARC-AGI-28.6%33.6%
SimpleBench58.8%61.1%
ARC-AGI-135.7%84.7%
LMArena Hard Prompts13991465
DTBench81.6%89.1%
LMCA37.4%43.1%
Epoch Capabilities Index142.67151.8
ForecastBench61.158.5
Kagi LLM Benchmark74.3%—
NYT Connections (extended)—83.1%
CritPt0.3%—
Chess Puzzles—40%
EnigmaEval5.6%—
Mystery Game Puzzles—26%

Math Gemini 3 Flash Preview leads

Claude Opus 4: 42.0 (#86), Gemini 3 Flash Preview: 51.7 (#55)

BenchmarkClaude Opus 4Gemini 3 Flash Preview
OTIS Mock AIME 2024-202564.4%95.6%
LMArena Math13901473
FrontierMath (Feb 2025 set)4.5%35.6%
FrontierMath Tier 4 (v1)4.2%4.2%
FrontierMath (Tiers 1-3)—51.2%
FrontierMath Tier 4—17.1%
MathArena Final-Answer Competitions—67.6%
ProofBench—15%
Omni-MATH61.6%—
MATH Level 585%—

Knowledge Gemini 3 Flash Preview leads

Claude Opus 4: 44.0 (#88), Gemini 3 Flash Preview: 58.8 (#33)

BenchmarkClaude Opus 4Gemini 3 Flash Preview
GPQA Diamond76.3%89.4%
Vectara Hallucination Rate12%13.5%
LMArena Expert13861462
Humanity's Last Exam10.7%—
SimpleQA Verified—66.8%
MMLU-Pro87.5%—
Confabulations15.9%—
GPQA (HELM)70.8%—

Multimodal Gemini 3 Flash Preview leads

Claude Opus 4: 31.5 (#106), Gemini 3 Flash Preview: 45.5 (#16)

BenchmarkClaude Opus 4Gemini 3 Flash Preview
LMArena Vision11921285
GeoBench49%88%
VPCT38%72.6%
Blueprint-Bench 2—0%
LMArena Document—1413

Multilingual Gemini 3 Flash Preview leads

Claude Opus 4: 48.8 (#138), Gemini 3 Flash Preview: 55.7 (#27)

BenchmarkClaude Opus 4Gemini 3 Flash Preview
LMArena Non-English13621458
LMArena Chinese13861511
LMArena French13721477
LMArena German13911497
LMArena Japanese13311489
LMArena Korean13211443
LMArena Russian13921480
LMArena Spanish13891469

Instruction Following Claude Opus 4 leads

Claude Opus 4: 77.1 (#28), Gemini 3 Flash Preview: 75.7 (#56)

BenchmarkClaude Opus 4Gemini 3 Flash Preview
LMArena Instruction Following14061437
IFEval91.8%—

Long Context Gemini 3 Flash Preview leads

Claude Opus 4: 39.6 (#172), Gemini 3 Flash Preview: 44.4 (#67)

BenchmarkClaude Opus 4Gemini 3 Flash Preview
LMArena Longer Query14221452
Fiction.LiveBench61.1%—

Writing & Preference Gemini 3 Flash Preview leads

Claude Opus 4: 61.2 (#89), Gemini 3 Flash Preview: 65.5 (#45)

BenchmarkClaude Opus 4Gemini 3 Flash Preview
LMArena Text13771466
LMArena Creative Writing13871457
LMArena Multi-Turn13961471
Short-Story Creative Writing83.6%—
EQ-Bench Creative Writing1580—
WildBench85.2%—

Frequently asked questions

Is Claude Opus 4 better than Gemini 3 Flash Preview?

Gemini 3 Flash Preview is the stronger model overall, scoring 52.3 to 43.1 on the Noometry Index.

Which is cheaper, Claude Opus 4 or Gemini 3 Flash Preview?

Gemini 3 Flash Preview is cheaper. It lists at $0.50 per million input tokens and $3 per million output tokens; Claude Opus 4 lists at $15 and $75.

Is Claude Opus 4 or Gemini 3 Flash Preview better for coding?

Gemini 3 Flash Preview scores higher on coding benchmarks: 50.9 versus 47.2 in the Noometry coding category.

Which has the bigger context window?

Gemini 3 Flash Preview does, with 1.05M tokens against 200K.

How many benchmarks do Claude Opus 4 and Gemini 3 Flash Preview share?

38 benchmarks have published results for both models. Claude Opus 4 has 56 scored results on Noometry and Gemini 3 Flash Preview has 59.

Related comparisons

Go deeper