Model comparison

Gemini 3 Pro vs Mercury 2.5

Gemini 3 Pro has enough public results to be ranked (#23); Mercury 2.5 does not yet, so treat this comparison as directional.

Last verified . 2 shared benchmarks.

Gemini 3 Pro Google

54.7

Rank #23 Confirmed

Mercury 2.5 Inception

30.2

Unranked Sparse

Summary

  • They share 2 benchmarks with published results for both. Gemini 3 Pro scores higher in 1 category and Mercury 2.5 in 0 categories; one gap is clear of the uncertainty.
  • The widest gap is in math, where Gemini 3 Pro leads 48.8 to 22.4.
  • The biggest single-benchmark swing is ProofBench: 20% for Gemini 3 Pro and 3% for Mercury 2.5.

Side by side

Gemini 3 Pro and Mercury 2.5 specifications
Gemini 3 ProMercury 2.5
ProviderGoogleInception
Noometry Index54.730.2
Released2025-11-182026-09-08
WeightsProprietaryProprietary
Context window—260K
Max output—66K
Input $ / M tokens—$0.04
Output $ / M tokens—$0.15
Results tracked672

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemini 3 Pro: 52.1 (#33), Mercury 2.5: —

Coding benchmarks
BenchmarkGemini 3 ProMercury 2.5
ALE-Bench1,177301.65
SWE-bench Verified72.9%—
SWE-bench Verified (bash only)74.2%—
LMArena WebDev1439—
SWE-bench Multilingual68.7%—
GSO18.6%—
WeirdML69.9%—
LMArena Coding1482—
AlgoTune1.83—

Agentic & Tool Use Not comparable

Gemini 3 Pro: 40.5 (#21), Mercury 2.5: —

Agentic & Tool Use benchmarks
BenchmarkGemini 3 ProMercury 2.5
Terminal-Bench69.4%—
Berkeley Function Calling Leaderboard72.5%—
GDPval40.3%—
Remote Labor Index1.3%—
τ²-bench Airline80.5%—
τ²-bench Banking18%—
τ²-bench Retail75.9%—
τ²-bench Telecom91%—
DeepResearch Bench46.3%—
BALROG58.1%—
LMArena Search1207—
METR Time Horizons71%—
Vending-Bench 25,478—

Reasoning Not comparable

Gemini 3 Pro: 52.5 (#28), Mercury 2.5: —

Reasoning benchmarks
BenchmarkGemini 3 ProMercury 2.5
ARC-AGI-231.1%—
SimpleBench76.4%—
Kagi LLM Benchmark80.1%—
NYT Connections (extended)94.4%—
ARC-AGI-175%—
CritPt6.9%—
Chess Puzzles31%—
EnigmaEval18.2%—
LMArena Hard Prompts1481—
Epoch Capabilities Index152.96—
ForecastBench61.2—

Math Gemini 3 Pro leads

Gemini 3 Pro: 48.8 (#50), Mercury 2.5: 22.4

Math benchmarks
BenchmarkGemini 3 ProMercury 2.5
ProofBench20%3%
MathArena Final-Answer Competitions67%—
OTIS Mock AIME 2024-202591.4%—
Omni-MATH55.5%—
LMArena Math1475—
FrontierMath (Feb 2025 set)37.6%—
FrontierMath Tier 4 (v1)18.8%—

Knowledge Not comparable

Gemini 3 Pro: 64.3 (#15), Mercury 2.5: —

Knowledge benchmarks
BenchmarkGemini 3 ProMercury 2.5
GPQA Diamond92.6%—
Humanity's Last Exam37.5%—
MMLU-Pro90.3%—
Vectara Hallucination Rate13.6%—
GPQA (HELM)80.3%—
LMArena Expert1475—

Multimodal Not comparable

Gemini 3 Pro: 56.9 (#1), Mercury 2.5: —

Multimodal benchmarks
BenchmarkGemini 3 ProMercury 2.5
LMArena Vision1305—
GeoBench84%—
VPCT91%—
LMArena Document1434—

Multilingual Not comparable

Gemini 3 Pro: 57.1 (#14), Mercury 2.5: —

Multilingual benchmarks
BenchmarkGemini 3 ProMercury 2.5
LMArena Non-English1474—
LMArena Chinese1522—
LMArena French1492—
LMArena German1517—
LMArena Japanese1513—
LMArena Korean1449—
LMArena Russian1493—
LMArena Spanish1468—

Instruction Following Not comparable

Gemini 3 Pro: 76.4 (#42), Mercury 2.5: —

Instruction Following benchmarks
BenchmarkGemini 3 ProMercury 2.5
IFEval87.7%—
LMArena Instruction Following1458—

Long Context Not comparable

Gemini 3 Pro: 44.0 (#75), Mercury 2.5: —

Long Context benchmarks
BenchmarkGemini 3 ProMercury 2.5
CL-bench15.8%—
LMArena Longer Query1472—

Writing & Preference Not comparable

Gemini 3 Pro: 66.6 (#34), Mercury 2.5: —

Writing & Preference benchmarks
BenchmarkGemini 3 ProMercury 2.5
LMArena Text1479—
LMArena Creative Writing1482—
EQ-Bench Creative Writing1525—
WildBench85.9%—
LMArena Multi-Turn1484—

Frequently asked questions

Is Gemini 3 Pro better than Mercury 2.5?

Gemini 3 Pro has enough public results to be ranked (#23); Mercury 2.5 does not yet, so treat this comparison as directional.

How many benchmarks do Gemini 3 Pro and Mercury 2.5 share?

2 benchmarks have published results for both models. Gemini 3 Pro has 67 scored results on Noometry and Mercury 2.5 has 2.

Related comparisons

Go deeper