Noometry

Model comparison

Gemini 3.5 Flash vs Mercury

Gemini 3.5 Flash is the stronger model overall, scoring 54.2 to 37.6 on the Noometry Index.

Last verified . 8 shared benchmarks.

Gemini 3.5 Flash Google

54.2

Rank #32 Confirmed

Mercury Inception

37.6

Rank #199 Confirmed

Summary

  • They share 8 benchmarks with published results for both. Gemini 3.5 Flash scores higher in 6 categories and Mercury in 0 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3.5 Flash leads 62.8 to 17.5.

Side by side

Gemini 3.5 FlashMercury
ProviderGoogleInception
Noometry Index54.237.6
Released2026-05-19—
WeightsProprietaryProprietary
Context window1.05M—
Max output66K—
Input $ / M tokens$1.50—
Output $ / M tokens$9—
Results tracked549

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.5 Flash leads

Gemini 3.5 Flash: 49.4 (#49), Mercury: 38.7 (#170)

BenchmarkGemini 3.5 FlashMercury
LMArena Coding14921322
SWE-bench Verified79.3%—
DeepSWE37.4%—
LMArena WebDev1499—
SciCode53.1%—
WeirdML62.6%—
ALE-Bench911.02—

Agentic & Tool Use Not comparable

Gemini 3.5 Flash: 24.7 (#114), Mercury: —

BenchmarkGemini 3.5 FlashMercury
APEX-Agents27.5%—
GBAEval6.7%—
GDP.pdf14%—
Vending-Bench 25,396—

Reasoning Gemini 3.5 Flash leads

Gemini 3.5 Flash: 62.8 (#18), Mercury: 17.5 (#293)

BenchmarkGemini 3.5 FlashMercury
LMArena Hard Prompts14881285
ARC-AGI-272.1%—
SimpleBench76.7%—
Kagi LLM Benchmark—21.6%
NYT Connections (extended)92.6%—
ARC-AGI-192.5%—
CritPt13.1%—
Chess Puzzles50%—
EnigmaEval25.4%—
EBR-Bench4.8%—
Mystery Game Puzzles32%—
DTBench94.7%—
LMCA47.1%—
Surface Evolver Bench58.1%—
Epoch Capabilities Index154.46—
ForecastBench59—

Math Not comparable

Gemini 3.5 Flash: 60.7 (#36), Mercury: —

BenchmarkGemini 3.5 FlashMercury
FrontierMath (Tiers 1-3)62.8%—
FrontierMath Tier 426.8%—
MathArena Final-Answer Competitions76.3%—
OTIS Mock AIME 2024-202595.6%—
ProofBench31%—
LMArena Math1504—
FrontierMath (Feb 2025 set)39%—
FrontierMath Tier 4 (v1)14.6%—

Knowledge Not comparable

Gemini 3.5 Flash: 66.3 (#11), Mercury: —

BenchmarkGemini 3.5 FlashMercury
GPQA Diamond92.8%—
SimpleQA Verified66.2%—
LMArena Expert1495—

Multimodal Not comparable

Gemini 3.5 Flash: 45.7 (#15), Mercury: —

BenchmarkGemini 3.5 FlashMercury
LMArena Vision1310—
Blueprint-Bench 233.6%—
LMArena Document1463—

Multilingual Gemini 3.5 Flash leads

Gemini 3.5 Flash: 57.0 (#13), Mercury: 41.6 (#206)

BenchmarkGemini 3.5 FlashMercury
LMArena Non-English14761260
LMArena Chinese1526—
LMArena French1490—
LMArena German1492—
LMArena Japanese1486—
LMArena Korean1451—
LMArena Russian1493—
LMArena Spanish1480—

Instruction Following Gemini 3.5 Flash leads

Gemini 3.5 Flash: 77.0 (#30), Mercury: 65.2 (#224)

BenchmarkGemini 3.5 FlashMercury
LMArena Instruction Following14671239

Long Context Gemini 3.5 Flash leads

Gemini 3.5 Flash: 45.4 (#38), Mercury: 38.4 (#198)

BenchmarkGemini 3.5 FlashMercury
LMArena Longer Query14821266

Writing & Preference Gemini 3.5 Flash leads

Gemini 3.5 Flash: 65.5 (#47), Mercury: 46.2 (#221)

BenchmarkGemini 3.5 FlashMercury
LMArena Text14821282
LMArena Creative Writing14701191
LMArena Multi-Turn14811282
EQ-Bench 41087—

Frequently asked questions

Is Gemini 3.5 Flash better than Mercury?

Gemini 3.5 Flash is the stronger model overall, scoring 54.2 to 37.6 on the Noometry Index.

Is Gemini 3.5 Flash or Mercury better for coding?

Gemini 3.5 Flash scores higher on coding benchmarks: 49.4 versus 38.7 in the Noometry coding category.

How many benchmarks do Gemini 3.5 Flash and Mercury share?

8 benchmarks have published results for both models. Gemini 3.5 Flash has 54 scored results on Noometry and Mercury has 9.

Related comparisons

Go deeper