Noometry

Model comparison

Gemini 2.5 Pro vs Qwen3.7 Plus

Gemini 2.5 Pro and Qwen3.7 Plus score almost the same on the Noometry Index (45.0 vs 45.3), so choose on price, context window or the category you care about most.

Last verified . 28 shared benchmarks.

Gemini 2.5 Pro Google

45.0

Rank #75 Confirmed

Qwen3.7 Plus Alibaba (Qwen)

45.3

Rank #72 Confirmed

Summary

  • They share 28 benchmarks with published results for both. Gemini 2.5 Pro scores higher in 6 categories and Qwen3.7 Plus in 4 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in math, where Qwen3.7 Plus leads 50.5 to 32.5.
  • The biggest single-benchmark swing is FrontierMath (Tiers 1-3): 24.6% for Gemini 2.5 Pro and 34.4% for Qwen3.7 Plus.
  • Qwen3.7 Plus is cheaper at $0.40 / $1.60 per million input/output tokens, against $1.25 / $10 for Gemini 2.5 Pro.
  • Gemini 2.5 Pro accepts more context: 1.05M tokens versus 1M.

Side by side

Gemini 2.5 ProQwen3.7 Plus
ProviderGoogleAlibaba (Qwen)
Noometry Index45.045.3
Released2025-03-252026-06-02
WeightsProprietaryProprietary
Context window1.05M1M
Max output66K131K
Input $ / M tokens$1.25$0.40
Output $ / M tokens$10$1.60
Results tracked7832

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.5 Pro leads

Gemini 2.5 Pro: 42.4 (#101), Qwen3.7 Plus: 36.6 (#206)

BenchmarkGemini 2.5 ProQwen3.7 Plus
SciCode42.8%45.5%
LMArena Coding14521473
SWE-bench Verified57.6%—
FrontierCode—10.2%
SWE-bench Verified (bash only)53.6%—
Aider Polyglot83.1%—
LMArena WebDev1227—
GSO3.9%—
WeirdML54%—
LiveBench Coding85.9%—
CadEval64%—
ALE-Bench785.52—
AlgoTune1.51—

Agentic & Tool Use Gemini 2.5 Pro leads

Gemini 2.5 Pro: 29.2 (#88), Qwen3.7 Plus: 21.4 (#138)

BenchmarkGemini 2.5 ProQwen3.7 Plus
Terminal-Bench32.6%—
OSWorld 2.0—2.8%
GDPval23.3%—
Remote Labor Index0.8%—
TheAgentCompany30.3%—
τ²-bench Banking13.7%—
DeepResearch Bench42.8%—
BALROG43.3%—
LMArena Search1142—
METR Time Horizons55.4%—
Vending-Bench 2573.64—

Reasoning Qwen3.7 Plus leads

Gemini 2.5 Pro: 28.8 (#99), Qwen3.7 Plus: 39.3 (#59)

BenchmarkGemini 2.5 ProQwen3.7 Plus
CritPt2%9.1%
Chess Puzzles20%24%
LMArena Hard Prompts14551460
DTBench82.4%84%
LMCA34.8%37.6%
Epoch Capabilities Index145.32147.37
ARC-AGI-24.9%—
SimpleBench62.4%—
Kagi LLM Benchmark70.3%—
NYT Connections (extended)—74.8%
ARC-AGI-141%—
EnigmaEval5.6%—
LiveBench Reasoning89.8%—
Mystery Game Puzzles—17%
LiveBench Data Analysis79.9%—
ForecastBench61.3—
LiveBench82.3%—

Math Qwen3.7 Plus leads

Gemini 2.5 Pro: 32.5 (#213), Qwen3.7 Plus: 50.5 (#56)

BenchmarkGemini 2.5 ProQwen3.7 Plus
FrontierMath (Tiers 1-3)24.6%34.4%
OTIS Mock AIME 2024-202584.7%93.3%
LMArena Math14501466
FrontierMath Tier 40%—
Omni-MATH41.6%—
LiveBench Math90.2%—
MATH Level 595.9%—
FrontierMath (Feb 2025 set)14.1%—
FrontierMath Tier 4 (v1)4.2%—

Knowledge Gemini 2.5 Pro leads

Gemini 2.5 Pro: 56.0 (#46), Qwen3.7 Plus: 54.9 (#51)

BenchmarkGemini 2.5 ProQwen3.7 Plus
GPQA Diamond85.3%87.9%
LMArena Expert14521467
Humanity's Last Exam21.6%—
MMLU-Pro86.3%—
Confabulations10.6%—
Vectara Hallucination Rate7%—
GPQA (HELM)74.9%—

Multimodal Gemini 2.5 Pro leads

Gemini 2.5 Pro: 45.2 (#18), Qwen3.7 Plus: 41.8 (#33)

BenchmarkGemini 2.5 ProQwen3.7 Plus
LMArena Vision12631279
LMArena Document14211444
GeoBench86%—
VPCT48%—
SpatialViz-Bench44.7%—

Multilingual Too close to call

Gemini 2.5 Pro: 55.3 (#31), Qwen3.7 Plus: 54.8 (#38)

BenchmarkGemini 2.5 ProQwen3.7 Plus
LMArena Non-English14511445
LMArena Chinese15071510
LMArena French14721473
LMArena German14871471
LMArena Japanese14611413
LMArena Korean14341415
LMArena Russian14611457
LMArena Spanish14731457

Instruction Following Too close to call

Gemini 2.5 Pro: 75.0 (#75), Qwen3.7 Plus: 75.8 (#52)

BenchmarkGemini 2.5 ProQwen3.7 Plus
LMArena Instruction Following14371440
LiveBench Instruction Following80.6%—
IFEval84%—

Long Context Gemini 2.5 Pro leads

Gemini 2.5 Pro: 59.8 (#5), Qwen3.7 Plus: 44.5 (#65)

BenchmarkGemini 2.5 ProQwen3.7 Plus
LMArena Longer Query14491455
Fiction.LiveBench91.7%—

Writing & Preference Too close to call

Gemini 2.5 Pro: 63.7 (#62), Qwen3.7 Plus: 64.3 (#56)

BenchmarkGemini 2.5 ProQwen3.7 Plus
LMArena Text14581455
LMArena Creative Writing14541439
LMArena Multi-Turn14531460
Short-Story Creative Writing83.8%—
EQ-Bench Creative Writing1421—
WildBench85.7%—
LiveBench Language67.8%—

Frequently asked questions

Is Gemini 2.5 Pro better than Qwen3.7 Plus?

Gemini 2.5 Pro and Qwen3.7 Plus score almost the same on the Noometry Index (45.0 vs 45.3), so choose on price, context window or the category you care about most.

Which is cheaper, Gemini 2.5 Pro or Qwen3.7 Plus?

Qwen3.7 Plus is cheaper. It lists at $0.40 per million input tokens and $1.60 per million output tokens; Gemini 2.5 Pro lists at $1.25 and $10.

Is Gemini 2.5 Pro or Qwen3.7 Plus better for coding?

Gemini 2.5 Pro scores higher on coding benchmarks: 42.4 versus 36.6 in the Noometry coding category.

Which has the bigger context window?

Gemini 2.5 Pro does, with 1.05M tokens against 1M.

How many benchmarks do Gemini 2.5 Pro and Qwen3.7 Plus share?

28 benchmarks have published results for both models. Gemini 2.5 Pro has 78 scored results on Noometry and Qwen3.7 Plus has 32.

Related comparisons

Go deeper