Model comparison

Gemini 3 Pro vs Qwen2.5 72B Instruct

Gemini 3 Pro is the stronger model overall, scoring 54.7 to 31.5 on the Noometry Index.

Last verified . 29 shared benchmarks.

Gemini 3 Pro Google

54.7

Rank #23 Confirmed

Qwen2.5 72B Instruct Alibaba (Qwen)

31.5

Rank #259 Confirmed

Summary

  • They share 29 benchmarks with published results for both. Gemini 3 Pro scores higher in 9 categories and Qwen2.5 72B Instruct in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Gemini 3 Pro leads 64.3 to 26.9.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 91.4% for Gemini 3 Pro and 8.1% for Qwen2.5 72B Instruct.
  • Qwen2.5 72B Instruct has downloadable open weights; the other is API-only.

Side by side

Gemini 3 Pro and Qwen2.5 72B Instruct specifications
Gemini 3 ProQwen2.5 72B Instruct
ProviderGoogleAlibaba (Qwen)
Noometry Index54.731.5
Released2025-11-182024-09
WeightsProprietaryOpen
Context window—131K
Max output—8K
Input $ / M tokens—$1.40
Output $ / M tokens—$5.60
Results tracked6743

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3 Pro leads

Gemini 3 Pro: 52.1 (#33), Qwen2.5 72B Instruct: 32.8 (#256)

Coding benchmarks
BenchmarkGemini 3 ProQwen2.5 72B Instruct
WeirdML69.9%16%
LMArena Coding14821293
SWE-bench Verified72.9%—
SWE-bench Verified (bash only)74.2%—
LMArena WebDev1439—
SWE-bench Multilingual68.7%—
GSO18.6%—
BigCodeBench Instruct—45.8%
BigCodeBench Complete—55.9%
ALE-Bench1,177—
AlgoTune1.83—

Agentic & Tool Use Gemini 3 Pro leads

Gemini 3 Pro: 40.5 (#21), Qwen2.5 72B Instruct: 22.0 (#124)

Agentic & Tool Use benchmarks
BenchmarkGemini 3 ProQwen2.5 72B Instruct
BALROG58.1%16.2%
METR Time Horizons71%35.8%
Terminal-Bench69.4%—
Berkeley Function Calling Leaderboard72.5%—
GDPval40.3%—
Remote Labor Index1.3%—
TheAgentCompany—5.7%
τ²-bench Airline80.5%—
τ²-bench Banking18%—
τ²-bench Retail75.9%—
τ²-bench Telecom91%—
DeepResearch Bench46.3%—
LMArena Search1207—
Vending-Bench 25,478—

Reasoning Gemini 3 Pro leads

Gemini 3 Pro: 52.5 (#28), Qwen2.5 72B Instruct: 21.4 (#197)

Reasoning benchmarks
BenchmarkGemini 3 ProQwen2.5 72B Instruct
LMArena Hard Prompts14811271
Epoch Capabilities Index152.96129.01
ForecastBench61.257.5
ARC-AGI-231.1%—
SimpleBench76.4%—
Kagi LLM Benchmark80.1%—
NYT Connections (extended)94.4%—
ARC-AGI-175%—
CritPt6.9%—
Chess Puzzles31%—
EnigmaEval18.2%—
DTBench—62.9%
LMCA—13.4%
BIG-Bench Hard—79.8%
HellaSwag—84.8%
PIQA—82.6%
WinoGrande—82.3%

Math Gemini 3 Pro leads

Gemini 3 Pro: 48.8 (#50), Qwen2.5 72B Instruct: 18.1 (#281)

Math benchmarks
BenchmarkGemini 3 ProQwen2.5 72B Instruct
OTIS Mock AIME 2024-202591.4%8.1%
Omni-MATH55.5%33%
LMArena Math14751283
MathArena Final-Answer Competitions67%—
ProofBench20%—
MATH Level 5—63.2%
FrontierMath (Feb 2025 set)37.6%—
FrontierMath Tier 4 (v1)18.8%—

Knowledge Gemini 3 Pro leads

Gemini 3 Pro: 64.3 (#15), Qwen2.5 72B Instruct: 26.9 (#247)

Knowledge benchmarks
BenchmarkGemini 3 ProQwen2.5 72B Instruct
GPQA Diamond92.6%49.1%
MMLU-Pro90.3%63.1%
GPQA (HELM)80.3%42.6%
LMArena Expert14751245
Humanity's Last Exam37.5%—
Confabulations—19.1%
Vectara Hallucination Rate13.6%—
ARC (AI2) Challenge—94.5%
MMLU—85.3%
TriviaQA—71.9%

Multimodal Not comparable

Gemini 3 Pro: 56.9 (#1), Qwen2.5 72B Instruct: —

Multimodal benchmarks
BenchmarkGemini 3 ProQwen2.5 72B Instruct
LMArena Vision1305—
GeoBench84%—
VPCT91%—
LMArena Document1434—

Multilingual Gemini 3 Pro leads

Gemini 3 Pro: 57.1 (#14), Qwen2.5 72B Instruct: 41.2 (#208)

Multilingual benchmarks
BenchmarkGemini 3 ProQwen2.5 72B Instruct
LMArena Non-English14741252
LMArena Chinese15221272
LMArena French14921279
LMArena German15171234
LMArena Japanese15131180
LMArena Korean14491188
LMArena Russian14931264
LMArena Spanish14681255

Instruction Following Gemini 3 Pro leads

Gemini 3 Pro: 76.4 (#42), Qwen2.5 72B Instruct: 65.7 (#216)

Instruction Following benchmarks
BenchmarkGemini 3 ProQwen2.5 72B Instruct
IFEval87.7%80.6%
LMArena Instruction Following14581254

Long Context Gemini 3 Pro leads

Gemini 3 Pro: 44.0 (#75), Qwen2.5 72B Instruct: 38.9 (#183)

Long Context benchmarks
BenchmarkGemini 3 ProQwen2.5 72B Instruct
LMArena Longer Query14721282
CL-bench15.8%—

Writing & Preference Gemini 3 Pro leads

Gemini 3 Pro: 66.6 (#34), Qwen2.5 72B Instruct: 46.9 (#210)

Writing & Preference benchmarks
BenchmarkGemini 3 ProQwen2.5 72B Instruct
LMArena Text14791269
LMArena Creative Writing14821221
WildBench85.9%80.2%
LMArena Multi-Turn14841272
EQ-Bench Creative Writing1525—

Frequently asked questions

Is Gemini 3 Pro better than Qwen2.5 72B Instruct?

Gemini 3 Pro is the stronger model overall, scoring 54.7 to 31.5 on the Noometry Index.

Is Gemini 3 Pro or Qwen2.5 72B Instruct better for coding?

Gemini 3 Pro scores higher on coding benchmarks: 52.1 versus 32.8 in the Noometry coding category.

How many benchmarks do Gemini 3 Pro and Qwen2.5 72B Instruct share?

29 benchmarks have published results for both models. Gemini 3 Pro has 67 scored results on Noometry and Qwen2.5 72B Instruct has 43.

Related comparisons

Go deeper