Model comparison

Gemini 3 Pro vs GPT-4 Turbo

Gemini 3 Pro is the stronger model overall, scoring 54.8 to 30.5 on the Noometry Index.

Last verified . 26 shared benchmarks.

Gemini 3 Pro Google

54.8

Rank #28 Confirmed

GPT-4 Turbo OpenAI

30.5

Rank #292 Confirmed

Summary

  • They share 26 benchmarks with published results for both. Gemini 3 Pro scores higher in 9 categories and GPT-4 Turbo in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini 3 Pro leads 49.9 to 9.0.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 91.4% for Gemini 3 Pro and 6.7% for GPT-4 Turbo.

Side by side

Gemini 3 Pro and GPT-4 Turbo specifications
Gemini 3 ProGPT-4 Turbo
ProviderGoogleOpenAI
Noometry Index54.830.5
Released2025-11-182023-11-06
WeightsProprietaryProprietary
Context window—128K
Max output—4K
Input $ / M tokens—$10
Output $ / M tokens—$30
Results tracked6736

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3 Pro leads

Gemini 3 Pro: 51.6 (#39), GPT-4 Turbo: 33.8 (#249)

Coding benchmarks
BenchmarkGemini 3 ProGPT-4 Turbo
WeirdML69.9%18%
LMArena Coding14811268
SWE-bench Verified72.9%—
SWE-bench Verified (bash only)74.2%—
LMArena WebDev1440—
SWE-bench Multilingual68.7%—
GSO18.6%—
BigCodeBench Instruct—48.2%
BigCodeBench Complete—58.2%
ALE-Bench1,177—
AlgoTune1.83—
HumanEval+—86.6%
MBPP+—73.3%

Agentic & Tool Use Not comparable

Gemini 3 Pro: 40.6 (#23), GPT-4 Turbo: —

Agentic & Tool Use benchmarks
BenchmarkGemini 3 ProGPT-4 Turbo
METR Time Horizons71%36.7%
Terminal-Bench69.4%—
Berkeley Function Calling Leaderboard72.5%—
GDPval40.3%—
Remote Labor Index1.3%—
τ²-bench Airline80.5%—
τ²-bench Banking18%—
τ²-bench Retail75.9%—
τ²-bench Telecom91%—
DeepResearch Bench46.3%—
BALROG58.1%—
LMArena Search1207—
Vending-Bench 25,478—

Reasoning Gemini 3 Pro leads

Gemini 3 Pro: 52.5 (#31), GPT-4 Turbo: 15.3 (#317)

Reasoning benchmarks
BenchmarkGemini 3 ProGPT-4 Turbo
SimpleBench76.4%25.1%
Chess Puzzles31%6%
LMArena Hard Prompts14801251
Epoch Capabilities Index152.92127.25
ForecastBench61.259.4
ARC-AGI-231.1%—
Kagi LLM Benchmark80.1%—
NYT Connections (extended)94.4%—
ARC-AGI-175%—
CritPt6.9%—
EnigmaEval18.2%—
DTBench—61.6%
LMCA—9.8%

Math Gemini 3 Pro leads

Gemini 3 Pro: 49.9 (#59), GPT-4 Turbo: 9.0 (#322)

Knowledge Gemini 3 Pro leads

Gemini 3 Pro: 64.4 (#16), GPT-4 Turbo: 24.3 (#268)

Knowledge benchmarks
BenchmarkGemini 3 ProGPT-4 Turbo
GPQA Diamond92.6%46.6%
LMArena Expert14751223
Humanity's Last Exam37.5%—
MMLU-Pro90.3%—
Confabulations—28.4%
Vectara Hallucination Rate13.6%—
GPQA (HELM)80.3%—
MMLU—81.3%

Multimodal Gemini 3 Pro leads

Gemini 3 Pro: 57.6 (#2), GPT-4 Turbo: 30.6 (#110)

Multimodal benchmarks
BenchmarkGemini 3 ProGPT-4 Turbo
LMArena Vision13051090
GeoBench84%—
VPCT91%—
LMArena Document1434—

Multilingual Gemini 3 Pro leads

Gemini 3 Pro: 56.9 (#16), GPT-4 Turbo: 40.5 (#216)

Multilingual benchmarks
BenchmarkGemini 3 ProGPT-4 Turbo
LMArena Non-English14741245
LMArena Chinese15231242
LMArena French14921276
LMArena German15151259
LMArena Japanese15101194
LMArena Korean14481187
LMArena Russian14931259
LMArena Spanish14701260

Instruction Following Gemini 3 Pro leads

Gemini 3 Pro: 76.3 (#45), GPT-4 Turbo: 65.8 (#216)

Instruction Following benchmarks
BenchmarkGemini 3 ProGPT-4 Turbo
LMArena Instruction Following14581249
IFEval87.7%—

Long Context Gemini 3 Pro leads

Gemini 3 Pro: 44.0 (#79), GPT-4 Turbo: 38.0 (#206)

Long Context benchmarks
BenchmarkGemini 3 ProGPT-4 Turbo
LMArena Longer Query14711254
CL-bench15.8%—

Writing & Preference Gemini 3 Pro leads

Gemini 3 Pro: 66.4 (#35), GPT-4 Turbo: 47.7 (#206)

Writing & Preference benchmarks
BenchmarkGemini 3 ProGPT-4 Turbo
LMArena Text14791272
LMArena Creative Writing14821269
LMArena Multi-Turn14841267
EQ-Bench Creative Writing1525—
WildBench85.9%—

Frequently asked questions

Is Gemini 3 Pro better than GPT-4 Turbo?

Gemini 3 Pro is the stronger model overall, scoring 54.8 to 30.5 on the Noometry Index.

Is Gemini 3 Pro or GPT-4 Turbo better for coding?

Gemini 3 Pro scores higher on coding benchmarks: 51.6 versus 33.8 in the Noometry coding category.

How many benchmarks do Gemini 3 Pro and GPT-4 Turbo share?

26 benchmarks have published results for both models. Gemini 3 Pro has 67 scored results on Noometry and GPT-4 Turbo has 36.

Related comparisons

Go deeper