Model comparison

Gemini 3 Pro vs Grok 3

Gemini 3 Pro is the stronger model overall, scoring 54.8 to 39.9 on the Noometry Index.

Last verified . 35 shared benchmarks.

Gemini 3 Pro Google

54.8

Rank #28 Confirmed

Grok 3 xAI

39.9

Rank #157 Confirmed

Summary

  • They share 35 benchmarks with published results for both. Gemini 3 Pro scores higher in 9 categories and Grok 3 in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3 Pro leads 52.5 to 13.7.
  • The biggest single-benchmark swing is ARC-AGI-1: 75% for Gemini 3 Pro and 5.5% for Grok 3.

Side by side

Gemini 3 Pro and Grok 3 specifications
Gemini 3 ProGrok 3
ProviderGooglexAI
Noometry Index54.839.9
Released2025-11-182025-04-09
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked6740

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3 Pro leads

Gemini 3 Pro: 51.6 (#39), Grok 3: 41.9 (#115)

Coding benchmarks
BenchmarkGemini 3 ProGrok 3
WeirdML69.9%37.2%
LMArena Coding14811432
SWE-bench Verified72.9%—
SWE-bench Verified (bash only)74.2%—
Aider Polyglot—53.3%
LMArena WebDev1440—
SWE-bench Multilingual68.7%—
GSO18.6%—
ALE-Bench1,177—
AlgoTune1.83—

Agentic & Tool Use Gemini 3 Pro leads

Gemini 3 Pro: 40.6 (#23), Grok 3: 30.5 (#76)

Agentic & Tool Use benchmarks
BenchmarkGemini 3 ProGrok 3
BALROG58.1%29.5%
Terminal-Bench69.4%—
Berkeley Function Calling Leaderboard72.5%—
GDPval40.3%—
Remote Labor Index1.3%—
τ²-bench Airline80.5%—
τ²-bench Banking18%—
τ²-bench Retail75.9%—
τ²-bench Telecom91%—
DeepResearch Bench46.3%—
LMArena Search1207—
METR Time Horizons71%—
Vending-Bench 25,478—

Reasoning Gemini 3 Pro leads

Gemini 3 Pro: 52.5 (#31), Grok 3: 13.7 (#333)

Reasoning benchmarks
BenchmarkGemini 3 ProGrok 3
ARC-AGI-231.1%0%
SimpleBench76.4%36.1%
Kagi LLM Benchmark80.1%61.3%
ARC-AGI-175%5.5%
LMArena Hard Prompts14801434
Epoch Capabilities Index152.92138.33
NYT Connections (extended)94.4%—
CritPt6.9%—
Chess Puzzles31%—
EnigmaEval18.2%—
ForecastBench61.2—

Math Gemini 3 Pro leads

Gemini 3 Pro: 49.9 (#59), Grok 3: 38.0 (#145)

Math benchmarks
BenchmarkGemini 3 ProGrok 3
OTIS Mock AIME 2024-202591.4%55.6%
Omni-MATH55.5%46.4%
LMArena Math14761391
FrontierMath (Feb 2025 set)37.6%3.8%
FrontierMath Tier 4 (v1)18.8%0%
MathArena Final-Answer Competitions67%—
ProofBench20%—
MATH Level 5—88.7%

Knowledge Gemini 3 Pro leads

Gemini 3 Pro: 64.4 (#16), Grok 3: 46.2 (#82)

Knowledge benchmarks
BenchmarkGemini 3 ProGrok 3
GPQA Diamond92.6%75.8%
MMLU-Pro90.3%78.8%
Vectara Hallucination Rate13.6%5.8%
GPQA (HELM)80.3%65%
LMArena Expert14751421
Humanity's Last Exam37.5%—
Confabulations—14.2%

Multimodal Not comparable

Gemini 3 Pro: 57.6 (#2), Grok 3: —

Multimodal benchmarks
BenchmarkGemini 3 ProGrok 3
LMArena Vision1305—
GeoBench84%—
VPCT91%—
LMArena Document1434—

Multilingual Gemini 3 Pro leads

Gemini 3 Pro: 56.9 (#16), Grok 3: 52.3 (#87)

Multilingual benchmarks
BenchmarkGemini 3 ProGrok 3
LMArena Non-English14741410
LMArena Chinese15231448
LMArena French14921460
LMArena German15151431
LMArena Japanese15101387
LMArena Korean14481373
LMArena Russian14931416
LMArena Spanish14701417

Instruction Following Gemini 3 Pro leads

Gemini 3 Pro: 76.3 (#45), Grok 3: 75.0 (#73)

Instruction Following benchmarks
BenchmarkGemini 3 ProGrok 3
IFEval87.7%88.4%
LMArena Instruction Following14581409

Long Context Gemini 3 Pro leads

Gemini 3 Pro: 44.0 (#79), Grok 3: 38.7 (#192)

Long Context benchmarks
BenchmarkGemini 3 ProGrok 3
LMArena Longer Query14711439
Fiction.LiveBench—58.3%
CL-bench15.8%—

Writing & Preference Gemini 3 Pro leads

Gemini 3 Pro: 66.4 (#35), Grok 3: 55.8 (#141)

Writing & Preference benchmarks
BenchmarkGemini 3 ProGrok 3
LMArena Text14791426
LMArena Creative Writing14821414
EQ-Bench Creative Writing15251186
WildBench85.9%84.9%
LMArena Multi-Turn14841425
Short-Story Creative Writing—76.4%

Frequently asked questions

Is Gemini 3 Pro better than Grok 3?

Gemini 3 Pro is the stronger model overall, scoring 54.8 to 39.9 on the Noometry Index.

Is Gemini 3 Pro or Grok 3 better for coding?

Gemini 3 Pro scores higher on coding benchmarks: 51.6 versus 41.9 in the Noometry coding category.

How many benchmarks do Gemini 3 Pro and Grok 3 share?

35 benchmarks have published results for both models. Gemini 3 Pro has 67 scored results on Noometry and Grok 3 has 40.

Related comparisons

Go deeper