Noometry

Model comparison

Gemini 3.7 Flash vs Grok 4

Gemini 3.7 Flash is the stronger model overall, scoring 59.8 to 48.1 on the Noometry Index.

Last verified . 24 shared benchmarks.

Gemini 3.7 Flash Google

59.8

Rank #14 Confirmed

Grok 4 xAI

48.1

Rank #56 Confirmed

Summary

  • They share 24 benchmarks with published results for both. Gemini 3.7 Flash scores higher in 8 categories and Grok 4 in 2 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3.7 Flash leads 70.0 to 36.7.
  • The biggest single-benchmark swing is ARC-AGI-2: 84.6% for Gemini 3.7 Flash and 16% for Grok 4.

Side by side

Gemini 3.7 FlashGrok 4
ProviderGooglexAI
Noometry Index59.848.1
Released2026-08-132025-07-09
WeightsProprietaryProprietary
Context window1.05M—
Max output66K—
Input $ / M tokens$0.75—
Output $ / M tokens$3.75—
Results tracked4448

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.7 Flash leads

Gemini 3.7 Flash: 56.2 (#22), Grok 4: 50.3 (#46)

BenchmarkGemini 3.7 FlashGrok 4
LMArena Coding14971408
DeepSWE65.5%—
FrontierCode43.6%—
Aider Polyglot—79.6%
LMArena WebDev1592—
FrontierSWE20.3%—
SciCode59.8%—
WeirdML—45.7%
ALE-Bench904.3—

Agentic & Tool Use Gemini 3.7 Flash leads

Gemini 3.7 Flash: 42.1 (#19), Grok 4: 32.3 (#68)

BenchmarkGemini 3.7 FlashGrok 4
Terminal-Bench—27.2%
APEX-Agents67.8%—
Berkeley Function Calling Leaderboard—63%
GDPval—21.1%
Remote Labor Index5%—
Cybench—43%
DeepResearch Bench—47.3%
BALROG—43.6%
GDP.pdf23.8%—
LMArena Search—1142
METR Time Horizons—66.6%

Reasoning Gemini 3.7 Flash leads

Gemini 3.7 Flash: 70.0 (#15), Grok 4: 36.7 (#65)

BenchmarkGemini 3.7 FlashGrok 4
ARC-AGI-284.6%16%
ARC-AGI-195.5%66.7%
Chess Puzzles47%28%
LMArena Hard Prompts14941409
Epoch Capabilities Index157.27146.44
SimpleBench—60.5%
Kagi LLM Benchmark—73.6%
NYT Connections (extended)94%—
CritPt14.3%—
Mystery Game Puzzles37%—
DTBench96.8%—
LMCA50.4%—
ForecastBench—60.9

Math Gemini 3.7 Flash leads

Gemini 3.7 Flash: 69.6 (#23), Grok 4: 48.4 (#64)

BenchmarkGemini 3.7 FlashGrok 4
OTIS Mock AIME 2024-202597.2%84%
LMArena Math15071422
FrontierMath (Tiers 1-3)71.6%—
FrontierMath Tier 436.6%—
ProofBench58%—
Omni-MATH—60.3%
FrontierMath (Feb 2025 set)—19.7%
FrontierMath Tier 4 (v1)—2.1%

Knowledge Gemini 3.7 Flash leads

Gemini 3.7 Flash: 69.7 (#5), Grok 4: 53.8 (#55)

BenchmarkGemini 3.7 FlashGrok 4
GPQA Diamond94.8%87%
LMArena Expert15081415
SimpleQA Verified69.2%—
MMLU-Pro—85.1%
Confabulations—12.4%
GPQA (HELM)—72.7%

Multimodal Gemini 3.7 Flash leads

Gemini 3.7 Flash: 37.3 (#73), Grok 4: 33.7 (#94)

BenchmarkGemini 3.7 FlashGrok 4
LMArena Vision13161210
GeoBench—45%
Furniture Assembly26.7%—

Multilingual Gemini 3.7 Flash leads

Gemini 3.7 Flash: 57.6 (#7), Grok 4: 51.8 (#103)

BenchmarkGemini 3.7 FlashGrok 4
LMArena Non-English14841403
LMArena Chinese15481427
LMArena French15051418
LMArena German14981429
LMArena Japanese15121394
LMArena Korean14831377
LMArena Russian15161410
LMArena Spanish15031420

Instruction Following Grok 4 leads

Gemini 3.7 Flash: 77.7 (#15), Grok 4: 79.2 (#5)

BenchmarkGemini 3.7 FlashGrok 4
LMArena Instruction Following14831387
IFEval—94.9%

Long Context Grok 4 leads

Gemini 3.7 Flash: 45.7 (#30), Grok 4: 63.1 (#4)

BenchmarkGemini 3.7 FlashGrok 4
LMArena Longer Query14921409
Fiction.LiveBench—94.4%

Writing & Preference Gemini 3.7 Flash leads

Gemini 3.7 Flash: 71.2 (#20), Grok 4: 58.5 (#116)

BenchmarkGemini 3.7 FlashGrok 4
LMArena Text14861411
LMArena Creative Writing14901397
LMArena Multi-Turn14891416
Short-Story Creative Writing—76.9%
EQ-Bench Creative Writing1723—
WildBench—79.7%

Frequently asked questions

Is Gemini 3.7 Flash better than Grok 4?

Gemini 3.7 Flash is the stronger model overall, scoring 59.8 to 48.1 on the Noometry Index.

Is Gemini 3.7 Flash or Grok 4 better for coding?

Gemini 3.7 Flash scores higher on coding benchmarks: 56.2 versus 50.3 in the Noometry coding category.

How many benchmarks do Gemini 3.7 Flash and Grok 4 share?

24 benchmarks have published results for both models. Gemini 3.7 Flash has 44 scored results on Noometry and Grok 4 has 48.

Related comparisons

Go deeper