Noometry

Model comparison

Gemini 3.7 Flash vs Grok 4.20 Multi-Agent

Gemini 3.7 Flash is the stronger model overall, scoring 59.8 to 46.2 on the Noometry Index.

Last verified . 19 shared benchmarks.

Gemini 3.7 Flash Google

59.8

Rank #14 Confirmed

Grok 4.20 Multi-Agent xAI

46.2

Rank #65 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Gemini 3.7 Flash scores higher in 8 categories and Grok 4.20 Multi-Agent in 1 category; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini 3.7 Flash leads 69.6 to 39.4.
  • Both cost about the same: $0.75 input and $3.75 output per million tokens.
  • Gemini 3.7 Flash accepts more context: 1.05M tokens versus 1M.

Side by side

Gemini 3.7 FlashGrok 4.20 Multi-Agent
ProviderGooglexAI
Noometry Index59.846.2
Released2026-08-132026-03-09
WeightsProprietaryProprietary
Context window1.05M1M
Max output66K30K
Input $ / M tokens$0.75$1.25
Output $ / M tokens$3.75$2.50
Results tracked4420

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.7 Flash leads

Gemini 3.7 Flash: 56.2 (#22), Grok 4.20 Multi-Agent: 43.0 (#92)

BenchmarkGemini 3.7 FlashGrok 4.20 Multi-Agent
LMArena Coding14971457
DeepSWE65.5%—
FrontierCode43.6%—
LMArena WebDev1592—
FrontierSWE20.3%—
SciCode59.8%—
ALE-Bench904.3—

Agentic & Tool Use Not comparable

Gemini 3.7 Flash: 42.1 (#19), Grok 4.20 Multi-Agent: —

BenchmarkGemini 3.7 FlashGrok 4.20 Multi-Agent
APEX-Agents67.8%—
Remote Labor Index5%—
GDP.pdf23.8%—
LMArena Search—1204

Reasoning Gemini 3.7 Flash leads

Gemini 3.7 Flash: 70.0 (#15), Grok 4.20 Multi-Agent: 43.9 (#48)

BenchmarkGemini 3.7 FlashGrok 4.20 Multi-Agent
NYT Connections (extended)94%89.6%
LMArena Hard Prompts14941448
ARC-AGI-284.6%—
ARC-AGI-195.5%—
CritPt14.3%—
Chess Puzzles47%—
Mystery Game Puzzles37%—
DTBench96.8%—
LMCA50.4%—
Epoch Capabilities Index157.27—

Math Gemini 3.7 Flash leads

Gemini 3.7 Flash: 69.6 (#23), Grok 4.20 Multi-Agent: 39.4 (#104)

BenchmarkGemini 3.7 FlashGrok 4.20 Multi-Agent
LMArena Math15071442
FrontierMath (Tiers 1-3)71.6%—
FrontierMath Tier 436.6%—
OTIS Mock AIME 2024-202597.2%—
ProofBench58%—

Knowledge Gemini 3.7 Flash leads

Gemini 3.7 Flash: 69.7 (#5), Grok 4.20 Multi-Agent: 40.4 (#119)

BenchmarkGemini 3.7 FlashGrok 4.20 Multi-Agent
LMArena Expert15081445
GPQA Diamond94.8%—
SimpleQA Verified69.2%—

Multimodal Grok 4.20 Multi-Agent leads

Gemini 3.7 Flash: 37.3 (#73), Grok 4.20 Multi-Agent: 40.5 (#48)

BenchmarkGemini 3.7 FlashGrok 4.20 Multi-Agent
LMArena Vision13161259
Furniture Assembly26.7%—

Multilingual Gemini 3.7 Flash leads

Gemini 3.7 Flash: 57.6 (#7), Grok 4.20 Multi-Agent: 54.4 (#43)

BenchmarkGemini 3.7 FlashGrok 4.20 Multi-Agent
LMArena Non-English14841440
LMArena Chinese15481475
LMArena French15051466
LMArena German14981456
LMArena Japanese15121405
LMArena Korean14831416
LMArena Russian15161457
LMArena Spanish15031447

Instruction Following Gemini 3.7 Flash leads

Gemini 3.7 Flash: 77.7 (#15), Grok 4.20 Multi-Agent: 74.8 (#84)

BenchmarkGemini 3.7 FlashGrok 4.20 Multi-Agent
LMArena Instruction Following14831420

Long Context Gemini 3.7 Flash leads

Gemini 3.7 Flash: 45.7 (#30), Grok 4.20 Multi-Agent: 43.7 (#88)

BenchmarkGemini 3.7 FlashGrok 4.20 Multi-Agent
LMArena Longer Query14921431

Writing & Preference Gemini 3.7 Flash leads

Gemini 3.7 Flash: 71.2 (#20), Grok 4.20 Multi-Agent: 64.0 (#59)

BenchmarkGemini 3.7 FlashGrok 4.20 Multi-Agent
LMArena Text14861450
LMArena Creative Writing14901436
LMArena Multi-Turn14891452
EQ-Bench Creative Writing1723—

Frequently asked questions

Is Gemini 3.7 Flash better than Grok 4.20 Multi-Agent?

Gemini 3.7 Flash is the stronger model overall, scoring 59.8 to 46.2 on the Noometry Index.

Which is cheaper, Gemini 3.7 Flash or Grok 4.20 Multi-Agent?

Gemini 3.7 Flash is cheaper. It lists at $0.75 per million input tokens and $3.75 per million output tokens; Grok 4.20 Multi-Agent lists at $1.25 and $2.50.

Is Gemini 3.7 Flash or Grok 4.20 Multi-Agent better for coding?

Gemini 3.7 Flash scores higher on coding benchmarks: 56.2 versus 43.0 in the Noometry coding category.

Which has the bigger context window?

Gemini 3.7 Flash does, with 1.05M tokens against 1M.

How many benchmarks do Gemini 3.7 Flash and Grok 4.20 Multi-Agent share?

19 benchmarks have published results for both models. Gemini 3.7 Flash has 44 scored results on Noometry and Grok 4.20 Multi-Agent has 20.

Related comparisons

Go deeper