Noometry

Model comparison

Gemini 3.1 Pro Preview vs Grok 4.20 Multi-Agent

Gemini 3.1 Pro Preview is the stronger model overall, scoring 56.7 to 46.2 on the Noometry Index. Grok 4.20 Multi-Agent costs 2.9× less per token, which makes it the better buy when Gemini 3.1 Pro Preview's lead doesn't matter for your workload.

Last verified . 20 shared benchmarks.

Gemini 3.1 Pro Preview Google

56.7

Rank #23 Confirmed

Grok 4.20 Multi-Agent xAI

46.2

Rank #65 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Gemini 3.1 Pro Preview scores higher in 7 categories and Grok 4.20 Multi-Agent in 2 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Gemini 3.1 Pro Preview leads 71.8 to 40.4.
  • The biggest single-benchmark swing is NYT Connections (extended): 97.4% for Gemini 3.1 Pro Preview and 89.6% for Grok 4.20 Multi-Agent.
  • Grok 4.20 Multi-Agent is cheaper at $1.25 / $2.50 per million input/output tokens, against $2 / $12 for Gemini 3.1 Pro Preview.
  • Gemini 3.1 Pro Preview accepts more context: 1.05M tokens versus 1M.

Side by side

Gemini 3.1 Pro PreviewGrok 4.20 Multi-Agent
ProviderGooglexAI
Noometry Index56.746.2
Released2026-02-192026-03-09
WeightsProprietaryProprietary
Context window1.05M1M
Max output66K30K
Input $ / M tokens$2$1.25
Output $ / M tokens$12$2.50
Results tracked7120

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Gemini 3.1 Pro Preview: 42.5 (#99), Grok 4.20 Multi-Agent: 43.0 (#92)

BenchmarkGemini 3.1 Pro PreviewGrok 4.20 Multi-Agent
LMArena Coding14841457
SWE-bench Verified75.6%—
DeepSWE11.7%—
LMArena WebDev1447—
SciCode58.9%—
GSO22.6%—
WeirdML72.1%—
MirrorCode8.9%—
ALE-Bench1,161—
AlgoTune2.02—

Agentic & Tool Use Not comparable

Gemini 3.1 Pro Preview: 37.7 (#34), Grok 4.20 Multi-Agent: —

BenchmarkGemini 3.1 Pro PreviewGrok 4.20 Multi-Agent
LMArena Search12111204
Terminal-Bench80.2%—
APEX-Agents35.3%—
τ²-bench Banking26%—
DeepResearch Bench47.8%—
PostTrainBench22%—
BALROG57%—
ExploitBench26.1%—
GBAEval0.8%—
GDP.pdf17%—
METR Time Horizons77%—
Vending-Bench 23,774—

Reasoning Gemini 3.1 Pro Preview leads

Gemini 3.1 Pro Preview: 71.7 (#12), Grok 4.20 Multi-Agent: 43.9 (#48)

BenchmarkGemini 3.1 Pro PreviewGrok 4.20 Multi-Agent
NYT Connections (extended)97.4%89.6%
LMArena Hard Prompts14851448
ARC-AGI-277.1%—
SimpleBench79.6%—
ARC-AGI-198%—
CritPt17.7%—
Chess Puzzles55%—
EnigmaEval36.8%—
Thematic Generalization79.4%—
EBR-Bench14.3%—
Mystery Game Puzzles34%—
DTBench97.1%—
LMCA53.8%—
Epoch Capabilities Index154.77—
ForecastBench59—

Math Gemini 3.1 Pro Preview leads

Gemini 3.1 Pro Preview: 62.1 (#34), Grok 4.20 Multi-Agent: 39.4 (#104)

BenchmarkGemini 3.1 Pro PreviewGrok 4.20 Multi-Agent
LMArena Math14851442
FrontierMath (Tiers 1-3)59.6%—
FrontierMath Tier 426.8%—
MathArena Final-Answer Competitions86.5%—
OTIS Mock AIME 2024-202595.6%—
ProofBench26%—
FrontierMath (Feb 2025 set)36.9%—
FrontierMath Tier 4 (v1)16.7%—

Knowledge Gemini 3.1 Pro Preview leads

Gemini 3.1 Pro Preview: 71.8 (#3), Grok 4.20 Multi-Agent: 40.4 (#119)

BenchmarkGemini 3.1 Pro PreviewGrok 4.20 Multi-Agent
LMArena Expert14851445
GPQA Diamond94.4%—
Humanity's Last Exam46.4%—
SimpleQA Verified73.5%—
Vectara Hallucination Rate10.4%—

Multimodal Grok 4.20 Multi-Agent leads

Gemini 3.1 Pro Preview: 37.9 (#69), Grok 4.20 Multi-Agent: 40.5 (#48)

BenchmarkGemini 3.1 Pro PreviewGrok 4.20 Multi-Agent
LMArena Vision12961259
Blueprint-Bench 226.5%—
Furniture Assembly26.7%—
LMArena Document1444—

Multilingual Gemini 3.1 Pro Preview leads

Gemini 3.1 Pro Preview: 57.0 (#12), Grok 4.20 Multi-Agent: 54.4 (#43)

BenchmarkGemini 3.1 Pro PreviewGrok 4.20 Multi-Agent
LMArena Non-English14771440
LMArena Chinese15291475
LMArena French14871466
LMArena German14911456
LMArena Japanese14931405
LMArena Korean14551416
LMArena Russian14981457
LMArena Spanish14791447

Instruction Following Gemini 3.1 Pro Preview leads

Gemini 3.1 Pro Preview: 77.0 (#32), Grok 4.20 Multi-Agent: 74.8 (#84)

BenchmarkGemini 3.1 Pro PreviewGrok 4.20 Multi-Agent
LMArena Instruction Following14661420

Long Context Gemini 3.1 Pro Preview leads

Gemini 3.1 Pro Preview: 47.4 (#18), Grok 4.20 Multi-Agent: 43.7 (#88)

BenchmarkGemini 3.1 Pro PreviewGrok 4.20 Multi-Agent
LMArena Longer Query14831431
CL-bench20.8%—
CL-bench Life16.9%—

Writing & Preference Gemini 3.1 Pro Preview leads

Gemini 3.1 Pro Preview: 66.1 (#37), Grok 4.20 Multi-Agent: 64.0 (#59)

BenchmarkGemini 3.1 Pro PreviewGrok 4.20 Multi-Agent
LMArena Text14811450
LMArena Creative Writing14821436
LMArena Multi-Turn14881452
EQ-Bench Creative Writing1491—
EQ-Bench 41142—

Frequently asked questions

Is Gemini 3.1 Pro Preview better than Grok 4.20 Multi-Agent?

Gemini 3.1 Pro Preview is the stronger model overall, scoring 56.7 to 46.2 on the Noometry Index. Grok 4.20 Multi-Agent costs 2.9× less per token, which makes it the better buy when Gemini 3.1 Pro Preview's lead doesn't matter for your workload.

Which is cheaper, Gemini 3.1 Pro Preview or Grok 4.20 Multi-Agent?

Grok 4.20 Multi-Agent is cheaper. It lists at $1.25 per million input tokens and $2.50 per million output tokens; Gemini 3.1 Pro Preview lists at $2 and $12.

Is Gemini 3.1 Pro Preview or Grok 4.20 Multi-Agent better for coding?

They score almost the same on coding (42.5 vs 43.0); test both on your own repository before choosing.

Which has the bigger context window?

Gemini 3.1 Pro Preview does, with 1.05M tokens against 1M.

How many benchmarks do Gemini 3.1 Pro Preview and Grok 4.20 Multi-Agent share?

20 benchmarks have published results for both models. Gemini 3.1 Pro Preview has 71 scored results on Noometry and Grok 4.20 Multi-Agent has 20.

Related comparisons

Go deeper