Noometry

Model comparison

Gemini 3.8 Flash vs Grok 4.20 Multi-Agent

Gemini 3.8 Flash is the stronger model overall, scoring 61.8 to 46.2 on the Noometry Index.

Last verified . 19 shared benchmarks.

Gemini 3.8 Flash Google

61.8

Rank #11 Confirmed

Grok 4.20 Multi-Agent xAI

46.2

Rank #65 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Gemini 3.8 Flash scores higher in 9 categories and Grok 4.20 Multi-Agent in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Gemini 3.8 Flash leads 74.8 to 40.4.
  • The biggest single-benchmark swing is NYT Connections (extended): 97.4% for Gemini 3.8 Flash and 89.6% for Grok 4.20 Multi-Agent.
  • Both cost about the same: $0.75 input and $3.75 output per million tokens.
  • Gemini 3.8 Flash accepts more context: 1.05M tokens versus 1M.

Side by side

Gemini 3.8 FlashGrok 4.20 Multi-Agent
ProviderGooglexAI
Noometry Index61.846.2
Released2026-09-022026-03-09
WeightsProprietaryProprietary
Context window1.05M1M
Max output66K30K
Input $ / M tokens$0.75$1.25
Output $ / M tokens$3.75$2.50
Results tracked5020

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.8 Flash leads

Gemini 3.8 Flash: 59.2 (#15), Grok 4.20 Multi-Agent: 43.0 (#92)

BenchmarkGemini 3.8 FlashGrok 4.20 Multi-Agent
LMArena Coding15101457
DeepSWE73.8%—
FrontierCode41.2%—
CursorBench39.6%—
LMArena WebDev1584—
FrontierSWE19.6%—
SciCode56.6%—
WeirdML84.8%—
ALE-Bench1,270—

Agentic & Tool Use Not comparable

Gemini 3.8 Flash: 41.8 (#21), Grok 4.20 Multi-Agent: —

BenchmarkGemini 3.8 FlashGrok 4.20 Multi-Agent
APEX-Agents64.3%—
Remote Labor Index5.8%—
GDP.pdf23.4%—
LMArena Search—1204
Vending-Bench 25,094—

Reasoning Gemini 3.8 Flash leads

Gemini 3.8 Flash: 76.9 (#5), Grok 4.20 Multi-Agent: 43.9 (#48)

BenchmarkGemini 3.8 FlashGrok 4.20 Multi-Agent
NYT Connections (extended)97.4%89.6%
LMArena Hard Prompts15081448
ARC-AGI-289.2%—
ARC-AGI-198.5%—
CritPt18.3%—
Chess Puzzles61%—
Mystery Game Puzzles47%—
DTBench95.7%—
LMCA52.9%—
Surface Evolver Bench76.9%—
Epoch Capabilities Index156.71—

Math Gemini 3.8 Flash leads

Gemini 3.8 Flash: 65.3 (#28), Grok 4.20 Multi-Agent: 39.4 (#104)

BenchmarkGemini 3.8 FlashGrok 4.20 Multi-Agent
LMArena Math15281442
FrontierMath (Tiers 1-3)68.4%—
FrontierMath Tier 422%—
OTIS Mock AIME 2024-202598.9%—
ProofBench48%—

Knowledge Gemini 3.8 Flash leads

Gemini 3.8 Flash: 74.8 (#2), Grok 4.20 Multi-Agent: 40.4 (#119)

BenchmarkGemini 3.8 FlashGrok 4.20 Multi-Agent
LMArena Expert15241445
GPQA Diamond95.4%—
Humanity's Last Exam44.5%—
SimpleQA Verified69.7%—

Multimodal Too close to call

Gemini 3.8 Flash: 40.7 (#45), Grok 4.20 Multi-Agent: 40.5 (#48)

BenchmarkGemini 3.8 FlashGrok 4.20 Multi-Agent
LMArena Vision13141259
Blueprint-Bench 238.6%—
Furniture Assembly31.7%—

Multilingual Gemini 3.8 Flash leads

Gemini 3.8 Flash: 58.0 (#5), Grok 4.20 Multi-Agent: 54.4 (#43)

BenchmarkGemini 3.8 FlashGrok 4.20 Multi-Agent
LMArena Non-English14911440
LMArena Chinese15541475
LMArena French14981466
LMArena German14931456
LMArena Japanese15021405
LMArena Korean14591416
LMArena Russian15151457
LMArena Spanish14851447

Instruction Following Gemini 3.8 Flash leads

Gemini 3.8 Flash: 78.0 (#13), Grok 4.20 Multi-Agent: 74.8 (#84)

BenchmarkGemini 3.8 FlashGrok 4.20 Multi-Agent
LMArena Instruction Following14901420

Long Context Gemini 3.8 Flash leads

Gemini 3.8 Flash: 46.3 (#24), Grok 4.20 Multi-Agent: 43.7 (#88)

BenchmarkGemini 3.8 FlashGrok 4.20 Multi-Agent
LMArena Longer Query15081431

Writing & Preference Gemini 3.8 Flash leads

Gemini 3.8 Flash: 72.2 (#15), Grok 4.20 Multi-Agent: 64.0 (#59)

BenchmarkGemini 3.8 FlashGrok 4.20 Multi-Agent
LMArena Text14991450
LMArena Creative Writing14921436
LMArena Multi-Turn15011452
EQ-Bench Creative Writing1748—

Frequently asked questions

Is Gemini 3.8 Flash better than Grok 4.20 Multi-Agent?

Gemini 3.8 Flash is the stronger model overall, scoring 61.8 to 46.2 on the Noometry Index.

Which is cheaper, Gemini 3.8 Flash or Grok 4.20 Multi-Agent?

Gemini 3.8 Flash is cheaper. It lists at $0.75 per million input tokens and $3.75 per million output tokens; Grok 4.20 Multi-Agent lists at $1.25 and $2.50.

Is Gemini 3.8 Flash or Grok 4.20 Multi-Agent better for coding?

Gemini 3.8 Flash scores higher on coding benchmarks: 59.2 versus 43.0 in the Noometry coding category.

Which has the bigger context window?

Gemini 3.8 Flash does, with 1.05M tokens against 1M.

How many benchmarks do Gemini 3.8 Flash and Grok 4.20 Multi-Agent share?

19 benchmarks have published results for both models. Gemini 3.8 Flash has 50 scored results on Noometry and Grok 4.20 Multi-Agent has 20.

Related comparisons

Go deeper