Noometry

Model comparison

Gemini 3.5 Flash vs Grok 4.1

Gemini 3.5 Flash is the stronger model overall, scoring 54.1 to 40.8 on the Noometry Index.

Last verified . 18 shared benchmarks.

Gemini 3.5 Flash Google

54.1

Rank #29 Confirmed

Grok 4.1 xAI

40.8

Rank #135 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Gemini 3.5 Flash scores higher in 8 categories and Grok 4.1 in 1 category; 9 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3.5 Flash leads 62.7 to 28.3.

Side by side

Gemini 3.5 FlashGrok 4.1
ProviderGooglexAI
Noometry Index54.140.8
Released2026-05-192025-11-17
WeightsProprietaryProprietary
Context window1.05M—
Max output66K—
Input $ / M tokens$1.50—
Output $ / M tokens$9—
Results tracked5419

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.5 Flash leads

Gemini 3.5 Flash: 49.1 (#46), Grok 4.1: 33.4 (#246)

BenchmarkGemini 3.5 FlashGrok 4.1
LMArena WebDev14991214
LMArena Coding14921445
SWE-bench Verified79.3%—
DeepSWE37.4%—
SciCode53.1%—
WeirdML62.6%—
ALE-Bench911.02—

Agentic & Tool Use Grok 4.1 leads

Gemini 3.5 Flash: 24.8 (#107), Grok 4.1: 33.8 (#47)

BenchmarkGemini 3.5 FlashGrok 4.1
APEX-Agents27.5%—
Cybench—39%
GBAEval6.7%—
GDP.pdf14%—
Vending-Bench 25,396—

Reasoning Gemini 3.5 Flash leads

Gemini 3.5 Flash: 62.7 (#16), Grok 4.1: 28.3 (#91)

BenchmarkGemini 3.5 FlashGrok 4.1
LMArena Hard Prompts14881436
ARC-AGI-272.1%—
SimpleBench76.7%—
NYT Connections (extended)92.6%—
ARC-AGI-192.5%—
CritPt13.1%—
Chess Puzzles50%—
EnigmaEval25.4%—
EBR-Bench4.8%—
Mystery Game Puzzles32%—
DTBench94.7%—
LMCA47.1%—
Surface Evolver Bench58.1%—
Epoch Capabilities Index154.55—
ForecastBench59—

Math Gemini 3.5 Flash leads

Gemini 3.5 Flash: 60.5 (#30), Grok 4.1: 36.2 (#124)

BenchmarkGemini 3.5 FlashGrok 4.1
LMArena Math15021422
FrontierMath (Tiers 1-3)62.8%—
FrontierMath Tier 426.8%—
MathArena Final-Answer Competitions76.3%—
OTIS Mock AIME 2024-202595.6%—
ProofBench31%—
FrontierMath (Feb 2025 set)39%—
FrontierMath Tier 4 (v1)14.6%—

Knowledge Gemini 3.5 Flash leads

Gemini 3.5 Flash: 66.3 (#10), Grok 4.1: 38.9 (#129)

BenchmarkGemini 3.5 FlashGrok 4.1
LMArena Expert14931417
GPQA Diamond92.8%—
SimpleQA Verified66.2%—

Multimodal Not comparable

Gemini 3.5 Flash: 45.7 (#13), Grok 4.1: —

BenchmarkGemini 3.5 FlashGrok 4.1
LMArena Vision1311—
Blueprint-Bench 233.6%—
LMArena Document1463—

Multilingual Gemini 3.5 Flash leads

Gemini 3.5 Flash: 57.1 (#12), Grok 4.1: 53.6 (#64)

BenchmarkGemini 3.5 FlashGrok 4.1
LMArena Non-English14751425
LMArena Chinese15251464
LMArena French14901448
LMArena German15001447
LMArena Japanese14811396
LMArena Korean14531407
LMArena Russian14911434
LMArena Spanish14781438

Instruction Following Gemini 3.5 Flash leads

Gemini 3.5 Flash: 77.2 (#29), Grok 4.1: 74.0 (#106)

BenchmarkGemini 3.5 FlashGrok 4.1
LMArena Instruction Following14661400

Long Context Gemini 3.5 Flash leads

Gemini 3.5 Flash: 45.3 (#39), Grok 4.1: 43.2 (#96)

BenchmarkGemini 3.5 FlashGrok 4.1
LMArena Longer Query14811416

Writing & Preference Gemini 3.5 Flash leads

Gemini 3.5 Flash: 65.5 (#46), Grok 4.1: 62.6 (#71)

BenchmarkGemini 3.5 FlashGrok 4.1
LMArena Text14811437
LMArena Creative Writing14671411
LMArena Multi-Turn14821438
EQ-Bench 41087—

Frequently asked questions

Is Gemini 3.5 Flash better than Grok 4.1?

Gemini 3.5 Flash is the stronger model overall, scoring 54.1 to 40.8 on the Noometry Index.

Is Gemini 3.5 Flash or Grok 4.1 better for coding?

Gemini 3.5 Flash scores higher on coding benchmarks: 49.1 versus 33.4 in the Noometry coding category.

How many benchmarks do Gemini 3.5 Flash and Grok 4.1 share?

18 benchmarks have published results for both models. Gemini 3.5 Flash has 54 scored results on Noometry and Grok 4.1 has 19.

Related comparisons

Go deeper