Noometry

Model comparison

Gemini 2.5 Flash vs Grok 4.1

Grok 4.1 is the stronger model overall, scoring 40.8 to 39.0 on the Noometry Index.

Last verified . 17 shared benchmarks.

Gemini 2.5 Flash Google

39.0

Rank #162 Confirmed

Grok 4.1 xAI

40.8

Rank #135 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Gemini 2.5 Flash scores higher in 4 categories and Grok 4.1 in 5 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.1 leads 28.3 to 18.2.

Side by side

Gemini 2.5 FlashGrok 4.1
ProviderGooglexAI
Noometry Index39.040.8
Released2025-04-172025-11-17
WeightsProprietaryProprietary
Context window1.05M—
Max output66K—
Input $ / M tokens$0.30—
Output $ / M tokens$2.50—
Results tracked5419

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.5 Flash leads

Gemini 2.5 Flash: 35.5 (#210), Grok 4.1: 33.4 (#246)

BenchmarkGemini 2.5 FlashGrok 4.1
LMArena Coding14241445
SWE-bench Verified (bash only)28.7%—
Aider Polyglot55.1%—
LMArena WebDev—1214
WeirdML41.9%—
ALE-Bench661.88—

Agentic & Tool Use Grok 4.1 leads

Gemini 2.5 Flash: 30.6 (#67), Grok 4.1: 33.8 (#47)

BenchmarkGemini 2.5 FlashGrok 4.1
Terminal-Bench17.1%—
Berkeley Function Calling Leaderboard56.2%—
TheAgentCompany41.1%—
Cybench—39%
BALROG33.5%—
Vending-Bench 2548.84—

Reasoning Grok 4.1 leads

Gemini 2.5 Flash: 18.2 (#271), Grok 4.1: 28.3 (#91)

BenchmarkGemini 2.5 FlashGrok 4.1
LMArena Hard Prompts14221436
ARC-AGI-22.5%—
SimpleBench41.2%—
Kagi LLM Benchmark56.8%—
ARC-AGI-133.3%—
CritPt1.1%—
EnigmaEval2.7%—
DTBench76.5%—
LMCA27.5%—
Epoch Capabilities Index143.04—
ForecastBench60.6—

Math Gemini 2.5 Flash leads

Gemini 2.5 Flash: 38.1 (#87), Grok 4.1: 36.2 (#124)

BenchmarkGemini 2.5 FlashGrok 4.1
LMArena Math14151422
OTIS Mock AIME 2024-202573.1%—
Omni-MATH38.5%—
FrontierMath (Feb 2025 set)4.8%—
FrontierMath Tier 4 (v1)4.2%—

Knowledge Grok 4.1 leads

Gemini 2.5 Flash: 36.1 (#162), Grok 4.1: 38.9 (#129)

BenchmarkGemini 2.5 FlashGrok 4.1
LMArena Expert14261417
Humanity's Last Exam12.1%—
MMLU-Pro63.9%—
Confabulations16.8%—
Vectara Hallucination Rate7.8%—
GPQA (HELM)39%—

Multimodal Not comparable

Gemini 2.5 Flash: 41.2 (#31), Grok 4.1: —

BenchmarkGemini 2.5 FlashGrok 4.1
LMArena Vision1254—
GeoBench76%—
VPCT46.2%—
SpatialViz-Bench36.9%—

Multilingual Grok 4.1 leads

Gemini 2.5 Flash: 52.5 (#83), Grok 4.1: 53.6 (#64)

BenchmarkGemini 2.5 FlashGrok 4.1
LMArena Non-English14101425
LMArena Chinese14501464
LMArena French14331448
LMArena German14191447
LMArena Japanese14031396
LMArena Korean13851407
LMArena Russian14151434
LMArena Spanish14211438

Instruction Following Gemini 2.5 Flash leads

Gemini 2.5 Flash: 75.9 (#50), Grok 4.1: 74.0 (#106)

BenchmarkGemini 2.5 FlashGrok 4.1
LMArena Instruction Following14051400
IFEval89.8%—

Long Context Gemini 2.5 Flash leads

Gemini 2.5 Flash: 47.5 (#16), Grok 4.1: 43.2 (#96)

BenchmarkGemini 2.5 FlashGrok 4.1
LMArena Longer Query14191416
Fiction.LiveBench77.8%—

Writing & Preference Grok 4.1 leads

Gemini 2.5 Flash: 54.0 (#153), Grok 4.1: 62.6 (#71)

BenchmarkGemini 2.5 FlashGrok 4.1
LMArena Text14171437
LMArena Creative Writing14001411
LMArena Multi-Turn14081438
Short-Story Creative Writing76.5%—
EQ-Bench Creative Writing1137—
WildBench81.7%—

Frequently asked questions

Is Gemini 2.5 Flash better than Grok 4.1?

Grok 4.1 is the stronger model overall, scoring 40.8 to 39.0 on the Noometry Index.

Is Gemini 2.5 Flash or Grok 4.1 better for coding?

Gemini 2.5 Flash scores higher on coding benchmarks: 35.5 versus 33.4 in the Noometry coding category.

How many benchmarks do Gemini 2.5 Flash and Grok 4.1 share?

17 benchmarks have published results for both models. Gemini 2.5 Flash has 54 scored results on Noometry and Grok 4.1 has 19.

Related comparisons

Go deeper