Noometry

Model comparison

Gemini 2.5 Flash-Lite vs Grok-3 mini

Grok-3 mini is the stronger model overall, scoring 41.0 to 36.4 on the Noometry Index.

Last verified . 26 shared benchmarks.

Gemini 2.5 Flash-Lite Google

36.4

Rank #208 Confirmed

Grok-3 mini xAI

41.0

Rank #130 Confirmed

Summary

  • They share 26 benchmarks with published results for both. Gemini 2.5 Flash-Lite scores higher in 3 categories and Grok-3 mini in 5 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Grok-3 mini leads 46.3 to 32.1.
  • The biggest single-benchmark swing is GPQA (HELM): 30.9% for Gemini 2.5 Flash-Lite and 67.5% for Grok-3 mini.

Side by side

Gemini 2.5 Flash-LiteGrok-3 mini
ProviderGooglexAI
Noometry Index36.441.0
Released2025-06-172025-04-09
WeightsProprietaryProprietary
Context window1.05M—
Max output66K—
Input $ / M tokens$0.10—
Output $ / M tokens$0.40—
Results tracked3335

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok-3 mini leads

Gemini 2.5 Flash-Lite: 38.0 (#167), Grok-3 mini: 40.4 (#126)

BenchmarkGemini 2.5 Flash-LiteGrok-3 mini
WeirdML35.2%42.6%
LMArena Coding13731380
Aider Polyglot—49.3%
ALE-Bench325.9—

Agentic & Tool Use Not comparable

Gemini 2.5 Flash-Lite: 27.8 (#89), Grok-3 mini: —

BenchmarkGemini 2.5 Flash-LiteGrok-3 mini
Berkeley Function Calling Leaderboard36.9%—

Reasoning Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 21.5 (#196), Grok-3 mini: 13.8 (#323)

BenchmarkGemini 2.5 Flash-LiteGrok-3 mini
Kagi LLM Benchmark40.5%61.3%
LMArena Hard Prompts13771374
Epoch Capabilities Index133.93140.35
ARC-AGI-2—0.4%
ARC-AGI-1—16.5%
DTBench62.8%—
LMCA18.1%—

Math Grok-3 mini leads

Gemini 2.5 Flash-Lite: 35.5 (#144), Grok-3 mini: 40.3 (#78)

BenchmarkGemini 2.5 Flash-LiteGrok-3 mini
Omni-MATH48%31.8%
LMArena Math13731386
OTIS Mock AIME 2024-2025—77.8%
MATH Level 5—90.9%
FrontierMath (Feb 2025 set)—5.9%

Knowledge Grok-3 mini leads

Gemini 2.5 Flash-Lite: 32.1 (#206), Grok-3 mini: 46.3 (#75)

BenchmarkGemini 2.5 Flash-LiteGrok-3 mini
MMLU-Pro53.7%79.9%
GPQA (HELM)30.9%67.5%
LMArena Expert13731395
GPQA Diamond—76.3%
Confabulations—10.8%
Vectara Hallucination Rate3.3%—

Multimodal Not comparable

Gemini 2.5 Flash-Lite: 28.6 (#109), Grok-3 mini: —

BenchmarkGemini 2.5 Flash-LiteGrok-3 mini
LMArena Vision1198—
VPCT30%—

Multilingual Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 49.5 (#129), Grok-3 mini: 48.3 (#141)

BenchmarkGemini 2.5 Flash-LiteGrok-3 mini
LMArena Non-English13691352
LMArena Chinese14041387
LMArena French13881357
LMArena German13901350
LMArena Japanese13591343
LMArena Korean13581336
LMArena Russian13731352
LMArena Spanish13961379

Instruction Following Grok-3 mini leads

Gemini 2.5 Flash-Lite: 70.2 (#163), Grok-3 mini: 78.7 (#8)

BenchmarkGemini 2.5 Flash-LiteGrok-3 mini
IFEval81%95.1%
LMArena Instruction Following13661356

Long Context Grok-3 mini leads

Gemini 2.5 Flash-Lite: 33.3 (#257), Grok-3 mini: 41.0 (#142)

BenchmarkGemini 2.5 Flash-LiteGrok-3 mini
Fiction.LiveBench47.2%66.7%
LMArena Longer Query13731372

Writing & Preference Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 57.0 (#130), Grok-3 mini: 52.7 (#163)

BenchmarkGemini 2.5 Flash-LiteGrok-3 mini
LMArena Text13791370
LMArena Creative Writing13661342
WildBench81.8%65.1%
LMArena Multi-Turn13671355
Short-Story Creative Writing—73.5%

Frequently asked questions

Is Gemini 2.5 Flash-Lite better than Grok-3 mini?

Grok-3 mini is the stronger model overall, scoring 41.0 to 36.4 on the Noometry Index.

Is Gemini 2.5 Flash-Lite or Grok-3 mini better for coding?

Grok-3 mini scores higher on coding benchmarks: 40.4 versus 38.0 in the Noometry coding category.

How many benchmarks do Gemini 2.5 Flash-Lite and Grok-3 mini share?

26 benchmarks have published results for both models. Gemini 2.5 Flash-Lite has 33 scored results on Noometry and Grok-3 mini has 35.

Related comparisons

Go deeper