Noometry

Model comparison

Gemini 2.0 Flash-Lite vs Grok-3 mini

Grok-3 mini is the stronger model overall, scoring 41.0 to 37.3 on the Noometry Index.

Last verified . 22 shared benchmarks.

Gemini 2.0 Flash-Lite Google

37.3

Rank #189 Confirmed

Grok-3 mini xAI

41.0

Rank #130 Confirmed

Summary

  • They share 22 benchmarks with published results for both. Gemini 2.0 Flash-Lite scores higher in 1 category and Grok-3 mini in 7 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Grok-3 mini leads 46.3 to 34.6.
  • The biggest single-benchmark swing is GPQA (HELM): 50% for Gemini 2.0 Flash-Lite and 67.5% for Grok-3 mini.

Side by side

Gemini 2.0 Flash-LiteGrok-3 mini
ProviderGooglexAI
Noometry Index37.341.0
Released2025-02-052025-04-09
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked3235

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok-3 mini leads

Gemini 2.0 Flash-Lite: 37.4 (#181), Grok-3 mini: 40.4 (#126)

BenchmarkGemini 2.0 Flash-LiteGrok-3 mini
LMArena Coding13221380
Aider Polyglot—49.3%
WeirdML—42.6%
LiveBench Coding47.1%—

Reasoning Gemini 2.0 Flash-Lite leads

Gemini 2.0 Flash-Lite: 21.2 (#203), Grok-3 mini: 13.8 (#323)

BenchmarkGemini 2.0 Flash-LiteGrok-3 mini
LMArena Hard Prompts13241374
ARC-AGI-2—0.4%
Kagi LLM Benchmark—61.3%
ARC-AGI-1—16.5%
LiveBench Reasoning50.1%—
DTBench52.5%—
LiveBench Data Analysis65.5%—
Epoch Capabilities Index—140.35
ForecastBench57.1—
LiveBench54.3%—

Math Grok-3 mini leads

Gemini 2.0 Flash-Lite: 31.8 (#192), Grok-3 mini: 40.3 (#78)

BenchmarkGemini 2.0 Flash-LiteGrok-3 mini
Omni-MATH37.4%31.8%
LMArena Math13091386
OTIS Mock AIME 2024-2025—77.8%
LiveBench Math58.1%—
MATH Level 5—90.9%
FrontierMath (Feb 2025 set)—5.9%

Knowledge Grok-3 mini leads

Gemini 2.0 Flash-Lite: 34.6 (#185), Grok-3 mini: 46.3 (#75)

BenchmarkGemini 2.0 Flash-LiteGrok-3 mini
MMLU-Pro72%79.9%
GPQA (HELM)50%67.5%
LMArena Expert13051395
GPQA Diamond—76.3%
Confabulations—10.8%

Multimodal Not comparable

Gemini 2.0 Flash-Lite: 30.6 (#103), Grok-3 mini: —

BenchmarkGemini 2.0 Flash-LiteGrok-3 mini
LMArena Vision1100—

Multilingual Grok-3 mini leads

Gemini 2.0 Flash-Lite: 46.2 (#156), Grok-3 mini: 48.3 (#141)

BenchmarkGemini 2.0 Flash-LiteGrok-3 mini
LMArena Non-English13231352
LMArena Chinese13391387
LMArena French13461357
LMArena German13061350
LMArena Japanese13021343
LMArena Korean13251336
LMArena Russian13281352
LMArena Spanish13131379

Instruction Following Grok-3 mini leads

Gemini 2.0 Flash-Lite: 70.6 (#158), Grok-3 mini: 78.7 (#8)

BenchmarkGemini 2.0 Flash-LiteGrok-3 mini
IFEval82.4%95.1%
LMArena Instruction Following13051356
LiveBench Instruction Following78.3%—

Long Context Too close to call

Gemini 2.0 Flash-Lite: 40.1 (#155), Grok-3 mini: 41.0 (#142)

BenchmarkGemini 2.0 Flash-LiteGrok-3 mini
LMArena Longer Query13211372
Fiction.LiveBench—66.7%

Writing & Preference Too close to call

Gemini 2.0 Flash-Lite: 51.9 (#172), Grok-3 mini: 52.7 (#163)

BenchmarkGemini 2.0 Flash-LiteGrok-3 mini
LMArena Text13301370
LMArena Creative Writing13191342
WildBench79%65.1%
LMArena Multi-Turn13071355
Short-Story Creative Writing—73.5%
LiveBench Language34.3%—

Frequently asked questions

Is Gemini 2.0 Flash-Lite better than Grok-3 mini?

Grok-3 mini is the stronger model overall, scoring 41.0 to 37.3 on the Noometry Index.

Is Gemini 2.0 Flash-Lite or Grok-3 mini better for coding?

Grok-3 mini scores higher on coding benchmarks: 40.4 versus 37.4 in the Noometry coding category.

How many benchmarks do Gemini 2.0 Flash-Lite and Grok-3 mini share?

22 benchmarks have published results for both models. Gemini 2.0 Flash-Lite has 32 scored results on Noometry and Grok-3 mini has 35.

Related comparisons

Go deeper