Noometry

Model comparison

Gemini 2.5 Flash-Lite vs GPT-4.1 mini

Gemini 2.5 Flash-Lite is the stronger model overall, scoring 36.4 to 33.5 on the Noometry Index.

Last verified . 30 shared benchmarks.

Gemini 2.5 Flash-Lite Google

36.4

Rank #208 Confirmed

GPT-4.1 mini OpenAI

33.5

Rank #232 Confirmed

Summary

  • They share 30 benchmarks with published results for both. Gemini 2.5 Flash-Lite scores higher in 6 categories and GPT-4.1 mini in 4 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini 2.5 Flash-Lite leads 35.5 to 23.1.
  • The biggest single-benchmark swing is GPQA (HELM): 30.9% for Gemini 2.5 Flash-Lite and 61.4% for GPT-4.1 mini.
  • Gemini 2.5 Flash-Lite is cheaper at $0.10 / $0.40 per million input/output tokens, against $0.40 / $1.60 for GPT-4.1 mini.
  • Gemini 2.5 Flash-Lite accepts more context: 1.05M tokens versus 1.05M.

Side by side

Gemini 2.5 Flash-LiteGPT-4.1 mini
ProviderGoogleOpenAI
Noometry Index36.433.5
Released2025-06-172025-04-14
WeightsProprietaryProprietary
Context window1.05M1.05M
Max output66K33K
Input $ / M tokens$0.10$0.40
Output $ / M tokens$0.40$1.60
Results tracked3347

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 38.0 (#167), GPT-4.1 mini: 30.4 (#286)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 mini
WeirdML35.2%37.6%
LMArena Coding13731367
SWE-bench Verified (bash only)—23.9%
Aider Polyglot—32.4%
SciCode—40.4%
BigCodeBench Instruct—48.9%
CadEval—16%
ALE-Bench325.9—

Agentic & Tool Use GPT-4.1 mini leads

Gemini 2.5 Flash-Lite: 27.8 (#89), GPT-4.1 mini: 33.0 (#52)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 mini
Berkeley Function Calling Leaderboard36.9%50.5%

Reasoning Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 21.5 (#196), GPT-4.1 mini: 10.9 (#335)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 mini
Kagi LLM Benchmark40.5%48.6%
LMArena Hard Prompts13771349
DTBench62.8%68.8%
LMCA18.1%21.1%
Epoch Capabilities Index133.93135.01
ARC-AGI-2—0%
ARC-AGI-1—3.5%
CritPt—0%
Chess Puzzles—7%
Mystery Game Puzzles—7%

Math Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 35.5 (#144), GPT-4.1 mini: 23.1 (#264)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 mini
Omni-MATH48%49.1%
LMArena Math13731343
FrontierMath (Tiers 1-3)—6.7%
OTIS Mock AIME 2024-2025—44.7%
MATH Level 5—87.3%
FrontierMath (Feb 2025 set)—4.5%

Knowledge GPT-4.1 mini leads

Gemini 2.5 Flash-Lite: 32.1 (#206), GPT-4.1 mini: 34.7 (#183)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 mini
MMLU-Pro53.7%78.3%
GPQA (HELM)30.9%61.4%
LMArena Expert13731338
GPQA Diamond—65.8%
SimpleQA Verified—12.7%
Vectara Hallucination Rate3.3%—

Multimodal GPT-4.1 mini leads

Gemini 2.5 Flash-Lite: 28.6 (#109), GPT-4.1 mini: 35.2 (#77)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 mini
LMArena Vision11981181
VPCT30%—

Multilingual Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 49.5 (#129), GPT-4.1 mini: 45.9 (#161)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 mini
LMArena Non-English13691318
LMArena Chinese14041329
LMArena French13881357
LMArena German13901349
LMArena Japanese13591291
LMArena Korean13581298
LMArena Russian13731324
LMArena Spanish13961319

Instruction Following GPT-4.1 mini leads

Gemini 2.5 Flash-Lite: 70.2 (#163), GPT-4.1 mini: 73.9 (#113)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 mini
IFEval81%90.4%
LMArena Instruction Following13661332

Long Context Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 33.3 (#257), GPT-4.1 mini: 31.8 (#270)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 mini
Fiction.LiveBench47.2%44.4%
LMArena Longer Query13731344

Writing & Preference Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 57.0 (#130), GPT-4.1 mini: 48.8 (#193)

BenchmarkGemini 2.5 Flash-LiteGPT-4.1 mini
LMArena Text13791341
LMArena Creative Writing13661300
WildBench81.8%83.8%
LMArena Multi-Turn13671354
EQ-Bench Creative Writing—1147

Frequently asked questions

Is Gemini 2.5 Flash-Lite better than GPT-4.1 mini?

Gemini 2.5 Flash-Lite is the stronger model overall, scoring 36.4 to 33.5 on the Noometry Index.

Which is cheaper, Gemini 2.5 Flash-Lite or GPT-4.1 mini?

Gemini 2.5 Flash-Lite is cheaper. It lists at $0.10 per million input tokens and $0.40 per million output tokens; GPT-4.1 mini lists at $0.40 and $1.60.

Is Gemini 2.5 Flash-Lite or GPT-4.1 mini better for coding?

Gemini 2.5 Flash-Lite scores higher on coding benchmarks: 38.0 versus 30.4 in the Noometry coding category.

Which has the bigger context window?

Gemini 2.5 Flash-Lite does, with 1.05M tokens against 1.05M.

How many benchmarks do Gemini 2.5 Flash-Lite and GPT-4.1 mini share?

30 benchmarks have published results for both models. Gemini 2.5 Flash-Lite has 33 scored results on Noometry and GPT-4.1 mini has 47.

Related comparisons

Go deeper