Noometry

Model comparison

Gemini 3.1 Flash Lite vs Qwen3-4B

Gemini 3.1 Flash Lite is the stronger model overall, scoring 40.8 to 31.9 on the Noometry Index.

Last verified . 4 shared benchmarks.

Gemini 3.1 Flash Lite Google

40.8

Rank #144 Confirmed

Qwen3-4B Alibaba (Qwen)

31.9

Rank #264 Confirmed

Summary

  • They share 4 benchmarks with published results for both. Gemini 3.1 Flash Lite scores higher in 4 categories and Qwen3-4B in 0 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini 3.1 Flash Lite leads 40.7 to 29.7.
  • The biggest single-benchmark swing is GPQA Diamond: 81.8% for Gemini 3.1 Flash Lite and 52.3% for Qwen3-4B.
  • Qwen3-4B has downloadable open weights; the other is API-only.

Side by side

Gemini 3.1 Flash LiteQwen3-4B
ProviderGoogleAlibaba (Qwen)
Noometry Index40.831.9
Released2026-03-032025-04-29
WeightsProprietaryOpen
Context window1.05M—
Max output66K—
Input $ / M tokens$0.25—
Output $ / M tokens$1.50—
Results tracked386

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemini 3.1 Flash Lite: 37.8 (#188), Qwen3-4B: —

BenchmarkGemini 3.1 Flash LiteQwen3-4B
LMArena WebDev1256—
SciCode41.9%—
WeirdML52.2%—
LMArena Coding1400—
ALE-Bench797.73—

Agentic & Tool Use Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 30.2 (#79), Qwen3-4B: 27.6 (#100)

BenchmarkGemini 3.1 Flash LiteQwen3-4B
Berkeley Function Calling Leaderboard—35.7%
DeepResearch Bench37.3%—

Reasoning Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 22.9 (#186), Qwen3-4B: 19.2 (#268)

BenchmarkGemini 3.1 Flash LiteQwen3-4B
Chess Puzzles25%4%
Kagi LLM Benchmark67.2%—
NYT Connections (extended)8.2%—
CritPt1.1%—
EnigmaEval3%—
Thematic Generalization63.3%—
LMArena Hard Prompts1407—
DTBench76.8%—
LMCA35%—
Epoch Capabilities Index144.47—
ForecastBench54.4—

Math Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 40.7 (#90), Qwen3-4B: 29.7 (#240)

BenchmarkGemini 3.1 Flash LiteQwen3-4B
OTIS Mock AIME 2024-202580%52.2%
FrontierMath (Tiers 1-3)27.7%—
MathArena Final-Answer Competitions—38.5%
LMArena Math1428—

Knowledge Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 41.9 (#104), Qwen3-4B: 33.0 (#208)

BenchmarkGemini 3.1 Flash LiteQwen3-4B
GPQA Diamond81.8%52.3%
Vectara Hallucination Rate8.2%5.7%
Humanity's Last Exam8.6%—
LMArena Expert1398—

Multimodal Not comparable

Gemini 3.1 Flash Lite: 39.4 (#60), Qwen3-4B: —

BenchmarkGemini 3.1 Flash LiteQwen3-4B
LMArena Vision1240—

Multilingual Not comparable

Gemini 3.1 Flash Lite: 52.3 (#86), Qwen3-4B: —

BenchmarkGemini 3.1 Flash LiteQwen3-4B
LMArena Non-English1411—
LMArena Chinese1461—
LMArena French1424—
LMArena German1429—
LMArena Japanese1413—
LMArena Korean1392—
LMArena Russian1420—
LMArena Spanish1421—

Instruction Following Not comparable

Gemini 3.1 Flash Lite: 72.7 (#131), Qwen3-4B: —

BenchmarkGemini 3.1 Flash LiteQwen3-4B
LMArena Instruction Following1377—

Long Context Not comparable

Gemini 3.1 Flash Lite: 42.5 (#122), Qwen3-4B: —

BenchmarkGemini 3.1 Flash LiteQwen3-4B
LMArena Longer Query1394—

Writing & Preference Not comparable

Gemini 3.1 Flash Lite: 60.9 (#94), Qwen3-4B: —

BenchmarkGemini 3.1 Flash LiteQwen3-4B
LMArena Text1416—
LMArena Creative Writing1401—
LMArena Multi-Turn1417—

Frequently asked questions

Is Gemini 3.1 Flash Lite better than Qwen3-4B?

Gemini 3.1 Flash Lite is the stronger model overall, scoring 40.8 to 31.9 on the Noometry Index.

How many benchmarks do Gemini 3.1 Flash Lite and Qwen3-4B share?

4 benchmarks have published results for both models. Gemini 3.1 Flash Lite has 38 scored results on Noometry and Qwen3-4B has 6.

Related comparisons

Go deeper