Noometry

Model comparison

Gemini 3.1 Flash Lite vs GLM-5.1

GLM-5.1 is the stronger model overall, scoring 47.8 to 40.8 on the Noometry Index. Gemini 3.1 Flash Lite costs 3.8× less per token, which makes it the better buy when GLM-5.1's lead doesn't matter for your workload.

Last verified . 29 shared benchmarks.

Gemini 3.1 Flash Lite Google

40.8

Rank #144 Confirmed

GLM-5.1 Z.ai (Zhipu)

47.8

Rank #59 Confirmed

Summary

  • They share 29 benchmarks with published results for both. Gemini 3.1 Flash Lite scores higher in 1 category and GLM-5.1 in 8 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where GLM-5.1 leads 39.1 to 22.9.
  • The biggest single-benchmark swing is NYT Connections (extended): 8.2% for Gemini 3.1 Flash Lite and 77.7% for GLM-5.1.
  • Gemini 3.1 Flash Lite is cheaper at $0.25 / $1.50 per million input/output tokens, against $1.40 / $4.40 for GLM-5.1.
  • Gemini 3.1 Flash Lite accepts more context: 1.05M tokens versus 200K.
  • GLM-5.1 has downloadable open weights; the other is API-only.

Side by side

Gemini 3.1 Flash LiteGLM-5.1
ProviderGoogleZ.ai (Zhipu)
Noometry Index40.847.8
Released2026-03-032026-04-07
WeightsProprietaryOpen
Context window1.05M200K
Max output66K131K
Input $ / M tokens$0.25$1.40
Output $ / M tokens$1.50$4.40
Results tracked3841

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-5.1 leads

Gemini 3.1 Flash Lite: 37.8 (#188), GLM-5.1: 48.7 (#55)

BenchmarkGemini 3.1 Flash LiteGLM-5.1
LMArena WebDev12561508
SciCode41.9%43.8%
WeirdML52.2%57.1%
LMArena Coding14001485
ALE-Bench797.73887.1
SWE-bench Verified—74.2%

Agentic & Tool Use Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 30.2 (#79), GLM-5.1: 24.9 (#113)

BenchmarkGemini 3.1 Flash LiteGLM-5.1
APEX-Agents—40.9%
DeepResearch Bench37.3%—
ExploitBench—18.1%
GBAEval—0%
Vending-Bench 2—5,634

Reasoning GLM-5.1 leads

Gemini 3.1 Flash Lite: 22.9 (#186), GLM-5.1: 39.1 (#60)

BenchmarkGemini 3.1 Flash LiteGLM-5.1
NYT Connections (extended)8.2%77.7%
CritPt1.1%4.6%
Chess Puzzles25%19%
Thematic Generalization63.3%69.8%
LMArena Hard Prompts14071472
Epoch Capabilities Index144.47149.84
SimpleBench—55.1%
Kagi LLM Benchmark67.2%—
EnigmaEval3%—
DTBench76.8%—
LMCA35%—
ForecastBench54.4—

Math GLM-5.1 leads

Gemini 3.1 Flash Lite: 40.7 (#90), GLM-5.1: 49.7 (#60)

BenchmarkGemini 3.1 Flash LiteGLM-5.1
FrontierMath (Tiers 1-3)27.7%36.8%
OTIS Mock AIME 2024-202580%93.3%
LMArena Math14281473
MathArena Final-Answer Competitions—67.1%
ProofBench—22.2%
FrontierMath (Feb 2025 set)—33.4%
FrontierMath Tier 4 (v1)—12.5%

Knowledge GLM-5.1 leads

Gemini 3.1 Flash Lite: 41.9 (#104), GLM-5.1: 54.9 (#50)

BenchmarkGemini 3.1 Flash LiteGLM-5.1
GPQA Diamond81.8%89.9%
LMArena Expert13981476
Humanity's Last Exam8.6%—
SimpleQA Verified—34%
Vectara Hallucination Rate8.2%—

Multimodal Not comparable

Gemini 3.1 Flash Lite: 39.4 (#60), GLM-5.1: —

BenchmarkGemini 3.1 Flash LiteGLM-5.1
LMArena Vision1240—

Multilingual GLM-5.1 leads

Gemini 3.1 Flash Lite: 52.3 (#86), GLM-5.1: 55.0 (#36)

BenchmarkGemini 3.1 Flash LiteGLM-5.1
LMArena Non-English14111447
LMArena Chinese14611515
LMArena French14241474
LMArena German14291465
LMArena Japanese14131434
LMArena Korean13921418
LMArena Russian14201454
LMArena Spanish14211469

Instruction Following GLM-5.1 leads

Gemini 3.1 Flash Lite: 72.7 (#131), GLM-5.1: 76.3 (#42)

BenchmarkGemini 3.1 Flash LiteGLM-5.1
LMArena Instruction Following13771451

Long Context GLM-5.1 leads

Gemini 3.1 Flash Lite: 42.5 (#122), GLM-5.1: 44.9 (#53)

BenchmarkGemini 3.1 Flash LiteGLM-5.1
LMArena Longer Query13941466

Writing & Preference GLM-5.1 leads

Gemini 3.1 Flash Lite: 60.9 (#94), GLM-5.1: 66.9 (#31)

BenchmarkGemini 3.1 Flash LiteGLM-5.1
LMArena Text14161461
LMArena Creative Writing14011453
LMArena Multi-Turn14171472
EQ-Bench Creative Writing—1592

Frequently asked questions

Is Gemini 3.1 Flash Lite better than GLM-5.1?

GLM-5.1 is the stronger model overall, scoring 47.8 to 40.8 on the Noometry Index. Gemini 3.1 Flash Lite costs 3.8× less per token, which makes it the better buy when GLM-5.1's lead doesn't matter for your workload.

Which is cheaper, Gemini 3.1 Flash Lite or GLM-5.1?

Gemini 3.1 Flash Lite is cheaper. It lists at $0.25 per million input tokens and $1.50 per million output tokens; GLM-5.1 lists at $1.40 and $4.40.

Is Gemini 3.1 Flash Lite or GLM-5.1 better for coding?

GLM-5.1 scores higher on coding benchmarks: 48.7 versus 37.8 in the Noometry coding category.

Which has the bigger context window?

Gemini 3.1 Flash Lite does, with 1.05M tokens against 200K.

How many benchmarks do Gemini 3.1 Flash Lite and GLM-5.1 share?

29 benchmarks have published results for both models. Gemini 3.1 Flash Lite has 38 scored results on Noometry and GLM-5.1 has 41.

Related comparisons

Go deeper