Noometry

Model comparison

Gemini 3.8 Flash vs GLM-5.1

Gemini 3.8 Flash is the stronger model overall, scoring 61.8 to 47.8 on the Noometry Index.

Last verified . 33 shared benchmarks.

Gemini 3.8 Flash Google

61.8

Rank #11 Confirmed

GLM-5.1 Z.ai (Zhipu)

47.8

Rank #59 Confirmed

Summary

  • They share 33 benchmarks with published results for both. Gemini 3.8 Flash scores higher in 9 categories and GLM-5.1 in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3.8 Flash leads 76.9 to 39.1.
  • The biggest single-benchmark swing is Chess Puzzles: 61% for Gemini 3.8 Flash and 19% for GLM-5.1.
  • Gemini 3.8 Flash is cheaper at $0.75 / $3.75 per million input/output tokens, against $1.40 / $4.40 for GLM-5.1.
  • Gemini 3.8 Flash accepts more context: 1.05M tokens versus 200K.
  • GLM-5.1 has downloadable open weights; the other is API-only.

Side by side

Gemini 3.8 FlashGLM-5.1
ProviderGoogleZ.ai (Zhipu)
Noometry Index61.847.8
Released2026-09-022026-04-07
WeightsProprietaryOpen
Context window1.05M200K
Max output66K131K
Input $ / M tokens$0.75$1.40
Output $ / M tokens$3.75$4.40
Results tracked5041

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.8 Flash leads

Gemini 3.8 Flash: 59.2 (#15), GLM-5.1: 48.7 (#55)

BenchmarkGemini 3.8 FlashGLM-5.1
LMArena WebDev15841508
SciCode56.6%43.8%
WeirdML84.8%57.1%
LMArena Coding15101485
ALE-Bench1,270887.1
SWE-bench Verified—74.2%
DeepSWE73.8%—
FrontierCode41.2%—
CursorBench39.6%—
FrontierSWE19.6%—

Agentic & Tool Use Gemini 3.8 Flash leads

Gemini 3.8 Flash: 41.8 (#21), GLM-5.1: 24.9 (#113)

BenchmarkGemini 3.8 FlashGLM-5.1
APEX-Agents64.3%40.9%
Vending-Bench 25,0945,634
Remote Labor Index5.8%—
ExploitBench—18.1%
GBAEval—0%
GDP.pdf23.4%—

Reasoning Gemini 3.8 Flash leads

Gemini 3.8 Flash: 76.9 (#5), GLM-5.1: 39.1 (#60)

BenchmarkGemini 3.8 FlashGLM-5.1
NYT Connections (extended)97.4%77.7%
CritPt18.3%4.6%
Chess Puzzles61%19%
LMArena Hard Prompts15081472
Epoch Capabilities Index156.71149.84
ARC-AGI-289.2%—
SimpleBench—55.1%
ARC-AGI-198.5%—
Thematic Generalization—69.8%
Mystery Game Puzzles47%—
DTBench95.7%—
LMCA52.9%—
Surface Evolver Bench76.9%—

Math Gemini 3.8 Flash leads

Gemini 3.8 Flash: 65.3 (#28), GLM-5.1: 49.7 (#60)

BenchmarkGemini 3.8 FlashGLM-5.1
FrontierMath (Tiers 1-3)68.4%36.8%
OTIS Mock AIME 2024-202598.9%93.3%
ProofBench48%22.2%
LMArena Math15281473
FrontierMath Tier 422%—
MathArena Final-Answer Competitions—67.1%
FrontierMath (Feb 2025 set)—33.4%
FrontierMath Tier 4 (v1)—12.5%

Knowledge Gemini 3.8 Flash leads

Gemini 3.8 Flash: 74.8 (#2), GLM-5.1: 54.9 (#50)

BenchmarkGemini 3.8 FlashGLM-5.1
GPQA Diamond95.4%89.9%
SimpleQA Verified69.7%34%
LMArena Expert15241476
Humanity's Last Exam44.5%—

Multimodal Not comparable

Gemini 3.8 Flash: 40.7 (#45), GLM-5.1: —

BenchmarkGemini 3.8 FlashGLM-5.1
LMArena Vision1314—
Blueprint-Bench 238.6%—
Furniture Assembly31.7%—

Multilingual Gemini 3.8 Flash leads

Gemini 3.8 Flash: 58.0 (#5), GLM-5.1: 55.0 (#36)

BenchmarkGemini 3.8 FlashGLM-5.1
LMArena Non-English14911447
LMArena Chinese15541515
LMArena French14981474
LMArena German14931465
LMArena Japanese15021434
LMArena Korean14591418
LMArena Russian15151454
LMArena Spanish14851469

Instruction Following Gemini 3.8 Flash leads

Gemini 3.8 Flash: 78.0 (#13), GLM-5.1: 76.3 (#42)

BenchmarkGemini 3.8 FlashGLM-5.1
LMArena Instruction Following14901451

Long Context Gemini 3.8 Flash leads

Gemini 3.8 Flash: 46.3 (#24), GLM-5.1: 44.9 (#53)

BenchmarkGemini 3.8 FlashGLM-5.1
LMArena Longer Query15081466

Writing & Preference Gemini 3.8 Flash leads

Gemini 3.8 Flash: 72.2 (#15), GLM-5.1: 66.9 (#31)

BenchmarkGemini 3.8 FlashGLM-5.1
LMArena Text14991461
LMArena Creative Writing14921453
EQ-Bench Creative Writing17481592
LMArena Multi-Turn15011472

Frequently asked questions

Is Gemini 3.8 Flash better than GLM-5.1?

Gemini 3.8 Flash is the stronger model overall, scoring 61.8 to 47.8 on the Noometry Index.

Which is cheaper, Gemini 3.8 Flash or GLM-5.1?

Gemini 3.8 Flash is cheaper. It lists at $0.75 per million input tokens and $3.75 per million output tokens; GLM-5.1 lists at $1.40 and $4.40.

Is Gemini 3.8 Flash or GLM-5.1 better for coding?

Gemini 3.8 Flash scores higher on coding benchmarks: 59.2 versus 48.7 in the Noometry coding category.

Which has the bigger context window?

Gemini 3.8 Flash does, with 1.05M tokens against 200K.

How many benchmarks do Gemini 3.8 Flash and GLM-5.1 share?

33 benchmarks have published results for both models. Gemini 3.8 Flash has 50 scored results on Noometry and GLM-5.1 has 41.

Related comparisons

Go deeper