Model comparison

GLM-5.3 vs Yi-1.5-34B

GLM-5.3 is the stronger model overall, scoring 54.8 to 30.6 on the Noometry Index.

Last verified . 18 shared benchmarks.

GLM-5.3 Z.ai (Zhipu)

54.8

Rank #26 Confirmed

Yi-1.5-34B 01.AI

30.6

Rank #289 Confirmed

Summary

  • They share 18 benchmarks with published results for both. GLM-5.3 scores higher in 8 categories and Yi-1.5-34B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GLM-5.3 leads 58.3 to 14.8.
  • The biggest single-benchmark swing is GPQA Diamond: 90.9% for GLM-5.3 and 32% for Yi-1.5-34B.

Side by side

GLM-5.3 and Yi-1.5-34B specifications
GLM-5.3Yi-1.5-34B
ProviderZ.ai (Zhipu)01.AI
Noometry Index54.830.6
Released2026-08-142024-05-13
WeightsOpenOpen
Context window1M—
Max output131K—
Input $ / M tokens$1.40—
Output $ / M tokens$4.40—
Results tracked4221

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-5.3 leads

GLM-5.3: 59.5 (#14), Yi-1.5-34B: 32.4 (#272)

Coding benchmarks
BenchmarkGLM-5.3Yi-1.5-34B
LMArena Coding14961169
DeepSWE69%—
FrontierCode40.1%—
CursorBench42.6%—
LMArena WebDev1622—
FrontierSWE30.2%—
SciCode59%—
WeirdML75.4%—
BigCodeBench Instruct—33.9%
BigCodeBench Complete—43.8%
ALE-Bench1,317—

Agentic & Tool Use Not comparable

GLM-5.3: 36.4 (#38), Yi-1.5-34B: —

Agentic & Tool Use benchmarks
BenchmarkGLM-5.3Yi-1.5-34B
APEX-Agents56.6%—
Vending-Bench 28,164—

Reasoning GLM-5.3 leads

GLM-5.3: 46.1 (#46), Yi-1.5-34B: 22.5 (#191)

Reasoning benchmarks
BenchmarkGLM-5.3Yi-1.5-34B
LMArena Hard Prompts14891160
NYT Connections (extended)74.2%—
CritPt19.1%—
Chess Puzzles21%—
Mystery Game Puzzles33%—
DTBench87.7%—
LMCA55.5%—
Bench to the Future 30.15—
Epoch Capabilities Index155.61—

Math GLM-5.3 leads

GLM-5.3: 62.3 (#33), Yi-1.5-34B: 27.5 (#249)

Math benchmarks
BenchmarkGLM-5.3Yi-1.5-34B
LMArena Math14891182
FrontierMath (Tiers 1-3)68.8%—
FrontierMath Tier 429.3%—
OTIS Mock AIME 2024-202591.1%—
ProofBench49%—
MATH Level 5—25.5%

Knowledge GLM-5.3 leads

GLM-5.3: 58.3 (#37), Yi-1.5-34B: 14.8 (#295)

Knowledge benchmarks
BenchmarkGLM-5.3Yi-1.5-34B
GPQA Diamond90.9%32%
LMArena Expert15161144
SimpleQA Verified41%—

Multilingual GLM-5.3 leads

GLM-5.3: 55.7 (#28), Yi-1.5-34B: 32.3 (#256)

Multilingual benchmarks
BenchmarkGLM-5.3Yi-1.5-34B
LMArena Non-English14571121
LMArena Chinese15281213
LMArena French14991156
LMArena German14991111
LMArena Japanese14531021
LMArena Korean14721005
LMArena Russian14631091
LMArena Spanish14601121

Instruction Following GLM-5.3 leads

GLM-5.3: 77.5 (#23), Yi-1.5-34B: 59.2 (#257)

Instruction Following benchmarks
BenchmarkGLM-5.3Yi-1.5-34B
LMArena Instruction Following14771139

Long Context GLM-5.3 leads

GLM-5.3: 45.4 (#41), Yi-1.5-34B: 34.6 (#248)

Long Context benchmarks
BenchmarkGLM-5.3Yi-1.5-34B
LMArena Longer Query14821143

Writing & Preference GLM-5.3 leads

GLM-5.3: 75.7 (#6), Yi-1.5-34B: 37.4 (#257)

Writing & Preference benchmarks
BenchmarkGLM-5.3Yi-1.5-34B
LMArena Text14711173
LMArena Creative Writing14571135
LMArena Multi-Turn14721153
EQ-Bench Creative Writing2075—

Frequently asked questions

Is GLM-5.3 better than Yi-1.5-34B?

GLM-5.3 is the stronger model overall, scoring 54.8 to 30.6 on the Noometry Index.

Is GLM-5.3 or Yi-1.5-34B better for coding?

GLM-5.3 scores higher on coding benchmarks: 59.5 versus 32.4 in the Noometry coding category.

How many benchmarks do GLM-5.3 and Yi-1.5-34B share?

18 benchmarks have published results for both models. GLM-5.3 has 42 scored results on Noometry and Yi-1.5-34B has 21.

Related comparisons

Go deeper