Noometry

Model comparison

GLM-5 vs o1-mini

GLM-5 is the stronger model overall, scoring 45.9 to 33.7 on the Noometry Index.

Last verified . 25 shared benchmarks.

GLM-5 Z.ai (Zhipu)

45.9

Rank #59 Confirmed

o1-mini OpenAI

33.7

Rank #230 Confirmed

Summary

  • They share 25 benchmarks with published results for both. GLM-5 scores higher in 9 categories and o1-mini in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where GLM-5 leads 27.6 to 8.9.
  • The biggest single-benchmark swing is SimpleBench: 53.2% for GLM-5 and 18.1% for o1-mini.
  • GLM-5 has downloadable open weights; the other is API-only.

Side by side

GLM-5o1-mini
ProviderZ.ai (Zhipu)OpenAI
Noometry Index45.933.7
Released2026-02-112024-09-12
WeightsOpenProprietary
Context window205K—
Max output131K—
Input $ / M tokens$1—
Output $ / M tokens$3.20—
Results tracked4539

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-5 leads

GLM-5: 49.0 (#47), o1-mini: 35.1 (#218)

BenchmarkGLM-5o1-mini
WeirdML48.2%36.3%
LMArena Coding14611362
SWE-bench Verified72.1%—
SWE-bench Verified (bash only)72.8%—
Aider Polyglot—32.9%
LMArena WebDev1434—
SWE-bench Multilingual69.7%—
LiveBench Coding—48%
ALE-Bench765.62—
HumanEval+—89%
MBPP+—78.8%

Agentic & Tool Use GLM-5 leads

GLM-5: 30.9 (#65), o1-mini: 24.3 (#112)

BenchmarkGLM-5o1-mini
Terminal-Bench52.4%—
τ²-bench Airline82.5%—
τ²-bench Banking9.8%—
τ²-bench Retail73.7%—
τ²-bench Telecom86.8%—
Cybench—10%
Vending-Bench 24,432—

Reasoning GLM-5 leads

GLM-5: 27.6 (#100), o1-mini: 8.9 (#340)

BenchmarkGLM-5o1-mini
ARC-AGI-24.9%0.8%
SimpleBench53.2%18.1%
ARC-AGI-144.7%14%
LMArena Hard Prompts14511333
Epoch Capabilities Index145.84135.82
Kagi LLM Benchmark75%—
NYT Connections (extended)74.8%—
Chess Puzzles10%—
LiveBench Reasoning—72.3%
LiveBench Data Analysis—57.9%
ForecastBench61—
LiveBench—57.8%

Math GLM-5 leads

GLM-5: 44.8 (#66), o1-mini: 33.7 (#168)

BenchmarkGLM-5o1-mini
OTIS Mock AIME 2024-202580%46.9%
LMArena Math14401358
FrontierMath (Feb 2025 set)16.4%1.7%
MathArena Final-Answer Competitions65.7%—
LiveBench Math—62%
MATH Level 5—89.2%
FrontierMath Tier 4 (v1)2.1%—

Knowledge GLM-5 leads

GLM-5: 52.2 (#59), o1-mini: 34.8 (#180)

BenchmarkGLM-5o1-mini
GPQA Diamond87.8%62.4%
LMArena Expert14541316
Confabulations—18.6%
Vectara Hallucination Rate10.1%—

Multilingual GLM-5 leads

GLM-5: 53.9 (#57), o1-mini: 43.8 (#177)

BenchmarkGLM-5o1-mini
LMArena Non-English14301289
LMArena Chinese15111314
LMArena French14551292
LMArena German14451278
LMArena Japanese14161245
LMArena Korean14211223
LMArena Russian14361283
LMArena Spanish14521302

Instruction Following GLM-5 leads

GLM-5: 75.4 (#64), o1-mini: 67.0 (#200)

BenchmarkGLM-5o1-mini
LMArena Instruction Following14271304
LiveBench Instruction Following—65.4%

Long Context GLM-5 leads

GLM-5: 44.6 (#58), o1-mini: 40.1 (#156)

BenchmarkGLM-5o1-mini
LMArena Longer Query14461321
CL-bench18.7%—

Writing & Preference GLM-5 leads

GLM-5: 66.2 (#38), o1-mini: 48.6 (#196)

BenchmarkGLM-5o1-mini
LMArena Text14461317
LMArena Creative Writing14381244
LMArena Multi-Turn14561314
Short-Story Creative Writing—64.9%
EQ-Bench Creative Writing1601—
LiveBench Language—40.9%

Frequently asked questions

Is GLM-5 better than o1-mini?

GLM-5 is the stronger model overall, scoring 45.9 to 33.7 on the Noometry Index.

Is GLM-5 or o1-mini better for coding?

GLM-5 scores higher on coding benchmarks: 49.0 versus 35.1 in the Noometry coding category.

How many benchmarks do GLM-5 and o1-mini share?

25 benchmarks have published results for both models. GLM-5 has 45 scored results on Noometry and o1-mini has 39.

Related comparisons

Go deeper