Model comparison

GLM-5 vs gpt-oss-20b

GLM-5 is the stronger model overall, scoring 45.9 to 32.1 on the Noometry Index. gpt-oss-20b costs 43× less per token, which makes it the better buy when GLM-5's lead doesn't matter for your workload.

Last verified . 25 shared benchmarks.

GLM-5 Z.ai (Zhipu)

45.9

Rank #59 Confirmed

gpt-oss-20b OpenAI

32.1

Rank #249 Confirmed

Summary

  • They share 25 benchmarks with published results for both. GLM-5 scores higher in 9 categories and gpt-oss-20b in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where GLM-5 leads 66.2 to 35.8.
  • The biggest single-benchmark swing is Terminal-Bench: 52.4% for GLM-5 and 3.4% for gpt-oss-20b.
  • gpt-oss-20b is cheaper at $0.018 / $0.09 per million input/output tokens, against $1 / $3.20 for GLM-5.
  • GLM-5 accepts more context: 205K tokens versus 131K.

Side by side

GLM-5 and gpt-oss-20b specifications
GLM-5gpt-oss-20b
ProviderZ.ai (Zhipu)OpenAI
Noometry Index45.932.1
Released2026-02-112025-08-05
WeightsOpenOpen
Context window205K131K
Max output131K16K
Input $ / M tokens$1$0.018
Output $ / M tokens$3.20$0.09
Results tracked4534

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-5 leads

GLM-5: 49.0 (#47), gpt-oss-20b: 37.1 (#185)

Coding benchmarks
BenchmarkGLM-5gpt-oss-20b
WeirdML48.2%40.9%
LMArena Coding14611307
ALE-Bench765.62566.05
SWE-bench Verified72.1%—
SWE-bench Verified (bash only)72.8%—
LMArena WebDev1434—
SWE-bench Multilingual69.7%—
SciCode—34.4%

Agentic & Tool Use GLM-5 leads

GLM-5: 30.9 (#65), gpt-oss-20b: 9.2 (#146)

Agentic & Tool Use benchmarks
BenchmarkGLM-5gpt-oss-20b
Terminal-Bench52.4%3.4%
τ²-bench Airline82.5%—
τ²-bench Banking9.8%—
τ²-bench Retail73.7%—
τ²-bench Telecom86.8%—
Vending-Bench 24,432—

Reasoning GLM-5 leads

GLM-5: 27.6 (#100), gpt-oss-20b: 18.8 (#251)

Reasoning benchmarks
BenchmarkGLM-5gpt-oss-20b
Kagi LLM Benchmark75%53.2%
Chess Puzzles10%4%
LMArena Hard Prompts14511274
Epoch Capabilities Index145.84137.81
ARC-AGI-24.9%—
SimpleBench53.2%—
NYT Connections (extended)74.8%—
ARC-AGI-144.7%—
CritPt—1.4%
DTBench—68%
LMCA—14.5%
ForecastBench61—

Math GLM-5 leads

GLM-5: 44.8 (#66), gpt-oss-20b: 37.6 (#93)

Knowledge GLM-5 leads

GLM-5: 52.2 (#59), gpt-oss-20b: 34.6 (#186)

Knowledge benchmarks
BenchmarkGLM-5gpt-oss-20b
GPQA Diamond87.8%60.8%
LMArena Expert14541258
MMLU-Pro—74%
Vectara Hallucination Rate10.1%—
GPQA (HELM)—59.4%

Multilingual GLM-5 leads

GLM-5: 53.9 (#57), gpt-oss-20b: 42.4 (#192)

Multilingual benchmarks
BenchmarkGLM-5gpt-oss-20b
LMArena Non-English14301269
LMArena Chinese15111311
LMArena German14451249
LMArena Japanese14161245
LMArena Korean14211239
LMArena Russian14361279
LMArena Spanish14521267
LMArena French1455—

Instruction Following GLM-5 leads

GLM-5: 75.4 (#64), gpt-oss-20b: 62.0 (#235)

Instruction Following benchmarks
BenchmarkGLM-5gpt-oss-20b
LMArena Instruction Following14271236
IFEval—73.2%

Long Context GLM-5 leads

GLM-5: 44.6 (#58), gpt-oss-20b: 37.9 (#203)

Long Context benchmarks
BenchmarkGLM-5gpt-oss-20b
LMArena Longer Query14461251
CL-bench18.7%—

Writing & Preference GLM-5 leads

GLM-5: 66.2 (#38), gpt-oss-20b: 35.8 (#260)

Writing & Preference benchmarks
BenchmarkGLM-5gpt-oss-20b
LMArena Text14461288
LMArena Creative Writing14381201
EQ-Bench Creative Writing1601666
LMArena Multi-Turn14561268
WildBench—73.7%

Frequently asked questions

Is GLM-5 better than gpt-oss-20b?

GLM-5 is the stronger model overall, scoring 45.9 to 32.1 on the Noometry Index. gpt-oss-20b costs 43× less per token, which makes it the better buy when GLM-5's lead doesn't matter for your workload.

Which is cheaper, GLM-5 or gpt-oss-20b?

gpt-oss-20b is cheaper. It lists at $0.018 per million input tokens and $0.09 per million output tokens; GLM-5 lists at $1 and $3.20.

Is GLM-5 or gpt-oss-20b better for coding?

GLM-5 scores higher on coding benchmarks: 49.0 versus 37.1 in the Noometry coding category.

Which has the bigger context window?

GLM-5 does, with 205K tokens against 131K.

How many benchmarks do GLM-5 and gpt-oss-20b share?

25 benchmarks have published results for both models. GLM-5 has 45 scored results on Noometry and gpt-oss-20b has 34.

Related comparisons

Go deeper