Model comparison

Falcon-180B vs GLM-5

GLM-5 is the stronger model overall, scoring 45.9 to 31.8 on the Noometry Index.

Last verified . 7 shared benchmarks.

GLM-5 Z.ai (Zhipu)

45.9

Rank #59 Confirmed

Summary

  • They share 7 benchmarks with published results for both. Falcon-180B scores higher in 0 categories and GLM-5 in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where GLM-5 leads 66.2 to 29.3.

Side by side

Falcon-180B and GLM-5 specifications
Falcon-180BGLM-5
ProviderTechnology Innovation InstituteZ.ai (Zhipu)
Noometry Index31.845.9
Released2023-09-062026-02-11
WeightsOpenOpen
Context window—205K
Max output—131K
Input $ / M tokens—$1
Output $ / M tokens—$3.20
Results tracked1645

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon-180B: —, GLM-5: 49.0 (#47)

Coding benchmarks
BenchmarkFalcon-180BGLM-5
SWE-bench Verified—72.1%
SWE-bench Verified (bash only)—72.8%
LMArena WebDev—1434
SWE-bench Multilingual—69.7%
WeirdML—48.2%
LMArena Coding—1461
ALE-Bench—765.62

Agentic & Tool Use Not comparable

Falcon-180B: —, GLM-5: 30.9 (#65)

Agentic & Tool Use benchmarks
BenchmarkFalcon-180BGLM-5
Terminal-Bench—52.4%
τ²-bench Airline—82.5%
τ²-bench Banking—9.8%
τ²-bench Retail—73.7%
τ²-bench Telecom—86.8%
Vending-Bench 2—4,432

Reasoning GLM-5 leads

Falcon-180B: 18.3 (#266), GLM-5: 27.6 (#100)

Reasoning benchmarks
BenchmarkFalcon-180BGLM-5
LMArena Hard Prompts10071451
Epoch Capabilities Index111.89145.84
ARC-AGI-2—4.9%
SimpleBench—53.2%
Kagi LLM Benchmark—75%
NYT Connections (extended)—74.8%
ARC-AGI-1—44.7%
Chess Puzzles—10%
ForecastBench—61
HellaSwag89%—
LAMBADA79.8%—
PIQA84.9%—
WinoGrande87.1%—

Math Not comparable

Falcon-180B: —, GLM-5: 44.8 (#66)

Knowledge Not comparable

Falcon-180B: —, GLM-5: 52.2 (#59)

Knowledge benchmarks
BenchmarkFalcon-180BGLM-5
GPQA Diamond—87.8%
Vectara Hallucination Rate—10.1%
LMArena Expert—1454
ARC (AI2) Challenge67.8%—
BoolQ89%—
MMLU70.6%—
OpenBookQA64.2%—

Multilingual GLM-5 leads

Falcon-180B: 25.3 (#281), GLM-5: 53.9 (#57)

Multilingual benchmarks
BenchmarkFalcon-180BGLM-5
LMArena Non-English10001430
LMArena Chinese—1511
LMArena French—1455
LMArena German—1445
LMArena Japanese—1416
LMArena Korean—1421
LMArena Russian—1436
LMArena Spanish—1452

Instruction Following GLM-5 leads

Falcon-180B: 53.6 (#281), GLM-5: 75.4 (#64)

Instruction Following benchmarks
BenchmarkFalcon-180BGLM-5
LMArena Instruction Following10471427

Long Context Not comparable

Falcon-180B: —, GLM-5: 44.6 (#58)

Long Context benchmarks
BenchmarkFalcon-180BGLM-5
CL-bench—18.7%
LMArena Longer Query—1446

Writing & Preference GLM-5 leads

Falcon-180B: 29.3 (#290), GLM-5: 66.2 (#38)

Writing & Preference benchmarks
BenchmarkFalcon-180BGLM-5
LMArena Text10541446
LMArena Creative Writing10891438
LMArena Multi-Turn10131456
EQ-Bench Creative Writing—1601

Frequently asked questions

Is Falcon-180B better than GLM-5?

GLM-5 is the stronger model overall, scoring 45.9 to 31.8 on the Noometry Index.

How many benchmarks do Falcon-180B and GLM-5 share?

7 benchmarks have published results for both models. Falcon-180B has 16 scored results on Noometry and GLM-5 has 45.

Related comparisons

Go deeper