Model comparison

GLM-4.5-Air vs Grok 4.5

Grok 4.5 is the stronger model overall, scoring 55.0 to 38.9 on the Noometry Index. GLM-4.5-Air costs 7.1× less per token, which makes it the better buy when Grok 4.5's lead doesn't matter for your workload.

Last verified . 18 shared benchmarks.

GLM-4.5-Air Z.ai (Zhipu)

38.9

Rank #177 Confirmed

Grok 4.5 xAI

55.0

Rank #25 Confirmed

Summary

  • They share 18 benchmarks with published results for both. GLM-4.5-Air scores higher in 0 categories and Grok 4.5 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.5 leads 56.1 to 24.1.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 43% for GLM-4.5-Air and 83.5% for Grok 4.5.
  • GLM-4.5-Air is cheaper at $0.20 / $1.10 per million input/output tokens, against $2 / $6 for Grok 4.5.
  • Grok 4.5 accepts more context: 500K tokens versus 131K.
  • GLM-4.5-Air has downloadable open weights; the other is API-only.

Side by side

GLM-4.5-Air and Grok 4.5 specifications
GLM-4.5-AirGrok 4.5
ProviderZ.ai (Zhipu)xAI
Noometry Index38.955.0
Released2025-07-202026-07-08
WeightsOpenProprietary
Context window131K500K
Max output98K500K
Input $ / M tokens$0.20$2
Output $ / M tokens$1.10$6
Results tracked2752

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.5 leads

GLM-4.5-Air: 33.3 (#259), Grok 4.5: 52.2 (#35)

Coding benchmarks
BenchmarkGLM-4.5-AirGrok 4.5
LMArena Coding13971474
DeepSWE—53.8%
FrontierCode—42.4%
LMArena WebDev—1553
SciCode—54.1%
GSO2.9%—
WeirdML—46.4%
ALE-Bench—1,309

Agentic & Tool Use Not comparable

GLM-4.5-Air: —, Grok 4.5: 44.4 (#17)

Agentic & Tool Use benchmarks
BenchmarkGLM-4.5-AirGrok 4.5
APEX-Agents—56.2%
τ²-bench Banking—47.9%
PostTrainBench—23.4%
GBAEval—65.4%
GDP.pdf—14%
LMArena Search—1213
Vending-Bench 2—3,887

Reasoning Grok 4.5 leads

GLM-4.5-Air: 24.1 (#166), Grok 4.5: 56.1 (#25)

Reasoning benchmarks
BenchmarkGLM-4.5-AirGrok 4.5
Kagi LLM Benchmark43%83.5%
LMArena Hard Prompts13791462
ARC-AGI-2—52.6%
SimpleBench—70%
NYT Connections (extended)—79.9%
ARC-AGI-1—87.2%
CritPt—15.4%
Chess Puzzles—36%
DTBench—96.5%
LMCA—45.2%
Surface Evolver Bench—74.4%
Epoch Capabilities Index—153.92
ForecastBench59.2—

Math Grok 4.5 leads

GLM-4.5-Air: 36.2 (#170), Grok 4.5: 60.9 (#35)

Math benchmarks
BenchmarkGLM-4.5-AirGrok 4.5
LMArena Math13961459
FrontierMath (Tiers 1-3)—57.2%
FrontierMath Tier 4—24.4%
OTIS Mock AIME 2024-2025—97.8%
ProofBench—31%
Omni-MATH39.1%—

Knowledge Grok 4.5 leads

GLM-4.5-Air: 35.0 (#191), Grok 4.5: 62.3 (#24)

Knowledge benchmarks
BenchmarkGLM-4.5-AirGrok 4.5
LMArena Expert13701466
GPQA Diamond—93.4%
Humanity's Last Exam8.1%—
SimpleQA Verified—48.3%
MMLU-Pro76.2%—
Vectara Hallucination Rate9.3%—
GPQA (HELM)59.4%—

Multimodal Not comparable

GLM-4.5-Air: —, Grok 4.5: 37.6 (#72)

Multimodal benchmarks
BenchmarkGLM-4.5-AirGrok 4.5
LMArena Vision—1288
Blueprint-Bench 2—27.3%
Furniture Assembly—22.5%
LMArena Document—1452

Multilingual Grok 4.5 leads

GLM-4.5-Air: 49.1 (#135), Grok 4.5: 54.4 (#42)

Multilingual benchmarks
BenchmarkGLM-4.5-AirGrok 4.5
LMArena Non-English13661440
LMArena Chinese14261496
LMArena French13991456
LMArena German13771446
LMArena Japanese13481428
LMArena Korean13081404
LMArena Russian13731448
LMArena Spanish13861450

Instruction Following Grok 4.5 leads

GLM-4.5-Air: 69.6 (#171), Grok 4.5: 76.0 (#48)

Instruction Following benchmarks
BenchmarkGLM-4.5-AirGrok 4.5
LMArena Instruction Following13541446
IFEval81.2%—

Long Context Grok 4.5 leads

GLM-4.5-Air: 41.6 (#135), Grok 4.5: 44.8 (#56)

Long Context benchmarks
BenchmarkGLM-4.5-AirGrok 4.5
LMArena Longer Query13661463

Writing & Preference Grok 4.5 leads

GLM-4.5-Air: 55.9 (#139), Grok 4.5: 65.8 (#42)

Writing & Preference benchmarks
BenchmarkGLM-4.5-AirGrok 4.5
LMArena Text13841448
LMArena Creative Writing13431442
LMArena Multi-Turn13711456
EQ-Bench Creative Writing—1579
WildBench78.9%—

Frequently asked questions

Is GLM-4.5-Air better than Grok 4.5?

Grok 4.5 is the stronger model overall, scoring 55.0 to 38.9 on the Noometry Index. GLM-4.5-Air costs 7.1× less per token, which makes it the better buy when Grok 4.5's lead doesn't matter for your workload.

Which is cheaper, GLM-4.5-Air or Grok 4.5?

GLM-4.5-Air is cheaper. It lists at $0.20 per million input tokens and $1.10 per million output tokens; Grok 4.5 lists at $2 and $6.

Is GLM-4.5-Air or Grok 4.5 better for coding?

Grok 4.5 scores higher on coding benchmarks: 52.2 versus 33.3 in the Noometry coding category.

Which has the bigger context window?

Grok 4.5 does, with 500K tokens against 131K.

How many benchmarks do GLM-4.5-Air and Grok 4.5 share?

18 benchmarks have published results for both models. GLM-4.5-Air has 27 scored results on Noometry and Grok 4.5 has 52.

Related comparisons

Go deeper