Noometry

Model comparison

GLM-4.7 vs GPT-5.4 mini

GPT-5.4 mini is the stronger model overall, scoring 45.0 to 42.0 on the Noometry Index. GLM-4.7 costs 1.7× less per token, which makes it the better buy when GPT-5.4 mini's lead doesn't matter for your workload.

Last verified . 31 shared benchmarks.

GLM-4.7 Z.ai (Zhipu)

42.0

Rank #124 Confirmed

GPT-5.4 mini OpenAI

45.0

Rank #76 Confirmed

Summary

  • They share 31 benchmarks with published results for both. GLM-4.7 scores higher in 2 categories and GPT-5.4 mini in 7 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-5.4 mini leads 45.5 to 38.6.
  • The biggest single-benchmark swing is Chess Puzzles: 6% for GLM-4.7 and 24% for GPT-5.4 mini.
  • GLM-4.7 is cheaper at $0.60 / $2.20 per million input/output tokens, against $0.75 / $4.50 for GPT-5.4 mini.
  • GPT-5.4 mini accepts more context: 400K tokens versus 205K.
  • GLM-4.7 has downloadable open weights; the other is API-only.

Side by side

GLM-4.7GPT-5.4 mini
ProviderZ.ai (Zhipu)OpenAI
Noometry Index42.045.0
Released2025-12-222026-03-17
WeightsOpenProprietary
Context window205K400K
Max output131K128K
Input $ / M tokens$0.60$0.75
Output $ / M tokens$2.20$4.50
Results tracked3646

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.4 mini leads

GLM-4.7: 44.0 (#79), GPT-5.4 mini: 45.2 (#72)

BenchmarkGLM-4.7GPT-5.4 mini
LMArena WebDev14351397
SciCode45.1%49.9%
LMArena Coding14541438
ALE-Bench399.481,189
FrontierCode—27%
WeirdML—60.3%

Agentic & Tool Use GPT-5.4 mini leads

GLM-4.7: 26.5 (#103), GPT-5.4 mini: 29.9 (#81)

BenchmarkGLM-4.7GPT-5.4 mini
Terminal-Bench33.4%—
DeepResearch Bench—36.3%
Vending-Bench 22,377—

Reasoning GPT-5.4 mini leads

GLM-4.7: 24.3 (#164), GPT-5.4 mini: 30.4 (#85)

BenchmarkGLM-4.7GPT-5.4 mini
CritPt1.7%10%
Chess Puzzles6%24%
LMArena Hard Prompts14431424
Epoch Capabilities Index143.51148.84
ARC-AGI-2—18.9%
SimpleBench47.7%—
Kagi LLM Benchmark—37.9%
NYT Connections (extended)—61.8%
ARC-AGI-1—63.7%
Thematic Generalization—61.7%
Mystery Game Puzzles—11%
DTBench—80%
LMCA—40.8%
ForecastBench—57

Math GPT-5.4 mini leads

GLM-4.7: 38.6 (#135), GPT-5.4 mini: 45.5 (#75)

BenchmarkGLM-4.7GPT-5.4 mini
OTIS Mock AIME 2024-202583.3%88.9%
ProofBench6%21%
LMArena Math14231419
FrontierMath (Feb 2025 set)2.4%28.3%
FrontierMath Tier 4 (v1)0%2.1%
FrontierMath (Tiers 1-3)—51.2%
FrontierMath Tier 4—9.8%

Knowledge GPT-5.4 mini leads

GLM-4.7: 47.0 (#80), GPT-5.4 mini: 51.5 (#67)

BenchmarkGLM-4.7GPT-5.4 mini
GPQA Diamond83.3%86.9%
SimpleQA Verified32.2%29.4%
Vectara Hallucination Rate11.7%5.5%
LMArena Expert14241435

Multimodal Not comparable

GLM-4.7: —, GPT-5.4 mini: 39.7 (#56)

BenchmarkGLM-4.7GPT-5.4 mini
LMArena Vision—1245

Multilingual Too close to call

GLM-4.7: 52.8 (#79), GPT-5.4 mini: 51.9 (#96)

BenchmarkGLM-4.7GPT-5.4 mini
LMArena Non-English14171405
LMArena Chinese14951446
LMArena French14321440
LMArena German14241409
LMArena Japanese14391374
LMArena Korean13991368
LMArena Russian14231417
LMArena Spanish14341405

Instruction Following Too close to call

GLM-4.7: 74.4 (#95), GPT-5.4 mini: 74.1 (#102)

BenchmarkGLM-4.7GPT-5.4 mini
LMArena Instruction Following14111405

Long Context Too close to call

GLM-4.7: 42.8 (#116), GPT-5.4 mini: 43.0 (#112)

BenchmarkGLM-4.7GPT-5.4 mini
LMArena Longer Query14321407
CL-bench15.9%—
CL-bench Life10.9%—

Writing & Preference GPT-5.4 mini leads

GLM-4.7: 60.9 (#93), GPT-5.4 mini: 64.0 (#58)

BenchmarkGLM-4.7GPT-5.4 mini
LMArena Text14351412
LMArena Creative Writing14011370
EQ-Bench Creative Writing14131665
LMArena Multi-Turn14461429

Frequently asked questions

Is GLM-4.7 better than GPT-5.4 mini?

GPT-5.4 mini is the stronger model overall, scoring 45.0 to 42.0 on the Noometry Index. GLM-4.7 costs 1.7× less per token, which makes it the better buy when GPT-5.4 mini's lead doesn't matter for your workload.

Which is cheaper, GLM-4.7 or GPT-5.4 mini?

GLM-4.7 is cheaper. It lists at $0.60 per million input tokens and $2.20 per million output tokens; GPT-5.4 mini lists at $0.75 and $4.50.

Is GLM-4.7 or GPT-5.4 mini better for coding?

GPT-5.4 mini scores higher on coding benchmarks: 45.2 versus 44.0 in the Noometry coding category.

Which has the bigger context window?

GPT-5.4 mini does, with 400K tokens against 205K.

How many benchmarks do GLM-4.7 and GPT-5.4 mini share?

31 benchmarks have published results for both models. GLM-4.7 has 36 scored results on Noometry and GPT-5.4 mini has 46.

Related comparisons

Go deeper