Model comparison

GLM-5.3-Flash vs Magistral Medium

GLM-5.3-Flash is the stronger model overall, scoring 49.6 to 34.8 on the Noometry Index.

Last verified . 19 shared benchmarks.

GLM-5.3-Flash Z.ai (Zhipu)

49.6

Rank #45 Confirmed

Magistral Medium Mistral AI

34.8

Rank #224 Confirmed

Summary

  • They share 19 benchmarks with published results for both. GLM-5.3-Flash scores higher in 8 categories and Magistral Medium in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GLM-5.3-Flash leads 58.4 to 32.9.
  • The biggest single-benchmark swing is CritPt: 15.4% for GLM-5.3-Flash and 0.3% for Magistral Medium.
  • GLM-5.3-Flash is cheaper at $0.15 / $0.50 per million input/output tokens, against $2 / $5 for Magistral Medium.
  • GLM-5.3-Flash accepts more context: 1M tokens versus 128K.

Side by side

GLM-5.3-Flash and Magistral Medium specifications
GLM-5.3-FlashMagistral Medium
ProviderZ.ai (Zhipu)Mistral AI
Noometry Index49.634.8
Released2026-08-202025-03-17
WeightsOpenOpen
Context window1M128K
Max output131K16K
Input $ / M tokens$0.15$2
Output $ / M tokens$0.50$5
Results tracked3622

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-5.3-Flash leads

GLM-5.3-Flash: 53.7 (#26), Magistral Medium: 38.6 (#161)

Coding benchmarks
BenchmarkGLM-5.3-FlashMagistral Medium
SciCode51.6%39.2%
LMArena Coding15061319
DeepSWE63.4%—
FrontierCode31.8%—
LMArena WebDev1614—
ALE-Bench303.55—

Agentic & Tool Use Not comparable

GLM-5.3-Flash: 34.3 (#41), Magistral Medium: —

Agentic & Tool Use benchmarks
BenchmarkGLM-5.3-FlashMagistral Medium
APEX-Agents52.8%—
GDP.pdf14%—

Reasoning GLM-5.3-Flash leads

GLM-5.3-Flash: 31.7 (#69), Magistral Medium: 8.7 (#342)

Reasoning benchmarks
BenchmarkGLM-5.3-FlashMagistral Medium
CritPt15.4%0.3%
LMArena Hard Prompts14901267
ARC-AGI-2—0%
Kagi LLM Benchmark—16.2%
ARC-AGI-1—6.1%
Chess Puzzles14%—
Mystery Game Puzzles8%—
Surface Evolver Bench52.5%—
Bench to the Future 30.15—
Epoch Capabilities Index151.9—

Math GLM-5.3-Flash leads

GLM-5.3-Flash: 53.1 (#38), Magistral Medium: 32.4 (#187)

Math benchmarks
BenchmarkGLM-5.3-FlashMagistral Medium
LMArena Math14991249
FrontierMath (Tiers 1-3)55.8%—
FrontierMath Tier 417.1%—
OTIS Mock AIME 2024-202593.9%—
ProofBench21%—

Knowledge GLM-5.3-Flash leads

GLM-5.3-Flash: 58.4 (#33), Magistral Medium: 32.9 (#199)

Knowledge benchmarks
BenchmarkGLM-5.3-FlashMagistral Medium
LMArena Expert15121222
GPQA Diamond90.2%—

Multimodal Not comparable

GLM-5.3-Flash: 42.6 (#25), Magistral Medium: —

Multimodal benchmarks
BenchmarkGLM-5.3-FlashMagistral Medium
LMArena Vision1304—

Multilingual GLM-5.3-Flash leads

GLM-5.3-Flash: 56.2 (#24), Magistral Medium: 39.8 (#219)

Multilingual benchmarks
BenchmarkGLM-5.3-FlashMagistral Medium
LMArena Non-English14621232
LMArena Chinese15291225
LMArena French14951268
LMArena German14571248
LMArena Japanese14201176
LMArena Korean14431125
LMArena Russian14721224
LMArena Spanish14711269

Instruction Following GLM-5.3-Flash leads

GLM-5.3-Flash: 77.8 (#17), Magistral Medium: 66.2 (#207)

Instruction Following benchmarks
BenchmarkGLM-5.3-FlashMagistral Medium
LMArena Instruction Following14801254

Long Context GLM-5.3-Flash leads

GLM-5.3-Flash: 45.3 (#41), Magistral Medium: 39.3 (#178)

Long Context benchmarks
BenchmarkGLM-5.3-FlashMagistral Medium
LMArena Longer Query14791295

Writing & Preference GLM-5.3-Flash leads

GLM-5.3-Flash: 65.4 (#49), Magistral Medium: 46.5 (#214)

Writing & Preference benchmarks
BenchmarkGLM-5.3-FlashMagistral Medium
LMArena Text14711255
LMArena Creative Writing14401245
LMArena Multi-Turn14711275

Frequently asked questions

Is GLM-5.3-Flash better than Magistral Medium?

GLM-5.3-Flash is the stronger model overall, scoring 49.6 to 34.8 on the Noometry Index.

Which is cheaper, GLM-5.3-Flash or Magistral Medium?

GLM-5.3-Flash is cheaper. It lists at $0.15 per million input tokens and $0.50 per million output tokens; Magistral Medium lists at $2 and $5.

Is GLM-5.3-Flash or Magistral Medium better for coding?

GLM-5.3-Flash scores higher on coding benchmarks: 53.7 versus 38.6 in the Noometry coding category.

Which has the bigger context window?

GLM-5.3-Flash does, with 1M tokens against 128K.

How many benchmarks do GLM-5.3-Flash and Magistral Medium share?

19 benchmarks have published results for both models. GLM-5.3-Flash has 36 scored results on Noometry and Magistral Medium has 22.

Related comparisons

Go deeper