Noometry

Model comparison

GLM-4.5-Air vs Mixtral 8x22B

GLM-4.5-Air is the stronger model overall, scoring 38.9 to 27.1 on the Noometry Index.

Last verified . 23 shared benchmarks.

GLM-4.5-Air Z.ai (Zhipu)

38.9

Rank #177 Confirmed

Mixtral 8x22B Mistral AI

27.1

Rank #333 Confirmed

Summary

  • They share 23 benchmarks with published results for both. GLM-4.5-Air scores higher in 8 categories and Mixtral 8x22B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GLM-4.5-Air leads 35.0 to 15.1.
  • The biggest single-benchmark swing is MMLU-Pro: 76.2% for GLM-4.5-Air and 46% for Mixtral 8x22B.
  • GLM-4.5-Air is cheaper at $0.20 / $1.10 per million input/output tokens, against $2 / $6 for Mixtral 8x22B.
  • GLM-4.5-Air accepts more context: 131K tokens versus 64K.

Side by side

GLM-4.5-AirMixtral 8x22B
ProviderZ.ai (Zhipu)Mistral AI
Noometry Index38.927.1
Released2025-07-202024-04-17
WeightsOpenOpen
Context window131K64K
Max output98K64K
Input $ / M tokens$0.20$2
Output $ / M tokens$1.10$6
Results tracked2734

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.5-Air leads

GLM-4.5-Air: 33.3 (#259), Mixtral 8x22B: 24.2 (#329)

BenchmarkGLM-4.5-AirMixtral 8x22B
LMArena Coding13971166
GSO2.9%—
WeirdML—3.2%
BigCodeBench Instruct—40.6%
BigCodeBench Complete—50.2%
HumanEval+—72%
MBPP+—64.3%

Agentic & Tool Use Not comparable

GLM-4.5-Air: —, Mixtral 8x22B: 23.1 (#127)

BenchmarkGLM-4.5-AirMixtral 8x22B
Cybench—7.5%

Reasoning GLM-4.5-Air leads

GLM-4.5-Air: 24.1 (#166), Mixtral 8x22B: 19.9 (#248)

BenchmarkGLM-4.5-AirMixtral 8x22B
LMArena Hard Prompts13791150
ForecastBench59.256.3
Kagi LLM Benchmark43%—
DTBench—55.1%
Epoch Capabilities Index—122.03

Math GLM-4.5-Air leads

GLM-4.5-Air: 36.2 (#170), Mixtral 8x22B: 22.9 (#275)

BenchmarkGLM-4.5-AirMixtral 8x22B
Omni-MATH39.1%16.3%
LMArena Math13961184
MATH Level 5—24.2%

Knowledge GLM-4.5-Air leads

GLM-4.5-Air: 35.0 (#191), Mixtral 8x22B: 15.1 (#293)

BenchmarkGLM-4.5-AirMixtral 8x22B
MMLU-Pro76.2%46%
GPQA (HELM)59.4%33.4%
LMArena Expert13701113
GPQA Diamond—34.1%
Humanity's Last Exam8.1%—
Vectara Hallucination Rate9.3%—
MMLU—77.8%

Multilingual GLM-4.5-Air leads

GLM-4.5-Air: 49.1 (#135), Mixtral 8x22B: 32.8 (#255)

BenchmarkGLM-4.5-AirMixtral 8x22B
LMArena Non-English13661128
LMArena Chinese14261116
LMArena French13991166
LMArena German13771141
LMArena Japanese13481037
LMArena Korean13081057
LMArena Russian13731158
LMArena Spanish13861151

Instruction Following GLM-4.5-Air leads

GLM-4.5-Air: 69.6 (#171), Mixtral 8x22B: 57.7 (#266)

BenchmarkGLM-4.5-AirMixtral 8x22B
IFEval81.2%72.4%
LMArena Instruction Following13541147

Long Context GLM-4.5-Air leads

GLM-4.5-Air: 41.6 (#135), Mixtral 8x22B: 34.7 (#247)

BenchmarkGLM-4.5-AirMixtral 8x22B
LMArena Longer Query13661144

Writing & Preference GLM-4.5-Air leads

GLM-4.5-Air: 55.9 (#139), Mixtral 8x22B: 36.9 (#262)

BenchmarkGLM-4.5-AirMixtral 8x22B
LMArena Text13841162
LMArena Creative Writing13431141
WildBench78.9%71.1%
LMArena Multi-Turn13711130

Frequently asked questions

Is GLM-4.5-Air better than Mixtral 8x22B?

GLM-4.5-Air is the stronger model overall, scoring 38.9 to 27.1 on the Noometry Index.

Which is cheaper, GLM-4.5-Air or Mixtral 8x22B?

GLM-4.5-Air is cheaper. It lists at $0.20 per million input tokens and $1.10 per million output tokens; Mixtral 8x22B lists at $2 and $6.

Is GLM-4.5-Air or Mixtral 8x22B better for coding?

GLM-4.5-Air scores higher on coding benchmarks: 33.3 versus 24.2 in the Noometry coding category.

Which has the bigger context window?

GLM-4.5-Air does, with 131K tokens against 64K.

How many benchmarks do GLM-4.5-Air and Mixtral 8x22B share?

23 benchmarks have published results for both models. GLM-4.5-Air has 27 scored results on Noometry and Mixtral 8x22B has 34.

Related comparisons

Go deeper