Model comparison

GLM-4.6V vs Grok 2 Mini 2024 08 13

GLM-4.6V is the stronger model overall, scoring 40.9 to 37.0 on the Noometry Index.

Last verified . 11 shared benchmarks.

GLM-4.6V Z.ai (Zhipu)

40.9

Rank #133 Confirmed

Grok 2 Mini 2024 08 13 xAI

37.0

Rank #196 Confirmed

Summary

  • They share 11 benchmarks with published results for both. GLM-4.6V scores higher in 7 categories and Grok 2 Mini 2024 08 13 in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where GLM-4.6V leads 56.8 to 47.5.
  • GLM-4.6V has downloadable open weights; the other is API-only.

Side by side

GLM-4.6V and Grok 2 Mini 2024 08 13 specifications
GLM-4.6VGrok 2 Mini 2024 08 13
ProviderZ.ai (Zhipu)xAI
Noometry Index40.937.0
Released2025-12-082024-08-13
WeightsOpenProprietary
Context window128K—
Max output33K—
Input $ / M tokens$0.30—
Output $ / M tokens$0.90—
Results tracked1217

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.6V leads

GLM-4.6V: 40.2 (#128), Grok 2 Mini 2024 08 13: 36.4 (#194)

Coding benchmarks
BenchmarkGLM-4.6VGrok 2 Mini 2024 08 13
LMArena Coding13901269

Reasoning GLM-4.6V leads

GLM-4.6V: 26.5 (#117), Grok 2 Mini 2024 08 13: 23.7 (#162)

Reasoning benchmarks
BenchmarkGLM-4.6VGrok 2 Mini 2024 08 13
LMArena Hard Prompts13681255

Math Not comparable

GLM-4.6V: —, Grok 2 Mini 2024 08 13: 32.8 (#185)

Math benchmarks
BenchmarkGLM-4.6VGrok 2 Mini 2024 08 13
LMArena Math—1265

Knowledge GLM-4.6V leads

GLM-4.6V: 37.4 (#148), Grok 2 Mini 2024 08 13: 33.4 (#195)

Knowledge benchmarks
BenchmarkGLM-4.6VGrok 2 Mini 2024 08 13
LMArena Expert13721238

Multimodal Not comparable

GLM-4.6V: 34.2 (#83), Grok 2 Mini 2024 08 13: —

Multimodal benchmarks
BenchmarkGLM-4.6VGrok 2 Mini 2024 08 13
LMArena Vision1164—

Multilingual GLM-4.6V leads

GLM-4.6V: 48.8 (#135), Grok 2 Mini 2024 08 13: 41.6 (#203)

Multilingual benchmarks
BenchmarkGLM-4.6VGrok 2 Mini 2024 08 13
LMArena Non-English13591257
LMArena Chinese14261262
LMArena Russian13411261
LMArena French—1285
LMArena German—1273
LMArena Japanese—1213
LMArena Korean—1195
LMArena Spanish—1278

Instruction Following GLM-4.6V leads

GLM-4.6V: 71.6 (#145), Grok 2 Mini 2024 08 13: 65.7 (#215)

Instruction Following benchmarks
BenchmarkGLM-4.6VGrok 2 Mini 2024 08 13
LMArena Instruction Following13511245

Long Context GLM-4.6V leads

GLM-4.6V: 41.3 (#138), Grok 2 Mini 2024 08 13: 38.4 (#191)

Long Context benchmarks
BenchmarkGLM-4.6VGrok 2 Mini 2024 08 13
LMArena Longer Query13581267

Writing & Preference GLM-4.6V leads

GLM-4.6V: 56.8 (#132), Grok 2 Mini 2024 08 13: 47.5 (#207)

Writing & Preference benchmarks
BenchmarkGLM-4.6VGrok 2 Mini 2024 08 13
LMArena Text13771281
LMArena Creative Writing13471242
LMArena Multi-Turn13591265

Frequently asked questions

Is GLM-4.6V better than Grok 2 Mini 2024 08 13?

GLM-4.6V is the stronger model overall, scoring 40.9 to 37.0 on the Noometry Index.

Is GLM-4.6V or Grok 2 Mini 2024 08 13 better for coding?

GLM-4.6V scores higher on coding benchmarks: 40.2 versus 36.4 in the Noometry coding category.

How many benchmarks do GLM-4.6V and Grok 2 Mini 2024 08 13 share?

11 benchmarks have published results for both models. GLM-4.6V has 12 scored results on Noometry and Grok 2 Mini 2024 08 13 has 17.

Related comparisons

Go deeper