Noometry

Model comparison

GLM-4.6 vs Grok-3 mini

GLM-4.6 and Grok-3 mini score almost the same on the Noometry Index (40.9 vs 41.0), so choose on price, context window or the category you care about most.

Last verified . 19 shared benchmarks.

GLM-4.6 Z.ai (Zhipu)

40.9

Rank #132 Confirmed

Grok-3 mini xAI

41.0

Rank #130 Confirmed

Summary

  • They share 19 benchmarks with published results for both. GLM-4.6 scores higher in 4 categories and Grok-3 mini in 4 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where GLM-4.6 leads 23.1 to 13.8.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 47.4% for GLM-4.6 and 61.3% for Grok-3 mini.
  • GLM-4.6 has downloadable open weights; the other is API-only.

Side by side

GLM-4.6Grok-3 mini
ProviderZ.ai (Zhipu)xAI
Noometry Index40.941.0
Released2025-09-302025-04-09
WeightsOpenProprietary
Context window205K—
Max output131K—
Input $ / M tokens$0.60—
Output $ / M tokens$2.20—
Results tracked2935

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

GLM-4.6: 39.9 (#137), Grok-3 mini: 40.4 (#126)

BenchmarkGLM-4.6Grok-3 mini
LMArena Coding14491380
SWE-bench Verified (bash only)55.4%—
Aider Polyglot—49.3%
LMArena WebDev1339—
SciCode38.4%—
WeirdML—42.6%
ALE-Bench340.82—

Agentic & Tool Use Not comparable

GLM-4.6: 32.1 (#60), Grok-3 mini: —

BenchmarkGLM-4.6Grok-3 mini
Terminal-Bench24.5%—
Berkeley Function Calling Leaderboard72.4%—

Reasoning GLM-4.6 leads

GLM-4.6: 23.1 (#168), Grok-3 mini: 13.8 (#323)

BenchmarkGLM-4.6Grok-3 mini
Kagi LLM Benchmark47.4%61.3%
LMArena Hard Prompts14401374
ARC-AGI-2—0.4%
ARC-AGI-1—16.5%
CritPt1.1%—
Epoch Capabilities Index—140.35

Math Grok-3 mini leads

GLM-4.6: 36.4 (#115), Grok-3 mini: 40.3 (#78)

BenchmarkGLM-4.6Grok-3 mini
LMArena Math14311386
FrontierMath (Feb 2025 set)3.8%5.9%
OTIS Mock AIME 2024-2025—77.8%
Omni-MATH—31.8%
MATH Level 5—90.9%
FrontierMath Tier 4 (v1)2.1%—

Knowledge Grok-3 mini leads

GLM-4.6: 39.6 (#118), Grok-3 mini: 46.3 (#75)

BenchmarkGLM-4.6Grok-3 mini
LMArena Expert14321395
GPQA Diamond—76.3%
MMLU-Pro—79.9%
Confabulations—10.8%
Vectara Hallucination Rate9.5%—
GPQA (HELM)—67.5%

Multilingual GLM-4.6 leads

GLM-4.6: 53.6 (#62), Grok-3 mini: 48.3 (#141)

BenchmarkGLM-4.6Grok-3 mini
LMArena Non-English14261352
LMArena Chinese15001387
LMArena French14591357
LMArena German14471350
LMArena Japanese13941343
LMArena Korean14011336
LMArena Russian14181352
LMArena Spanish14361379

Instruction Following Grok-3 mini leads

GLM-4.6: 74.5 (#93), Grok-3 mini: 78.7 (#8)

BenchmarkGLM-4.6Grok-3 mini
LMArena Instruction Following14101356
IFEval—95.1%

Long Context GLM-4.6 leads

GLM-4.6: 43.4 (#91), Grok-3 mini: 41.0 (#142)

BenchmarkGLM-4.6Grok-3 mini
LMArena Longer Query14231372
Fiction.LiveBench—66.7%

Writing & Preference GLM-4.6 leads

GLM-4.6: 61.3 (#86), Grok-3 mini: 52.7 (#163)

BenchmarkGLM-4.6Grok-3 mini
LMArena Text14401370
LMArena Creative Writing14111342
LMArena Multi-Turn14271355
Short-Story Creative Writing—73.5%
EQ-Bench Creative Writing1411—
WildBench—65.1%

Frequently asked questions

Is GLM-4.6 better than Grok-3 mini?

GLM-4.6 and Grok-3 mini score almost the same on the Noometry Index (40.9 vs 41.0), so choose on price, context window or the category you care about most.

Is GLM-4.6 or Grok-3 mini better for coding?

They score almost the same on coding (39.9 vs 40.4); test both on your own repository before choosing.

How many benchmarks do GLM-4.6 and Grok-3 mini share?

19 benchmarks have published results for both models. GLM-4.6 has 29 scored results on Noometry and Grok-3 mini has 35.

Related comparisons

Go deeper